-- Logs begin at Mon 2022-01-10 17:13:03 UTC, end at Mon 2022-01-10 18:08:43 UTC. -- Jan 10 17:36:47.735163 dv-cinder-824031-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jan 10 17:36:47.744256 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jan 10 17:36:47.746840 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 10 17:36:47 2022] *** Jan 10 17:36:47.746984 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 10 17:36:47.747089 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 10 17:36:47.747183 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: nodename: dv-cinder-824031-2-iscsi Jan 10 17:36:47.747274 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: machine: x86_64 Jan 10 17:36:47.747382 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: clock source: unix Jan 10 17:36:47.747499 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: pcre jit disabled Jan 10 17:36:47.747643 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: detected number of CPU cores: 4 Jan 10 17:36:47.747643 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: current working directory: / Jan 10 17:36:47.747643 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: detected binary path: /usr/bin/uwsgi-core Jan 10 17:36:47.747643 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: your processes number limit is 47680 Jan 10 17:36:47.747643 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: your memory page size is 4096 bytes Jan 10 17:36:47.747643 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: detected max file descriptor number: 2048 Jan 10 17:36:47.747643 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: lock engine: pthread robust mutexes Jan 10 17:36:47.748055 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: thunder lock: enabled Jan 10 17:36:47.748055 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jan 10 17:36:47.748055 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 10 17:36:47.798465 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: Python main interpreter initialized at 0x5639832879c0 Jan 10 17:36:47.798465 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: python threads support enabled Jan 10 17:36:47.798465 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: your server socket listen backlog is limited to 100 connections Jan 10 17:36:47.798465 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: your mercy for graceful operations on workers is 90 seconds Jan 10 17:36:47.798795 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: mapped 403077 bytes (393 KB) for 2 cores Jan 10 17:36:47.798867 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: *** Operational MODE: preforking *** Jan 10 17:36:47.799131 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: *** uWSGI is running in multiple interpreter mode *** Jan 10 17:36:47.799131 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: spawned uWSGI master process (pid: 90751) Jan 10 17:36:47.799342 dv-cinder-824031-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jan 10 17:36:47.800628 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: spawned uWSGI worker 1 (pid: 90762, cores: 1) Jan 10 17:36:47.800628 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: spawned uWSGI worker 2 (pid: 90763, cores: 1) Jan 10 17:36:47.800628 dv-cinder-824031-2-iscsi devstack@keystone.service[90751]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 10 17:36:53.044690 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 17:36:53.044690 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: from cryptography.utils import int_from_bytes Jan 10 17:36:53.045512 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 17:36:53.045512 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: from cryptography.utils import int_from_bytes Jan 10 17:36:53.045914 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 17:36:53.045914 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: from cryptography.utils import int_from_bytes Jan 10 17:36:53.046011 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 17:36:53.046011 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: from cryptography.utils import int_from_bytes Jan 10 17:36:53.089355 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 10 17:36:53.089531 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 10 17:36:53.089683 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 10 17:36:53.089833 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] command line args: [] {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 10 17:36:53.089923 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 10 17:36:53.090002 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 10 17:36:53.090077 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] command line args: [] {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 10 17:36:53.090156 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ================================================================================ {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 10 17:36:53.090321 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 10 17:36:53.090413 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] admin_token = **** {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.090484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ================================================================================ {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 10 17:36:53.090559 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] config_dir = [] {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.090713 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] admin_token = **** {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.090833 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.090906 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] config_source = [] {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.090975 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] config_dir = [] {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.091045 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] debug = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.091110 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.091352 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.091575 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] config_source = [] {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.091575 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] debug = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.091703 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.091764 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.091852 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] insecure_debug = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.091917 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.091979 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.092046 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] insecure_debug = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.092284 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.092372 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.092438 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] list_limit = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.092501 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.092570 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] log_config_append = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.092730 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] list_limit = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.092808 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.092905 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] log_config_append = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.092975 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] log_dir = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.093123 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] log_file = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.093211 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.093278 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] log_dir = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.093340 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.093489 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] log_file = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.093572 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.093721 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.093869 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.093957 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.094035 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.094151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.094251 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.094324 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.094399 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.094591 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.094717 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.094717 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.094864 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.094930 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.094999 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.095209 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.095327 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.095393 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.095460 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.095641 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.095736 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.095855 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.095932 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.096118 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.096249 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] notification_format = cadf {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.096338 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.096416 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.096549 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] notification_format = cadf {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.096885 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.31/identity {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.097017 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.097111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] publish_errors = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.097271 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.097461 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.31/identity {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.097554 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.097637 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] publish_errors = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.097708 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.097909 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.097984 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.098102 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.098243 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.098330 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.098411 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] standard_threads = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.098487 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.098556 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] strict_password_check = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.098676 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.098756 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.098874 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] standard_threads = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.098947 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] use_eventlog = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.099029 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] strict_password_check = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.099105 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] use_journal = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.099269 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] use_json = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.099398 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.099483 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] use_stderr = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.099555 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] use_eventlog = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.099623 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] use_syslog = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.099746 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] use_journal = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.099746 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] use_json = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.099891 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] watch_log_file = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.100004 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] use_stderr = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.100087 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.100163 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] use_syslog = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.100237 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.100314 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] watch_log_file = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 17:36:53.100507 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.100628 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.100704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.100774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.101004 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.101220 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.101306 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.101386 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.101456 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.101525 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.101687 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.101868 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.101952 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.102023 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.102134 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.102224 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.102403 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.102531 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.102616 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.102692 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.102858 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.102979 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.103072 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.103152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.103302 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.103388 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.103534 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.103612 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.103758 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.103836 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.104008 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.104094 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.104240 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.104318 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.104451 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.104525 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.104696 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.104776 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.104967 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.105060 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.105207 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.105291 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.105456 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.105534 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.105698 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.105778 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.105923 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.106003 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.106149 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.106241 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.106371 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.106455 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.106609 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.106682 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.106825 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.106908 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.107056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.107141 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.107277 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.107361 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.107504 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.107583 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.107725 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.107806 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.107950 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.108025 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.108185 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.108258 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.108425 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.108499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.108653 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.108728 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.108900 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.109026 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.109132 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.109219 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.109358 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.109435 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.109583 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.109657 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.109808 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.109889 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.110030 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.110143 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.110247 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.110340 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.110469 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.110581 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.110698 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.110802 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.110943 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.111088 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.111185 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.111312 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.111391 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.111537 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.111623 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.111735 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.111807 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.111927 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.112025 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.112111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.112252 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.112328 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.112484 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.112570 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.112714 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.112790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.112966 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.113045 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.113199 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.113286 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.113475 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.113555 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.113710 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.113831 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.113939 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.114014 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.114170 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.114250 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.114396 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.114517 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.114628 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.114703 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.114861 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.114951 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.115083 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.115197 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.115313 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.115390 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.115545 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.115633 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.115782 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.115863 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.116017 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.116092 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.116256 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.116340 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.116486 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.116561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.116728 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] cache.enabled = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.116805 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.116986 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.117075 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.117217 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.117293 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] cache.enabled = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.117448 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.117525 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.117680 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.117830 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.117902 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.117971 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.118125 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.118202 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.118364 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.118453 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.118597 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.118675 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.118828 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.118903 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.119054 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.119141 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.119281 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.119357 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.119506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.119584 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.119736 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.119813 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.119960 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.120042 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.120192 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.120266 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.120417 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.120501 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.120654 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.120730 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.120899 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.120979 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.121149 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.121224 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.121386 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.121463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.121616 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.121692 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.121857 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] auth.external = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.121932 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.122081 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] auth.mapped = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.122158 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.122323 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] auth.external = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.122397 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.122552 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] auth.mapped = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.122627 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.122795 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] auth.password = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.122876 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.123020 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] auth.token = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.123102 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.123254 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.123340 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] auth.password = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.123486 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] catalog.caching = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.123562 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] auth.token = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.123720 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.123794 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.123941 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.124027 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] catalog.caching = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.124182 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.124257 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.124408 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.124489 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.124634 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.124717 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.124893 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] credential.caching = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.125008 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.125125 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] credential.driver = sql {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.125204 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.125367 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.125443 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] credential.caching = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.125607 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.125692 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] credential.driver = sql {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.125838 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.125915 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.126074 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.126151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.126303 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.126389 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.126542 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.126657 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.126783 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.126858 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.127009 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.127092 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.127254 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.127331 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.127489 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.127564 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.127744 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.127827 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.127994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.128070 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.128229 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.128305 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.128478 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.128563 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.128708 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] federation.caching = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.128791 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.129010 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.129090 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.129249 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] federation.caching = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.129341 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] federation.driver = sql {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.129490 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.129565 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.129714 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.129791 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] federation.driver = sql {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.129954 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.130040 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.130182 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.130257 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.130426 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.130502 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.130656 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.130743 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.130902 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.130979 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.131134 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.131211 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.131376 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.131531 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.131604 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] identity.caching = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.131673 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.131834 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.131910 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.132065 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] identity.caching = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.132148 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.132292 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.132367 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.132521 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.132599 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.132766 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] identity.driver = sql {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.132903 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.133015 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.133094 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.133247 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.133332 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] identity.driver = sql {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.133476 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.133559 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.133712 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.133788 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.133945 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.134020 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.134172 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.134256 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.134396 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.134473 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.134628 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.134704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.134856 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.134940 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.135098 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.135180 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.135343 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.135419 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.135583 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.135659 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.135834 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.135909 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.136071 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.136146 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.136305 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.136383 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.136532 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.136608 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.136765 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.136842 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.137021 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.137100 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.137253 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.137328 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.137484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.137559 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.137714 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.137791 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.137950 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.138025 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.138173 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.138248 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.138417 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.138494 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.138643 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.138719 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.138877 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.138958 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.139118 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.139196 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.139346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.139428 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.139571 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.139649 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.139804 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.139882 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.140030 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.password = **** {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.140107 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.140262 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.140337 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.140490 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.password = **** {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.140575 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.140723 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.140798 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.140978 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.141058 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.141212 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.141290 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.141446 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.141544 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.141681 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.141793 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.141955 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.142032 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.142204 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.142281 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.142435 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.142511 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.142665 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.142743 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.142907 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.142981 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.143137 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.143213 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.143370 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.143446 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.143592 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.user = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.143673 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.143824 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.143900 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.144055 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.user = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.144132 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.144284 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.144359 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.144528 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.144663 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.144833 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.144929 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.145099 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.145174 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.145329 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.145405 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.145557 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.145636 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.145788 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.145868 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.146014 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.146089 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.146240 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.146317 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.146466 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.146542 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.146698 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.146773 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.146931 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.147008 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.147172 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.147247 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.147411 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.147488 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.147652 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.147730 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.147877 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.147962 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.148467 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.148552 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.148700 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.148776 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.148951 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.149031 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.149187 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.149276 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.149418 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.149494 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.149650 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.149724 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.149884 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.149968 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.150112 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.150188 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.150360 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.150435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] policy.driver = sql {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.150584 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.150666 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.150822 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.150899 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] policy.driver = sql {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.151047 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.151129 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.151274 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] receipt.caching = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.151357 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.151505 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.151582 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.151734 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] receipt.caching = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.151809 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.151968 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.152052 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.152192 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.152275 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.152422 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.152499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.152656 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] resource.caching = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.152740 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.152909 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.152990 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.153152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] resource.caching = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.153231 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] resource.driver = sql {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.153388 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.153471 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.153630 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.153707 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] resource.driver = sql {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.153862 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.153937 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.154089 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] revoke.caching = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.154237 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.154331 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.154409 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.154561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] revoke.caching = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.154637 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.154792 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] role.cache_time = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.154879 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.155022 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] role.caching = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.155099 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.155256 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] role.cache_time = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.155330 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] role.driver = sql {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.155477 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] role.list_limit = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.155560 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] role.caching = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.155723 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] role.driver = sql {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.155798 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.155953 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] role.list_limit = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.156035 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.156193 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.156277 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.156435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.156512 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.156675 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.156752 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.156940 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.157032 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.157187 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.157264 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.157425 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.157500 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.157651 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.157739 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.157892 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.157969 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.158121 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.158198 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.158360 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.158446 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.158601 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.158678 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.158841 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.158983 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.159087 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.159215 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.159460 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.159537 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.159697 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.159773 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.159937 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.160014 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.160205 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.160281 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.160460 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.160535 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.160707 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.160784 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.160962 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.161040 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.161218 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.161295 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.161443 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.161521 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.161671 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.161751 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.161898 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.161975 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.162128 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.162211 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.162358 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.162435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.162610 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.162686 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.162849 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.162925 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.163081 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.163157 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.163311 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] token.cache_time = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.163390 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.163542 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.163620 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] token.caching = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.163770 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.163846 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] token.cache_time = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.164001 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] token.caching = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.164076 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] token.provider = fernet {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.164226 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.164302 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.164470 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] token.provider = fernet {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.164584 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.164705 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.164807 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.164962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.165038 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.165183 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.165261 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.165418 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.165495 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.165660 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] trust.driver = sql {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.165739 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.165890 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.165967 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.166122 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.166199 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] trust.driver = sql {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.166349 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.166427 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.166583 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.166658 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.166817 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.166901 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.167037 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.167113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.167272 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.167349 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.167508 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.167591 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.167749 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.167871 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] database.connection = **** {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.168012 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.168111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.168273 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] database.connection = **** {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.168357 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.168521 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.168598 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.168767 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.168843 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.169027 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.169115 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.169260 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.169335 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.169489 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.169565 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.169718 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.169801 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.169949 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.170025 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.170182 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.170264 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.170450 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.170536 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.170680 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.170764 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.170920 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.171006 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.171150 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.171227 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.171392 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.171474 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.171619 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.171698 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.171855 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.171932 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.172081 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.172157 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.172235 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 10 17:36:53.172307 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.172539 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 17:36:53.172707 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 10 17:36:53.201702 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.201965 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.202190 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.202747 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.202981 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.203202 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.210713 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.211671 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.239506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.239695 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.240176 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.240416 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.291764 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.292908 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.340632 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.340769 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.341237 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.341445 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.405611 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.405774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.405859 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.405935 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.405997 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.406092 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.406200 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.406286 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.406411 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.406498 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.406622 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.406710 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.429993 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.430231 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.430381 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.430464 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.430529 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.430623 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.430709 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.430875 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.431005 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.431087 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.431165 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.431262 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.431349 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.431521 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.442548 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.442863 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.455049 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.455267 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.455523 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.455666 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.455762 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.455838 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.455914 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.455986 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.456102 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.456192 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.456299 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.456387 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.456527 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.456766 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 17:36:53.473336 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.473521 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 10 17:36:53.473745 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.473873 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.473941 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 10 17:36:53.474022 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 10 17:36:53.474232 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.474357 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.474437 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 10 17:36:53.474511 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.474713 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.474851 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.474934 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.475009 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.475178 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.475446 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.485660 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.485937 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.486060 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.486203 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.486334 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.486483 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.486629 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.486734 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.494409 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=90763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.494638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=90762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.497610 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=90763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.497791 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=90762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.497886 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.498099 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.498225 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.498396 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.498503 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.498739 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.498864 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.499005 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.499096 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.499239 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.499344 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.499532 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.499658 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.499790 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.499882 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.500029 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.500122 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.500308 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.500432 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.500566 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.526431 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.526552 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.528003 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=90762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.528129 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=90763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.528257 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.528364 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.533377 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=90762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.533502 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=90763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.533631 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.533723 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.533910 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.534055 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.540964 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=90762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.541089 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=90763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.541225 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.541317 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.545674 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=90762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.545951 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.546225 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.546514 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.546764 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.547031 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.547291 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.547416 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=90763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.547553 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.547646 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.547859 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.548136 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.548412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.548667 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.548955 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.549222 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.565566 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.565832 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.567315 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.567587 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.570381 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=90762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.571989 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=90763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.573961 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.574246 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.575533 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.575819 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.579089 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=90762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.580694 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=90763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.582638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=90762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.584275 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=90763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.586322 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.586613 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.586899 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.587159 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.587425 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.587715 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.587983 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.588277 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.588552 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.588830 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.589120 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.589391 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.606280 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=90762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.606591 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.606853 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.607122 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.607863 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=90763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.608134 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.608482 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.608748 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.614777 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.616423 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.616547 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.616708 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.618122 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.618390 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.619616 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=90762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.619903 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.620169 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.620447 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.620724 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.621368 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=90763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.621642 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.621873 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.622186 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.622469 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.633723 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=90762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.634005 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.634269 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.634542 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.634810 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.635074 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.635346 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.637285 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=90763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.637558 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.637838 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.638133 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.638409 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.638674 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.638939 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.654245 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=90762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.656761 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=90763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.657421 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=90762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.659950 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=90763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.660709 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.662271 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.663231 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.663863 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=90762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.664111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.664422 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.664767 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.666383 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=90763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.666662 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.666953 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.671596 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.673174 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=90762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.674135 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.675695 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=90763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.676302 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.676580 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.676887 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.677157 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.678976 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.679323 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.679686 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.680024 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.686081 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=90762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.686361 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.686630 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.689069 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=90763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.689364 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.689627 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.694339 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=90762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.694611 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.694880 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.695151 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.695420 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.695693 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.695965 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.696209 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.696479 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.696699 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.697019 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.697291 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.697487 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=90763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 17:36:53.697633 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.697783 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.697917 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=90762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.698048 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.698178 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.698388 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.698646 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.698929 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.699192 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.699468 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.699733 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.699999 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.700254 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.700521 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.700783 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=90763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 17:36:53.734588 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5639832879c0 pid: 90762 (default app) Jan 10 17:36:53.737484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5639832879c0 pid: 90763 (default app) Jan 10 17:36:53.738013 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f7860-a570-4667-89c9-09499d3ed5e1 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:36:53.738313 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f7860-a570-4667-89c9-09499d3ed5e1 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:36:53.738612 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f7860-a570-4667-89c9-09499d3ed5e1 None None] PATH_INFO: `/v3` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:36:53.742828 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1/1] 10.222.0.31 () {50 vars in 791 bytes} [Mon Jan 10 17:36:53 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:01.656209 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3565a6-4921-499b-83cc-e33d1a2c0e17 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:01.656757 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3565a6-4921-499b-83cc-e33d1a2c0e17 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:01.656757 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3565a6-4921-499b-83cc-e33d1a2c0e17 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:01.661970 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1/2] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:37:01.672893 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2345b3-cb33-4bdb-951e-7aed7e2bcb48 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:01.673308 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2345b3-cb33-4bdb-951e-7aed7e2bcb48 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:01.673471 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2345b3-cb33-4bdb-951e-7aed7e2bcb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:01.705558 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG oslo_db.sqlalchemy.engines [None req-cd2345b3-cb33-4bdb-951e-7aed7e2bcb48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=90762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 17:37:01.996820 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG passlib.handlers.bcrypt [None req-cd2345b3-cb33-4bdb-951e-7aed7e2bcb48 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=90762) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 10 17:37:01.997166 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG passlib.handlers.bcrypt [None req-cd2345b3-cb33-4bdb-951e-7aed7e2bcb48 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=90762) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 10 17:37:02.053464 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-cd2345b3-cb33-4bdb-951e-7aed7e2bcb48 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:02.055055 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-cd2345b3-cb33-4bdb-951e-7aed7e2bcb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:02.189095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 2/3] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 518 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:02.381905 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3565a6-4921-499b-83cc-e33d1a2c0e17 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:02.423059 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG oslo_db.sqlalchemy.engines [None req-3d3565a6-4921-499b-83cc-e33d1a2c0e17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=90763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 17:37:02.564638 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3565a6-4921-499b-83cc-e33d1a2c0e17 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:02.570153 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c40af-76b5-4698-b3f4-09fd64db96ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:02.570816 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c40af-76b5-4698-b3f4-09fd64db96ba admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:02.571107 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c40af-76b5-4698-b3f4-09fd64db96ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:02.571381 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c40af-76b5-4698-b3f4-09fd64db96ba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:02.580533 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c40af-76b5-4698-b3f4-09fd64db96ba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:02.631118 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6a7c40af-76b5-4698-b3f4-09fd64db96ba admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 10 17:37:02.631454 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c40af-76b5-4698-b3f4-09fd64db96ba admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:02.641570 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 2/4] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:02.651522 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2345b3-cb33-4bdb-951e-7aed7e2bcb48 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:02.669329 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2345b3-cb33-4bdb-951e-7aed7e2bcb48 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:02.675819 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857a464-f4b7-4f29-8c83-8e1895c0e0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:02.677040 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857a464-f4b7-4f29-8c83-8e1895c0e0bd admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:02.677323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857a464-f4b7-4f29-8c83-8e1895c0e0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:02.677601 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857a464-f4b7-4f29-8c83-8e1895c0e0bd admin admin] PATH_INFO: `/v3/projects/ef5870ae6e4a4492ac99ab89391674b9` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:02.679401 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857a464-f4b7-4f29-8c83-8e1895c0e0bd admin admin] RBAC: Authorizing `identity:get_project(project_id=ef5870ae6e4a4492ac99ab89391674b9)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:02.730069 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a857a464-f4b7-4f29-8c83-8e1895c0e0bd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 10 17:37:02.730411 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857a464-f4b7-4f29-8c83-8e1895c0e0bd admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:02.735121 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 3/5] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:02 2022] GET /identity/v3/projects/ef5870ae6e4a4492ac99ab89391674b9 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:05.059573 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe62f7-912a-404a-9613-80a4b96f1f40 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:05.060065 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe62f7-912a-404a-9613-80a4b96f1f40 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:05.060065 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe62f7-912a-404a-9613-80a4b96f1f40 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:05.067144 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 3/6] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:05.075788 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12932f-696b-438d-bd4b-8961c6aa33ed None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:05.076292 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12932f-696b-438d-bd4b-8961c6aa33ed None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:05.076370 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12932f-696b-438d-bd4b-8961c6aa33ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:05.103695 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-1e12932f-696b-438d-bd4b-8961c6aa33ed None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:05.105270 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-1e12932f-696b-438d-bd4b-8961c6aa33ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:05.115092 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 4/7] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:05.149814 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe62f7-912a-404a-9613-80a4b96f1f40 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:05.164470 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe62f7-912a-404a-9613-80a4b96f1f40 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:05.169721 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e849cc-ea38-402a-84d6-18bc86ae1075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:05.170367 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e849cc-ea38-402a-84d6-18bc86ae1075 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:05.170649 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e849cc-ea38-402a-84d6-18bc86ae1075 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:05.170919 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e849cc-ea38-402a-84d6-18bc86ae1075 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:05.179025 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e849cc-ea38-402a-84d6-18bc86ae1075 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:05.180817 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e849cc-ea38-402a-84d6-18bc86ae1075 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:05.189906 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 4/8] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:05.195572 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12932f-696b-438d-bd4b-8961c6aa33ed None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:05.205614 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12932f-696b-438d-bd4b-8961c6aa33ed None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:05.211969 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaf567-e2a9-4d2c-9ef1-a1d3cde8e4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:05.212883 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaf567-e2a9-4d2c-9ef1-a1d3cde8e4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:05.213169 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaf567-e2a9-4d2c-9ef1-a1d3cde8e4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:05.213443 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaf567-e2a9-4d2c-9ef1-a1d3cde8e4a3 admin admin] PATH_INFO: `/v3/users/8900330194a64240acfd4144b4e26c1b` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:05.215064 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfaf567-e2a9-4d2c-9ef1-a1d3cde8e4a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=8900330194a64240acfd4144b4e26c1b)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:05.216944 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfaf567-e2a9-4d2c-9ef1-a1d3cde8e4a3 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:05.218520 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 5/9] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:05 2022] GET /identity/v3/users/8900330194a64240acfd4144b4e26c1b => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:07.620072 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fd656-57b4-44d7-ad48-b1ffca400dbc None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:07.620595 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fd656-57b4-44d7-ad48-b1ffca400dbc None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:07.620741 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fd656-57b4-44d7-ad48-b1ffca400dbc None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:07.622558 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 5/10] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:07.627791 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90538b-29d3-426b-819f-1e97b809c52a None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:07.628217 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90538b-29d3-426b-819f-1e97b809c52a None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:07.628300 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90538b-29d3-426b-819f-1e97b809c52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:07.631506 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cee2af-ccd9-4f3a-8000-8988b36a44e5 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:07.631790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cee2af-ccd9-4f3a-8000-8988b36a44e5 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:07.632061 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cee2af-ccd9-4f3a-8000-8988b36a44e5 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:07.633677 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 6/11] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:37:07.640006 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09393e9f-d1f7-4728-81d1-7b77106eee52 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:07.640287 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09393e9f-d1f7-4728-81d1-7b77106eee52 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:07.640563 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09393e9f-d1f7-4728-81d1-7b77106eee52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:07.646224 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-2a90538b-29d3-426b-819f-1e97b809c52a None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:07.647417 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-2a90538b-29d3-426b-819f-1e97b809c52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:07.655458 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 6/12] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:07.679743 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90538b-29d3-426b-819f-1e97b809c52a None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:07.681419 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG passlib.handlers.bcrypt [None req-09393e9f-d1f7-4728-81d1-7b77106eee52 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=90763) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 10 17:37:07.681844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG passlib.handlers.bcrypt [None req-09393e9f-d1f7-4728-81d1-7b77106eee52 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=90763) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 10 17:37:07.688604 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90538b-29d3-426b-819f-1e97b809c52a None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:07.693541 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93332e07-a973-4048-960e-60a6adb593b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:07.694323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93332e07-a973-4048-960e-60a6adb593b4 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:07.694606 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93332e07-a973-4048-960e-60a6adb593b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:07.694877 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93332e07-a973-4048-960e-60a6adb593b4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:07.708035 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93332e07-a973-4048-960e-60a6adb593b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:07.714878 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-93332e07-a973-4048-960e-60a6adb593b4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:37:07.718175 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 7/13] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:37:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:37:07.721617 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93332e07-a973-4048-960e-60a6adb593b4 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:07.727916 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-09393e9f-d1f7-4728-81d1-7b77106eee52 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:07.729531 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-09393e9f-d1f7-4728-81d1-7b77106eee52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:07.731516 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93332e07-a973-4048-960e-60a6adb593b4 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:07.736457 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e99b6-a835-4d92-8121-9210b8a7769d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:07.737139 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e99b6-a835-4d92-8121-9210b8a7769d admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:07.737424 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e99b6-a835-4d92-8121-9210b8a7769d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:07.737702 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e99b6-a835-4d92-8121-9210b8a7769d admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:07.738476 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e99b6-a835-4d92-8121-9210b8a7769d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:07.738783 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e99b6-a835-4d92-8121-9210b8a7769d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:07.740555 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING py.warnings [None req-dd3e99b6-a835-4d92-8121-9210b8a7769d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:37:07.740555 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: warnings.warn(msg) Jan 10 17:37:07.740555 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: Jan 10 17:37:07.741498 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e99b6-a835-4d92-8121-9210b8a7769d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:07.751179 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 7/14] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:07.755558 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 8/15] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:07.761037 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09393e9f-d1f7-4728-81d1-7b77106eee52 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:07.770717 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09393e9f-d1f7-4728-81d1-7b77106eee52 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:07.772931 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e99b6-a835-4d92-8121-9210b8a7769d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:07.775924 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f663ee9-80e1-41f4-be39-ec917b0d156b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:07.777198 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f663ee9-80e1-41f4-be39-ec917b0d156b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:07.777484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f663ee9-80e1-41f4-be39-ec917b0d156b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:07.777745 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f663ee9-80e1-41f4-be39-ec917b0d156b admin admin] PATH_INFO: `/v3/users/8900330194a64240acfd4144b4e26c1b` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:07.779421 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f663ee9-80e1-41f4-be39-ec917b0d156b admin admin] RBAC: Authorizing `identity:get_user(user_id=8900330194a64240acfd4144b4e26c1b)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:07.781337 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f663ee9-80e1-41f4-be39-ec917b0d156b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:07.782927 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 8/16] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:07 2022] GET /identity/v3/users/8900330194a64240acfd4144b4e26c1b => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:07.783243 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e99b6-a835-4d92-8121-9210b8a7769d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:07.788245 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889caf8-ddaa-4cfa-a1da-30b19e8d871b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:07.788510 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f663ee9-80e1-41f4-be39-ec917b0d156b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:07.788948 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889caf8-ddaa-4cfa-a1da-30b19e8d871b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:07.789233 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889caf8-ddaa-4cfa-a1da-30b19e8d871b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:07.789506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889caf8-ddaa-4cfa-a1da-30b19e8d871b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:07.797841 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889caf8-ddaa-4cfa-a1da-30b19e8d871b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:07.798346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f663ee9-80e1-41f4-be39-ec917b0d156b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:07.799636 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889caf8-ddaa-4cfa-a1da-30b19e8d871b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:07.802796 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b392fbe-fa1b-43af-8f77-b922cdc211c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:07.803585 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b392fbe-fa1b-43af-8f77-b922cdc211c8 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:07.803867 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b392fbe-fa1b-43af-8f77-b922cdc211c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:07.804493 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b392fbe-fa1b-43af-8f77-b922cdc211c8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:07.805369 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b392fbe-fa1b-43af-8f77-b922cdc211c8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:07.807055 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b392fbe-fa1b-43af-8f77-b922cdc211c8 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:07.808235 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 9/17] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:07.808617 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 9/18] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:37:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:07.813735 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889caf8-ddaa-4cfa-a1da-30b19e8d871b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:07.814222 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b392fbe-fa1b-43af-8f77-b922cdc211c8 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:07.821951 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889caf8-ddaa-4cfa-a1da-30b19e8d871b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:07.823450 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b392fbe-fa1b-43af-8f77-b922cdc211c8 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:07.826508 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389f48a-df44-43f0-af19-3bfedd923304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:07.827298 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389f48a-df44-43f0-af19-3bfedd923304 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:07.827577 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389f48a-df44-43f0-af19-3bfedd923304 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:07.827739 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccc9dc-3c7d-41fe-b424-c30480b471bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:07.827848 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389f48a-df44-43f0-af19-3bfedd923304 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:07.828357 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccc9dc-3c7d-41fe-b424-c30480b471bf admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:07.828641 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccc9dc-3c7d-41fe-b424-c30480b471bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:07.828945 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccc9dc-3c7d-41fe-b424-c30480b471bf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:07.829065 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389f48a-df44-43f0-af19-3bfedd923304 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:07.829778 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccc9dc-3c7d-41fe-b424-c30480b471bf admin admin] RBAC: Adding query filter params (role.id=3c05bedf79e04eb38d2ae66736030bfe, scope.domain.id=default, user.id=8900330194a64240acfd4144b4e26c1b) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:07.830084 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccc9dc-3c7d-41fe-b424-c30480b471bf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:07.830762 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389f48a-df44-43f0-af19-3bfedd923304 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:07.831830 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING py.warnings [None req-c9ccc9dc-3c7d-41fe-b424-c30480b471bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:37:07.831830 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: warnings.warn(msg) Jan 10 17:37:07.831830 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: Jan 10 17:37:07.832320 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 10/19] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:37:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:07.833013 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccc9dc-3c7d-41fe-b424-c30480b471bf admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:07.842939 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 10/20] 10.222.0.31 () {56 vars in 1343 bytes} [Mon Jan 10 17:37:07 2022] GET /identity/v3/role_assignments?user.id=8900330194a64240acfd4144b4e26c1b&scope.domain.id=default&role.id=3c05bedf79e04eb38d2ae66736030bfe => generated 233 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:10.627131 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c45c48-1e41-421b-9493-513834eae2ff None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:10.628191 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c45c48-1e41-421b-9493-513834eae2ff None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:10.628969 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c45c48-1e41-421b-9493-513834eae2ff None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:10.631415 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 11/21] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:10.635204 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b3edb-e8e2-4f5c-a52f-adf1542a6f52 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:10.636143 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b3edb-e8e2-4f5c-a52f-adf1542a6f52 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:10.636614 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b3edb-e8e2-4f5c-a52f-adf1542a6f52 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:10.639108 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 11/22] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:10.643608 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64734895-8631-4b4c-a766-b200bd27223c None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:10.643894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64734895-8631-4b4c-a766-b200bd27223c None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:10.644479 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64734895-8631-4b4c-a766-b200bd27223c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:10.650440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567e69c-4cbe-4b69-a10e-267de7ed961a None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:10.650722 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567e69c-4cbe-4b69-a10e-267de7ed961a None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:10.651152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567e69c-4cbe-4b69-a10e-267de7ed961a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:10.673995 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-64734895-8631-4b4c-a766-b200bd27223c None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:10.675232 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-64734895-8631-4b4c-a766-b200bd27223c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:10.676121 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-5567e69c-4cbe-4b69-a10e-267de7ed961a None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:10.677628 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-5567e69c-4cbe-4b69-a10e-267de7ed961a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:10.688381 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 12/23] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:10.689948 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 12/24] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:37:10.713611 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64734895-8631-4b4c-a766-b200bd27223c None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:10.723491 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64734895-8631-4b4c-a766-b200bd27223c None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:10.732691 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d1740-dde1-44f4-bd05-94defe6a1f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:10.734387 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d1740-dde1-44f4-bd05-94defe6a1f33 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:10.734864 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d1740-dde1-44f4-bd05-94defe6a1f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:10.735328 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d1740-dde1-44f4-bd05-94defe6a1f33 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:10.740798 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567e69c-4cbe-4b69-a10e-267de7ed961a None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:10.750349 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567e69c-4cbe-4b69-a10e-267de7ed961a None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:10.764012 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb347e-002b-467c-b818-070ebaca713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:10.765187 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb347e-002b-467c-b818-070ebaca713c admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:10.765660 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb347e-002b-467c-b818-070ebaca713c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:10.766119 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb347e-002b-467c-b818-070ebaca713c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:10.766705 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d1740-dde1-44f4-bd05-94defe6a1f33 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:10.774161 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-c41d1740-dde1-44f4-bd05-94defe6a1f33 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:37:10.775380 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 13/25] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:37:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:10.786143 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d1740-dde1-44f4-bd05-94defe6a1f33 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:10.797264 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d1740-dde1-44f4-bd05-94defe6a1f33 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:10.808600 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706eb91-1ddf-4a05-aaa5-37f97966ea23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:10.809572 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706eb91-1ddf-4a05-aaa5-37f97966ea23 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:10.809990 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706eb91-1ddf-4a05-aaa5-37f97966ea23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:10.810398 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706eb91-1ddf-4a05-aaa5-37f97966ea23 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:10.810784 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb347e-002b-467c-b818-070ebaca713c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:10.811474 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706eb91-1ddf-4a05-aaa5-37f97966ea23 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:10.811916 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706eb91-1ddf-4a05-aaa5-37f97966ea23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:10.813015 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb347e-002b-467c-b818-070ebaca713c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:10.813812 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706eb91-1ddf-4a05-aaa5-37f97966ea23 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:10.831291 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 14/26] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:10.837249 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706eb91-1ddf-4a05-aaa5-37f97966ea23 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:10.838116 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-cedb347e-002b-467c-b818-070ebaca713c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:37:10.839497 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 13/27] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:37:10.845236 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb347e-002b-467c-b818-070ebaca713c admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:10.849127 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706eb91-1ddf-4a05-aaa5-37f97966ea23 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:10.855692 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb347e-002b-467c-b818-070ebaca713c admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:10.859641 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ffc14-021d-4c30-9c1d-56a630c2d85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:10.860773 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ffc14-021d-4c30-9c1d-56a630c2d85a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:10.861301 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ffc14-021d-4c30-9c1d-56a630c2d85a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:10.861849 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ffc14-021d-4c30-9c1d-56a630c2d85a admin admin] PATH_INFO: `/v3/users/8900330194a64240acfd4144b4e26c1b` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:10.863319 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ffc14-021d-4c30-9c1d-56a630c2d85a admin admin] RBAC: Authorizing `identity:get_user(user_id=8900330194a64240acfd4144b4e26c1b)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:10.866154 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ffc14-021d-4c30-9c1d-56a630c2d85a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:10.868430 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 15/28] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:10 2022] GET /identity/v3/users/8900330194a64240acfd4144b4e26c1b => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:10.874030 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ffc14-021d-4c30-9c1d-56a630c2d85a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:10.874198 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5e44c-17ed-4eae-9735-5129331f2967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:10.874828 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5e44c-17ed-4eae-9735-5129331f2967 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:10.875104 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5e44c-17ed-4eae-9735-5129331f2967 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:10.875382 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5e44c-17ed-4eae-9735-5129331f2967 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:10.880926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5e44c-17ed-4eae-9735-5129331f2967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:10.880926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5e44c-17ed-4eae-9735-5129331f2967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:10.880926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING py.warnings [None req-94c5e44c-17ed-4eae-9735-5129331f2967 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:37:10.880926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: warnings.warn(msg) Jan 10 17:37:10.880926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: Jan 10 17:37:10.880926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5e44c-17ed-4eae-9735-5129331f2967 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:10.890435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ffc14-021d-4c30-9c1d-56a630c2d85a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:10.900794 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471f532-48ff-4007-a5c4-379f990ee7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:10.901887 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471f532-48ff-4007-a5c4-379f990ee7fa admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:10.902362 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471f532-48ff-4007-a5c4-379f990ee7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:10.902823 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471f532-48ff-4007-a5c4-379f990ee7fa admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:10.904203 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471f532-48ff-4007-a5c4-379f990ee7fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:10.906143 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471f532-48ff-4007-a5c4-379f990ee7fa admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:10.907969 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 16/29] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:37:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:10.908844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 14/30] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:10.915759 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471f532-48ff-4007-a5c4-379f990ee7fa admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:10.918115 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5e44c-17ed-4eae-9735-5129331f2967 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:10.927496 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471f532-48ff-4007-a5c4-379f990ee7fa admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:10.934392 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5e44c-17ed-4eae-9735-5129331f2967 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:10.937219 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863622c-70a7-4bb5-a3ed-7eae3096afcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:10.938156 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863622c-70a7-4bb5-a3ed-7eae3096afcb admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:10.938584 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863622c-70a7-4bb5-a3ed-7eae3096afcb admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:10.939069 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863622c-70a7-4bb5-a3ed-7eae3096afcb admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:10.939745 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fe956-f6e6-4338-bbc6-05b4c2bc4793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:10.940148 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863622c-70a7-4bb5-a3ed-7eae3096afcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:10.940821 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fe956-f6e6-4338-bbc6-05b4c2bc4793 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:10.941282 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fe956-f6e6-4338-bbc6-05b4c2bc4793 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:10.941656 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fe956-f6e6-4338-bbc6-05b4c2bc4793 admin admin] PATH_INFO: `/v3/domains/default/users/8900330194a64240acfd4144b4e26c1b/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:10.941849 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING py.warnings [None req-6863622c-70a7-4bb5-a3ed-7eae3096afcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:37:10.941849 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: warnings.warn(msg) Jan 10 17:37:10.941849 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: Jan 10 17:37:10.943434 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863622c-70a7-4bb5-a3ed-7eae3096afcb admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:10.950010 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fe956-f6e6-4338-bbc6-05b4c2bc4793 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8900330194a64240acfd4144b4e26c1b, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:10.951322 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING py.warnings [None req-610fe956-f6e6-4338-bbc6-05b4c2bc4793 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:37:10.951322 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: warnings.warn(msg) Jan 10 17:37:10.951322 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: Jan 10 17:37:10.953624 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fe956-f6e6-4338-bbc6-05b4c2bc4793 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:11.174421 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 17/31] 10.222.0.31 () {60 vars in 1162 bytes} [Mon Jan 10 17:37:10 2022] POST /identity/v3/projects => generated 301 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:37:11.292322 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 15/32] 10.222.0.31 () {58 vars in 1382 bytes} [Mon Jan 10 17:37:10 2022] PUT /identity/v3/domains/default/users/8900330194a64240acfd4144b4e26c1b/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:37:11.423005 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fe7dc-36c6-437a-82b5-a31a06919bed None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:11.423712 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fe7dc-36c6-437a-82b5-a31a06919bed None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:11.424201 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fe7dc-36c6-437a-82b5-a31a06919bed None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:11.426493 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 18/33] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:11.433125 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9ce7e-0274-4dce-910c-725d50912dfb None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:11.433416 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9ce7e-0274-4dce-910c-725d50912dfb None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:11.433889 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9ce7e-0274-4dce-910c-725d50912dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:11.462227 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-2ee9ce7e-0274-4dce-910c-725d50912dfb None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:11.464173 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-2ee9ce7e-0274-4dce-910c-725d50912dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:11.554484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 16/34] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:11.596227 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fe7dc-36c6-437a-82b5-a31a06919bed None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:11.615419 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fe7dc-36c6-437a-82b5-a31a06919bed None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:11.621040 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bde31e-5086-4766-b8d2-328568c1ba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:11.621739 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bde31e-5086-4766-b8d2-328568c1ba7c admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:11.622025 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bde31e-5086-4766-b8d2-328568c1ba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:11.622304 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bde31e-5086-4766-b8d2-328568c1ba7c admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:11.623110 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bde31e-5086-4766-b8d2-328568c1ba7c admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:11.624461 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING py.warnings [None req-d9bde31e-5086-4766-b8d2-328568c1ba7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:37:11.624461 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: warnings.warn(msg) Jan 10 17:37:11.624461 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: Jan 10 17:37:11.625435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bde31e-5086-4766-b8d2-328568c1ba7c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:11.657917 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 19/35] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:37:11 2022] POST /identity/v3/roles => generated 225 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:37:11.698673 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511921e-3def-453b-b055-2d67f29152f6 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:11.699622 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511921e-3def-453b-b055-2d67f29152f6 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:11.700101 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511921e-3def-453b-b055-2d67f29152f6 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:11.705579 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 17/36] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:11.712740 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18576cf4-3018-4cfb-b460-6aa8124bcbe7 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:11.713054 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18576cf4-3018-4cfb-b460-6aa8124bcbe7 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:11.713498 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18576cf4-3018-4cfb-b460-6aa8124bcbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:11.745535 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-18576cf4-3018-4cfb-b460-6aa8124bcbe7 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:11.747145 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-18576cf4-3018-4cfb-b460-6aa8124bcbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:11.765505 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 20/37] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:11.810442 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511921e-3def-453b-b055-2d67f29152f6 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:11.827503 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511921e-3def-453b-b055-2d67f29152f6 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:11.835121 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c373a13-2883-429a-8556-7c4790707180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:11.835835 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c373a13-2883-429a-8556-7c4790707180 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:11.836117 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c373a13-2883-429a-8556-7c4790707180 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:11.836397 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c373a13-2883-429a-8556-7c4790707180 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:11.837228 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c373a13-2883-429a-8556-7c4790707180 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:11.838485 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING py.warnings [None req-1c373a13-2883-429a-8556-7c4790707180 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:37:11.838485 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: warnings.warn(msg) Jan 10 17:37:11.838485 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: Jan 10 17:37:11.839427 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c373a13-2883-429a-8556-7c4790707180 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:11.875003 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 18/38] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:37:11 2022] POST /identity/v3/roles => generated 219 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:37:12.100994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39212254-235b-4e86-930c-f0f72aa734ab None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:12.100994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39212254-235b-4e86-930c-f0f72aa734ab None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:12.100994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39212254-235b-4e86-930c-f0f72aa734ab None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:12.101725 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 21/39] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:12.107714 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60e416-e5c9-4d9b-ac7b-82ed71348311 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:12.108231 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60e416-e5c9-4d9b-ac7b-82ed71348311 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:12.108644 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60e416-e5c9-4d9b-ac7b-82ed71348311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:12.130849 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-ce60e416-e5c9-4d9b-ac7b-82ed71348311 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:12.133370 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-ce60e416-e5c9-4d9b-ac7b-82ed71348311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:12.140339 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 19/40] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:12.167713 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39212254-235b-4e86-930c-f0f72aa734ab None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:12.183066 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39212254-235b-4e86-930c-f0f72aa734ab None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:12.188135 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2cee0-246d-4992-8d4a-bbc314a2df04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:12.189221 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2cee0-246d-4992-8d4a-bbc314a2df04 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:12.189669 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2cee0-246d-4992-8d4a-bbc314a2df04 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:12.190075 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2cee0-246d-4992-8d4a-bbc314a2df04 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:12.191487 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2cee0-246d-4992-8d4a-bbc314a2df04 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:12.193647 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2cee0-246d-4992-8d4a-bbc314a2df04 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:12.195476 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 22/41] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:37:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:12.201376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60e416-e5c9-4d9b-ac7b-82ed71348311 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:12.211325 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60e416-e5c9-4d9b-ac7b-82ed71348311 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:12.217920 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f86173-0f2f-476a-8d6e-88dd7db4fb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:12.218833 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f86173-0f2f-476a-8d6e-88dd7db4fb41 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:12.219264 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f86173-0f2f-476a-8d6e-88dd7db4fb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:12.219669 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f86173-0f2f-476a-8d6e-88dd7db4fb41 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:12.220616 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f86173-0f2f-476a-8d6e-88dd7db4fb41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:12.221837 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING py.warnings [None req-b3f86173-0f2f-476a-8d6e-88dd7db4fb41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:37:12.221837 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: warnings.warn(msg) Jan 10 17:37:12.221837 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: Jan 10 17:37:12.223495 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f86173-0f2f-476a-8d6e-88dd7db4fb41 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:12.258386 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 20/42] 10.222.0.31 () {60 vars in 1162 bytes} [Mon Jan 10 17:37:12 2022] POST /identity/v3/projects => generated 312 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:37:12.384361 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859e991-f351-4915-8335-4d182f193acd None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:12.384704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859e991-f351-4915-8335-4d182f193acd None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:12.384958 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859e991-f351-4915-8335-4d182f193acd None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:12.386809 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 23/43] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:12.392709 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335a025-daeb-48a7-9f82-fb8591e6a90e None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:12.394303 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335a025-daeb-48a7-9f82-fb8591e6a90e None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:12.394303 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335a025-daeb-48a7-9f82-fb8591e6a90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:12.413348 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-8335a025-daeb-48a7-9f82-fb8591e6a90e None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:12.414568 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-8335a025-daeb-48a7-9f82-fb8591e6a90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:12.475419 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 21/44] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:12.499386 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859e991-f351-4915-8335-4d182f193acd None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:12.512566 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859e991-f351-4915-8335-4d182f193acd None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:12.518025 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f89925-d736-44e6-8ffe-dfa45cce2d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:12.518699 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f89925-d736-44e6-8ffe-dfa45cce2d33 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:12.518984 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f89925-d736-44e6-8ffe-dfa45cce2d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:12.519287 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f89925-d736-44e6-8ffe-dfa45cce2d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:12.520058 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f89925-d736-44e6-8ffe-dfa45cce2d33 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:12.521727 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f89925-d736-44e6-8ffe-dfa45cce2d33 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:12.537142 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 24/45] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:37:12 2022] POST /identity/v3/roles => generated 223 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:37:14.001374 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09469f-c66c-45ae-9c3b-c799b8d75a8c None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:14.001881 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09469f-c66c-45ae-9c3b-c799b8d75a8c None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:14.001881 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09469f-c66c-45ae-9c3b-c799b8d75a8c None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:14.003683 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 22/46] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:14.008881 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b914632-c920-40ba-90ad-a70735655b92 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:14.009303 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b914632-c920-40ba-90ad-a70735655b92 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:14.009458 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b914632-c920-40ba-90ad-a70735655b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:14.028690 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-2b914632-c920-40ba-90ad-a70735655b92 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:14.029917 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-2b914632-c920-40ba-90ad-a70735655b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:14.040585 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 25/47] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:14.065271 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09469f-c66c-45ae-9c3b-c799b8d75a8c None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:14.078160 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09469f-c66c-45ae-9c3b-c799b8d75a8c None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:14.082914 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c02cdc-115d-49e8-b4d1-ee6cbb7ee8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:14.083708 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c02cdc-115d-49e8-b4d1-ee6cbb7ee8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:14.083996 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c02cdc-115d-49e8-b4d1-ee6cbb7ee8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:14.084282 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c02cdc-115d-49e8-b4d1-ee6cbb7ee8d1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:14.097048 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c02cdc-115d-49e8-b4d1-ee6cbb7ee8d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:14.103956 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-99c02cdc-115d-49e8-b4d1-ee6cbb7ee8d1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:37:14.105191 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 23/48] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:37:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:14.111179 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b914632-c920-40ba-90ad-a70735655b92 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:14.120690 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b914632-c920-40ba-90ad-a70735655b92 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:14.126307 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01415b3-cada-470a-b959-d7edb589cec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:14.127021 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01415b3-cada-470a-b959-d7edb589cec0 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:14.127314 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01415b3-cada-470a-b959-d7edb589cec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:14.127581 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01415b3-cada-470a-b959-d7edb589cec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:14.128425 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01415b3-cada-470a-b959-d7edb589cec0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:14.128764 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01415b3-cada-470a-b959-d7edb589cec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:14.130575 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01415b3-cada-470a-b959-d7edb589cec0 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:14.139107 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 26/49] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:14.144692 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c02cdc-115d-49e8-b4d1-ee6cbb7ee8d1 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:14.155552 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c02cdc-115d-49e8-b4d1-ee6cbb7ee8d1 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:14.160508 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc47f1-d36a-4751-9bc7-d5d09ec50d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:14.161402 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc47f1-d36a-4751-9bc7-d5d09ec50d17 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:14.161687 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc47f1-d36a-4751-9bc7-d5d09ec50d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:14.161967 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc47f1-d36a-4751-9bc7-d5d09ec50d17 admin admin] PATH_INFO: `/v3/users/8900330194a64240acfd4144b4e26c1b` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:14.163268 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc47f1-d36a-4751-9bc7-d5d09ec50d17 admin admin] RBAC: Authorizing `identity:get_user(user_id=8900330194a64240acfd4144b4e26c1b)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:14.165128 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc47f1-d36a-4751-9bc7-d5d09ec50d17 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:14.166710 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 24/50] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:14 2022] GET /identity/v3/users/8900330194a64240acfd4144b4e26c1b => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:14.171906 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01415b3-cada-470a-b959-d7edb589cec0 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:14.181828 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01415b3-cada-470a-b959-d7edb589cec0 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:14.186885 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbee8b-23c8-4b25-8c6c-d4aaba4ab46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:14.187670 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbee8b-23c8-4b25-8c6c-d4aaba4ab46f admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:14.187951 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbee8b-23c8-4b25-8c6c-d4aaba4ab46f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:14.188225 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbee8b-23c8-4b25-8c6c-d4aaba4ab46f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:14.189551 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbee8b-23c8-4b25-8c6c-d4aaba4ab46f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:14.191269 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbee8b-23c8-4b25-8c6c-d4aaba4ab46f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:14.192821 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 27/51] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:37:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:14.198328 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc47f1-d36a-4751-9bc7-d5d09ec50d17 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:14.208373 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc47f1-d36a-4751-9bc7-d5d09ec50d17 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:14.213238 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f4f85-f138-43d7-970c-a2fd1f0177f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:14.213884 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f4f85-f138-43d7-970c-a2fd1f0177f2 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:14.214168 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f4f85-f138-43d7-970c-a2fd1f0177f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:14.214447 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f4f85-f138-43d7-970c-a2fd1f0177f2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:14.215293 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f4f85-f138-43d7-970c-a2fd1f0177f2 admin admin] RBAC: Adding query filter params (role.id=3c05bedf79e04eb38d2ae66736030bfe, scope.domain.id=default, user.id=8900330194a64240acfd4144b4e26c1b) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:14.215591 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f4f85-f138-43d7-970c-a2fd1f0177f2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:14.217506 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f4f85-f138-43d7-970c-a2fd1f0177f2 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:14.223376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 25/52] 10.222.0.31 () {56 vars in 1343 bytes} [Mon Jan 10 17:37:14 2022] GET /identity/v3/role_assignments?user.id=8900330194a64240acfd4144b4e26c1b&scope.domain.id=default&role.id=3c05bedf79e04eb38d2ae66736030bfe => generated 530 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:14.691630 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4aaf79-f535-4320-88e1-df82e9af448f None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:14.691888 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4aaf79-f535-4320-88e1-df82e9af448f None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:14.692194 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4aaf79-f535-4320-88e1-df82e9af448f None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:14.694032 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 28/53] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:14.700279 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77be01-8394-4519-9901-484ff10637d9 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:14.700757 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77be01-8394-4519-9901-484ff10637d9 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:14.701264 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77be01-8394-4519-9901-484ff10637d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:14.727238 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-5c77be01-8394-4519-9901-484ff10637d9 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:14.728467 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-5c77be01-8394-4519-9901-484ff10637d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:14.737600 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 26/54] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:14.762556 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4aaf79-f535-4320-88e1-df82e9af448f None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:14.777667 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4aaf79-f535-4320-88e1-df82e9af448f None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:14.782713 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66b4ce-26d3-4bfd-9569-cde66ed1a1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:14.783506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66b4ce-26d3-4bfd-9569-cde66ed1a1fa admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:14.783790 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66b4ce-26d3-4bfd-9569-cde66ed1a1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:14.784064 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66b4ce-26d3-4bfd-9569-cde66ed1a1fa admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:14.785455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66b4ce-26d3-4bfd-9569-cde66ed1a1fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:14.787168 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66b4ce-26d3-4bfd-9569-cde66ed1a1fa admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:14.788718 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 29/55] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:37:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:14.794580 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77be01-8394-4519-9901-484ff10637d9 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:14.808655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77be01-8394-4519-9901-484ff10637d9 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:14.817075 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1f2d8-05f6-4449-a2d0-8491cec2bc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:14.817716 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1f2d8-05f6-4449-a2d0-8491cec2bc8d admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:14.817996 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1f2d8-05f6-4449-a2d0-8491cec2bc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:14.818267 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1f2d8-05f6-4449-a2d0-8491cec2bc8d admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:14.818986 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1f2d8-05f6-4449-a2d0-8491cec2bc8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:14.820924 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1f2d8-05f6-4449-a2d0-8491cec2bc8d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:14.850010 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 27/56] 10.222.0.31 () {60 vars in 1161 bytes} [Mon Jan 10 17:37:14 2022] POST /identity/v3/projects => generated 298 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:37:17.209632 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01604fe5-d74b-4aae-8eee-0f0ae6b1e11b None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:17.210461 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01604fe5-d74b-4aae-8eee-0f0ae6b1e11b None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:17.210461 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01604fe5-d74b-4aae-8eee-0f0ae6b1e11b None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:17.213437 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 30/57] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:17.219649 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e93561-e228-4cd1-aa66-2439e9630d06 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:17.220356 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e93561-e228-4cd1-aa66-2439e9630d06 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:17.220492 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e93561-e228-4cd1-aa66-2439e9630d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:17.246052 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-b6e93561-e228-4cd1-aa66-2439e9630d06 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:17.247229 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b6e93561-e228-4cd1-aa66-2439e9630d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:17.304475 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 28/58] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:17.341200 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01604fe5-d74b-4aae-8eee-0f0ae6b1e11b None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:17.356727 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01604fe5-d74b-4aae-8eee-0f0ae6b1e11b None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:17.362689 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6ba99-4f06-493c-abcb-c0b1629801eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:17.363533 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6ba99-4f06-493c-abcb-c0b1629801eb admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:17.363827 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6ba99-4f06-493c-abcb-c0b1629801eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:17.364102 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6ba99-4f06-493c-abcb-c0b1629801eb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:17.365388 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6ba99-4f06-493c-abcb-c0b1629801eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:17.367101 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6ba99-4f06-493c-abcb-c0b1629801eb admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:17.368659 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 31/59] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:37:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:17.373965 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e93561-e228-4cd1-aa66-2439e9630d06 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:17.383251 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e93561-e228-4cd1-aa66-2439e9630d06 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:17.389072 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6235fba-977e-4abb-98cb-e1ecd3c81030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:17.389737 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6235fba-977e-4abb-98cb-e1ecd3c81030 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:17.390023 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6235fba-977e-4abb-98cb-e1ecd3c81030 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:17.390244 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6235fba-977e-4abb-98cb-e1ecd3c81030 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:17.391020 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6235fba-977e-4abb-98cb-e1ecd3c81030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:17.392042 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING py.warnings [None req-d6235fba-977e-4abb-98cb-e1ecd3c81030 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:37:17.392042 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: warnings.warn(msg) Jan 10 17:37:17.392042 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: Jan 10 17:37:17.393324 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6235fba-977e-4abb-98cb-e1ecd3c81030 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:17.422889 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 29/60] 10.222.0.31 () {60 vars in 1153 bytes} [Mon Jan 10 17:37:17 2022] POST /identity/v3/users => generated 275 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:37:21.009326 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e81d00-0496-4e66-be41-46c800809f7f None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.010367 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e81d00-0496-4e66-be41-46c800809f7f None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.010889 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e81d00-0496-4e66-be41-46c800809f7f None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.013058 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 32/61] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:21.018843 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0491929-5f20-4ee4-8801-974a9c7c46bf None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.019886 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0491929-5f20-4ee4-8801-974a9c7c46bf None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.020379 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0491929-5f20-4ee4-8801-974a9c7c46bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.047291 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-b0491929-5f20-4ee4-8801-974a9c7c46bf None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:21.048877 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b0491929-5f20-4ee4-8801-974a9c7c46bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:21.060433 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 30/62] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:37:21.066901 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfa881-fbd7-4019-a6f4-a9a2f024a801 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.067438 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfa881-fbd7-4019-a6f4-a9a2f024a801 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.067930 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfa881-fbd7-4019-a6f4-a9a2f024a801 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.070195 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 33/63] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:21.075337 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78296399-c8b6-465d-b632-f823796f76b8 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.075951 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78296399-c8b6-465d-b632-f823796f76b8 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.076435 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78296399-c8b6-465d-b632-f823796f76b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.103584 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-78296399-c8b6-465d-b632-f823796f76b8 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:21.105219 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-78296399-c8b6-465d-b632-f823796f76b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:21.114325 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 31/64] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:21.123595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfa881-fbd7-4019-a6f4-a9a2f024a801 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.136998 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfa881-fbd7-4019-a6f4-a9a2f024a801 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.141783 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11aed8a-16bc-4924-8ea3-4412f9cc4f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.142838 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11aed8a-16bc-4924-8ea3-4412f9cc4f77 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.143340 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11aed8a-16bc-4924-8ea3-4412f9cc4f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.143820 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11aed8a-16bc-4924-8ea3-4412f9cc4f77 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.156891 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78296399-c8b6-465d-b632-f823796f76b8 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.161180 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11aed8a-16bc-4924-8ea3-4412f9cc4f77 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:21.167254 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78296399-c8b6-465d-b632-f823796f76b8 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.168264 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-a11aed8a-16bc-4924-8ea3-4412f9cc4f77 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:37:21.169928 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 34/65] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:21.175549 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11aed8a-16bc-4924-8ea3-4412f9cc4f77 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.177562 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807ad4a-efff-45dc-946b-cb1a32408f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.178395 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807ad4a-efff-45dc-946b-cb1a32408f9d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.178681 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807ad4a-efff-45dc-946b-cb1a32408f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.178961 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807ad4a-efff-45dc-946b-cb1a32408f9d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.190366 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11aed8a-16bc-4924-8ea3-4412f9cc4f77 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.195508 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807ad4a-efff-45dc-946b-cb1a32408f9d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:21.202457 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-6807ad4a-efff-45dc-946b-cb1a32408f9d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 17:37:21.203984 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 32/66] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:21.206343 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65e5ba-1f45-4c54-b837-7ee28ace599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.207206 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65e5ba-1f45-4c54-b837-7ee28ace599c admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.207583 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65e5ba-1f45-4c54-b837-7ee28ace599c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.207955 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65e5ba-1f45-4c54-b837-7ee28ace599c admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.208838 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65e5ba-1f45-4c54-b837-7ee28ace599c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:21.209987 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807ad4a-efff-45dc-946b-cb1a32408f9d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.210463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65e5ba-1f45-4c54-b837-7ee28ace599c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.212119 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65e5ba-1f45-4c54-b837-7ee28ace599c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.223445 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807ad4a-efff-45dc-946b-cb1a32408f9d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.225699 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 35/67] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:21.227114 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efda69f-00ad-4e19-a3d8-53aa52b4b893 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.227494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efda69f-00ad-4e19-a3d8-53aa52b4b893 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.227817 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efda69f-00ad-4e19-a3d8-53aa52b4b893 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.228829 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0ce11-ebce-4c3c-9417-8929c6850fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.229673 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0ce11-ebce-4c3c-9417-8929c6850fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.229917 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 36/68] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:21.230301 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0ce11-ebce-4c3c-9417-8929c6850fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.230762 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0ce11-ebce-4c3c-9417-8929c6850fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.231741 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0ce11-ebce-4c3c-9417-8929c6850fe4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:21.232225 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0ce11-ebce-4c3c-9417-8929c6850fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.233447 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING py.warnings [None req-d1f0ce11-ebce-4c3c-9417-8929c6850fe4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:37:21.233447 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: warnings.warn(msg) Jan 10 17:37:21.233447 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: Jan 10 17:37:21.234687 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0ce11-ebce-4c3c-9417-8929c6850fe4 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.235091 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a03f04-9dbb-4ec6-a077-e674a73b0299 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.235474 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a03f04-9dbb-4ec6-a077-e674a73b0299 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.235846 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a03f04-9dbb-4ec6-a077-e674a73b0299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.249854 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 33/69] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:21.250963 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0ce11-ebce-4c3c-9417-8929c6850fe4 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.260603 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-94a03f04-9dbb-4ec6-a077-e674a73b0299 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:21.260757 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0ce11-ebce-4c3c-9417-8929c6850fe4 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.262253 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-94a03f04-9dbb-4ec6-a077-e674a73b0299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:21.265126 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54684a3a-947f-4486-928b-d90ced51fae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.266002 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54684a3a-947f-4486-928b-d90ced51fae4 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.266288 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54684a3a-947f-4486-928b-d90ced51fae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.266574 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54684a3a-947f-4486-928b-d90ced51fae4 admin admin] PATH_INFO: `/v3/users/8900330194a64240acfd4144b4e26c1b` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.267807 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54684a3a-947f-4486-928b-d90ced51fae4 admin admin] RBAC: Authorizing `identity:get_user(user_id=8900330194a64240acfd4144b4e26c1b)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.269698 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54684a3a-947f-4486-928b-d90ced51fae4 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.271504 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 37/71] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:37:21.271625 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 34/71] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/users/8900330194a64240acfd4144b4e26c1b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:21.276360 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54684a3a-947f-4486-928b-d90ced51fae4 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.277482 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a03f04-9dbb-4ec6-a077-e674a73b0299 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.290516 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a03f04-9dbb-4ec6-a077-e674a73b0299 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.292457 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54684a3a-947f-4486-928b-d90ced51fae4 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.298200 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f79ea2-8016-4bb6-be07-1746bb32959c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.298865 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f79ea2-8016-4bb6-be07-1746bb32959c admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.299152 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f79ea2-8016-4bb6-be07-1746bb32959c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.299432 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f79ea2-8016-4bb6-be07-1746bb32959c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.306825 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a4d5f-c633-4654-b51b-1d722df45695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.307955 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a4d5f-c633-4654-b51b-1d722df45695 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.308423 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a4d5f-c633-4654-b51b-1d722df45695 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.308527 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f79ea2-8016-4bb6-be07-1746bb32959c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.309074 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a4d5f-c633-4654-b51b-1d722df45695 admin admin] PATH_INFO: `/v3/users/6cb1515034ae4cf4921e9b2eb5f14f7e` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.310570 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f79ea2-8016-4bb6-be07-1746bb32959c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.321304 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 38/72] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:21.322096 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f79ea2-8016-4bb6-be07-1746bb32959c admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.325626 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a4d5f-c633-4654-b51b-1d722df45695 admin admin] RBAC: Authorizing `identity:get_user(user_id=6cb1515034ae4cf4921e9b2eb5f14f7e)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.328008 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a4d5f-c633-4654-b51b-1d722df45695 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.329919 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 35/73] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/users/6cb1515034ae4cf4921e9b2eb5f14f7e => generated 275 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:21.335241 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a4d5f-c633-4654-b51b-1d722df45695 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.335365 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f79ea2-8016-4bb6-be07-1746bb32959c admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.336412 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dafcd9-df3e-4f3d-83dd-7461035b8692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.337319 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dafcd9-df3e-4f3d-83dd-7461035b8692 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.337674 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dafcd9-df3e-4f3d-83dd-7461035b8692 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.338022 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dafcd9-df3e-4f3d-83dd-7461035b8692 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.345702 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a4d5f-c633-4654-b51b-1d722df45695 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.350099 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dafcd9-df3e-4f3d-83dd-7461035b8692 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:21.350685 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c900ab-b114-41c0-84b7-90f50b249768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.351728 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c900ab-b114-41c0-84b7-90f50b249768 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.352182 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c900ab-b114-41c0-84b7-90f50b249768 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.352618 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c900ab-b114-41c0-84b7-90f50b249768 admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.353999 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c900ab-b114-41c0-84b7-90f50b249768 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e853ee55e324805acbbf0aff75277c3)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.356256 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c900ab-b114-41c0-84b7-90f50b249768 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.357826 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-12dafcd9-df3e-4f3d-83dd-7461035b8692 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 17:37:21.358342 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 36/74] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:21.359254 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c900ab-b114-41c0-84b7-90f50b249768 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.359361 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 39/75] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:21.365776 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dafcd9-df3e-4f3d-83dd-7461035b8692 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.370865 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c900ab-b114-41c0-84b7-90f50b249768 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.375317 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d3928-fb27-484d-a699-95990d9a73d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.375957 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d3928-fb27-484d-a699-95990d9a73d0 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.376245 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d3928-fb27-484d-a699-95990d9a73d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.376525 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d3928-fb27-484d-a699-95990d9a73d0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.377104 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dafcd9-df3e-4f3d-83dd-7461035b8692 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.381902 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8803366-c4b2-40c0-876e-673faf54896d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.382758 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8803366-c4b2-40c0-876e-673faf54896d admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.383247 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8803366-c4b2-40c0-876e-673faf54896d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.383705 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8803366-c4b2-40c0-876e-673faf54896d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.384726 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8803366-c4b2-40c0-876e-673faf54896d admin admin] RBAC: Adding query filter params (role.id=3c05bedf79e04eb38d2ae66736030bfe, scope.project.id=3e853ee55e324805acbbf0aff75277c3, user.id=8900330194a64240acfd4144b4e26c1b) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:21.385270 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8803366-c4b2-40c0-876e-673faf54896d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.385403 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d3928-fb27-484d-a699-95990d9a73d0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.386565 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING py.warnings [None req-c8803366-c4b2-40c0-876e-673faf54896d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:37:21.386565 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: warnings.warn(msg) Jan 10 17:37:21.386565 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: Jan 10 17:37:21.387670 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d3928-fb27-484d-a699-95990d9a73d0 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.388033 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8803366-c4b2-40c0-876e-673faf54896d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.395216 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 40/76] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/role_assignments?user.id=8900330194a64240acfd4144b4e26c1b&scope.project.id=3e853ee55e324805acbbf0aff75277c3&role.id=3c05bedf79e04eb38d2ae66736030bfe => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:21.396130 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8803366-c4b2-40c0-876e-673faf54896d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.397422 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 37/77] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:21.410046 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d3928-fb27-484d-a699-95990d9a73d0 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.415162 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8803366-c4b2-40c0-876e-673faf54896d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.419489 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d3928-fb27-484d-a699-95990d9a73d0 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.424379 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738febd1-9021-4da2-a166-3b56113c14ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.425338 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738febd1-9021-4da2-a166-3b56113c14ad admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.425777 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738febd1-9021-4da2-a166-3b56113c14ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.426187 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738febd1-9021-4da2-a166-3b56113c14ad admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.427655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738febd1-9021-4da2-a166-3b56113c14ad admin admin] RBAC: Authorizing `identity:get_project(project_id=3e853ee55e324805acbbf0aff75277c3)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.430174 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738febd1-9021-4da2-a166-3b56113c14ad admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.431079 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34acb5-1c26-4a42-a4cd-ef34cfdecc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.431757 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34acb5-1c26-4a42-a4cd-ef34cfdecc76 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.432037 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34acb5-1c26-4a42-a4cd-ef34cfdecc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.432318 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34acb5-1c26-4a42-a4cd-ef34cfdecc76 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.432968 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 38/78] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:21.437658 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34acb5-1c26-4a42-a4cd-ef34cfdecc76 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:21.437658 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34acb5-1c26-4a42-a4cd-ef34cfdecc76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.438747 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34acb5-1c26-4a42-a4cd-ef34cfdecc76 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.439038 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738febd1-9021-4da2-a166-3b56113c14ad admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.449675 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738febd1-9021-4da2-a166-3b56113c14ad admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.455167 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1998c-0be4-43f9-8b34-ce22405cfee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.456301 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1998c-0be4-43f9-8b34-ce22405cfee7 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.456752 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1998c-0be4-43f9-8b34-ce22405cfee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.457218 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1998c-0be4-43f9-8b34-ce22405cfee7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.457846 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 41/79] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:21.458660 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1998c-0be4-43f9-8b34-ce22405cfee7 admin admin] RBAC: Adding query filter params (role.id=3c8f0c77d36b49608a0e17cfcff15691, scope.project.id=3e853ee55e324805acbbf0aff75277c3, user.id=6cb1515034ae4cf4921e9b2eb5f14f7e) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:21.463538 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1998c-0be4-43f9-8b34-ce22405cfee7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.464791 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34acb5-1c26-4a42-a4cd-ef34cfdecc76 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.466241 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1998c-0be4-43f9-8b34-ce22405cfee7 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.472730 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 39/80] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/role_assignments?user.id=6cb1515034ae4cf4921e9b2eb5f14f7e&scope.project.id=3e853ee55e324805acbbf0aff75277c3&role.id=3c8f0c77d36b49608a0e17cfcff15691 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:21.483612 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34acb5-1c26-4a42-a4cd-ef34cfdecc76 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.497821 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9d3d3-53be-4f82-b0a4-f1da2a7dd8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.499016 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9d3d3-53be-4f82-b0a4-f1da2a7dd8cd admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.499495 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9d3d3-53be-4f82-b0a4-f1da2a7dd8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.499914 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9d3d3-53be-4f82-b0a4-f1da2a7dd8cd admin admin] PATH_INFO: `/v3/users/6cb1515034ae4cf4921e9b2eb5f14f7e` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.501716 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9d3d3-53be-4f82-b0a4-f1da2a7dd8cd admin admin] RBAC: Authorizing `identity:get_user(user_id=6cb1515034ae4cf4921e9b2eb5f14f7e)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.508969 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9d3d3-53be-4f82-b0a4-f1da2a7dd8cd admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.511197 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 42/81] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/users/6cb1515034ae4cf4921e9b2eb5f14f7e => generated 275 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:21.517143 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1998c-0be4-43f9-8b34-ce22405cfee7 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.531466 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2ba05-62c4-4c34-aedd-5927d055ce89 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.531781 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2ba05-62c4-4c34-aedd-5927d055ce89 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.532073 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2ba05-62c4-4c34-aedd-5927d055ce89 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.533891 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 43/82] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:21.534588 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1998c-0be4-43f9-8b34-ce22405cfee7 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.540040 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b604f-940e-49fc-b444-a18721b5ca4c None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.540385 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b604f-940e-49fc-b444-a18721b5ca4c None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.540600 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b604f-940e-49fc-b444-a18721b5ca4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.544299 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44aa1e5-6fd6-471b-9d85-fe1085a62a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.545384 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aa1e5-6fd6-471b-9d85-fe1085a62a8d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.545848 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aa1e5-6fd6-471b-9d85-fe1085a62a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.546326 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aa1e5-6fd6-471b-9d85-fe1085a62a8d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.566083 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44aa1e5-6fd6-471b-9d85-fe1085a62a8d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.568286 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44aa1e5-6fd6-471b-9d85-fe1085a62a8d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.579412 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-3a2b604f-940e-49fc-b444-a18721b5ca4c None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:21.582404 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-3a2b604f-940e-49fc-b444-a18721b5ca4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:21.586802 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 40/83] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:21.593013 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44aa1e5-6fd6-471b-9d85-fe1085a62a8d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.602898 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44aa1e5-6fd6-471b-9d85-fe1085a62a8d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.607437 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 44/84] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:37:21.608401 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20258c-a27e-4926-a62f-9282995b5436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.609561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20258c-a27e-4926-a62f-9282995b5436 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.610059 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20258c-a27e-4926-a62f-9282995b5436 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.610522 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20258c-a27e-4926-a62f-9282995b5436 admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.612069 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20258c-a27e-4926-a62f-9282995b5436 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e853ee55e324805acbbf0aff75277c3)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.614509 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20258c-a27e-4926-a62f-9282995b5436 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.616583 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 41/85] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:21.622935 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b604f-940e-49fc-b444-a18721b5ca4c None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.634886 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b604f-940e-49fc-b444-a18721b5ca4c None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.640186 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7423a-3ab2-4763-8c3a-18fe4607e488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.641324 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7423a-3ab2-4763-8c3a-18fe4607e488 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.641918 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7423a-3ab2-4763-8c3a-18fe4607e488 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.642420 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7423a-3ab2-4763-8c3a-18fe4607e488 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.643599 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7423a-3ab2-4763-8c3a-18fe4607e488 admin admin] RBAC: Adding query filter params (role.id=112bab30f846403ea40d96a74a04af2c, scope.project.id=3e853ee55e324805acbbf0aff75277c3, user.id=6cb1515034ae4cf4921e9b2eb5f14f7e) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:21.644214 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7423a-3ab2-4763-8c3a-18fe4607e488 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.646435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7423a-3ab2-4763-8c3a-18fe4607e488 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.651634 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20258c-a27e-4926-a62f-9282995b5436 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.661865 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 45/86] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/role_assignments?user.id=6cb1515034ae4cf4921e9b2eb5f14f7e&scope.project.id=3e853ee55e324805acbbf0aff75277c3&role.id=112bab30f846403ea40d96a74a04af2c => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:21.663158 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7287f2c-084c-43b3-894d-ec17a9bf7e58 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.663536 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7287f2c-084c-43b3-894d-ec17a9bf7e58 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.663814 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7287f2c-084c-43b3-894d-ec17a9bf7e58 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.668897 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20258c-a27e-4926-a62f-9282995b5436 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.669106 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 46/87] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:21.672030 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f2717-eb09-42ab-b8ba-67611ab94037 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.672354 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f2717-eb09-42ab-b8ba-67611ab94037 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.672598 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f2717-eb09-42ab-b8ba-67611ab94037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.682192 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be8057-8cd8-49a9-9735-d36420ce7737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.683423 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be8057-8cd8-49a9-9735-d36420ce7737 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.683911 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be8057-8cd8-49a9-9735-d36420ce7737 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.684399 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be8057-8cd8-49a9-9735-d36420ce7737 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.687013 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be8057-8cd8-49a9-9735-d36420ce7737 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.692885 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be8057-8cd8-49a9-9735-d36420ce7737 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.693088 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-d28f2717-eb09-42ab-b8ba-67611ab94037 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:21.694252 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-d28f2717-eb09-42ab-b8ba-67611ab94037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:21.695851 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 42/88] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:21.702255 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be8057-8cd8-49a9-9735-d36420ce7737 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.708336 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 47/89] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:21.734728 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f2717-eb09-42ab-b8ba-67611ab94037 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.736500 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be8057-8cd8-49a9-9735-d36420ce7737 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.743509 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427cfab-ed02-4185-a2ed-04c440a8c58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.744205 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427cfab-ed02-4185-a2ed-04c440a8c58e admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.744483 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427cfab-ed02-4185-a2ed-04c440a8c58e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.744758 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427cfab-ed02-4185-a2ed-04c440a8c58e admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.745552 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427cfab-ed02-4185-a2ed-04c440a8c58e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.746660 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f2717-eb09-42ab-b8ba-67611ab94037 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.747603 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427cfab-ed02-4185-a2ed-04c440a8c58e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.751857 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df377854-92ed-40e9-9282-2857b82a7235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.753066 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df377854-92ed-40e9-9282-2857b82a7235 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.753627 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df377854-92ed-40e9-9282-2857b82a7235 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.754098 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df377854-92ed-40e9-9282-2857b82a7235 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.773428 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df377854-92ed-40e9-9282-2857b82a7235 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:21.776559 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 43/90] 10.222.0.31 () {60 vars in 1153 bytes} [Mon Jan 10 17:37:21 2022] POST /identity/v3/users => generated 289 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:37:21.783975 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-df377854-92ed-40e9-9282-2857b82a7235 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 17:37:21.785725 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 48/91] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:37:21.791970 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427cfab-ed02-4185-a2ed-04c440a8c58e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.802911 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427cfab-ed02-4185-a2ed-04c440a8c58e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.808068 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e75afe-f91a-44d7-a7a5-c117afb5d853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.809146 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e75afe-f91a-44d7-a7a5-c117afb5d853 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.809646 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e75afe-f91a-44d7-a7a5-c117afb5d853 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.810098 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e75afe-f91a-44d7-a7a5-c117afb5d853 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.811096 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e75afe-f91a-44d7-a7a5-c117afb5d853 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:21.811592 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e75afe-f91a-44d7-a7a5-c117afb5d853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.813510 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e75afe-f91a-44d7-a7a5-c117afb5d853 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.825530 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 44/92] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:21.831767 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df377854-92ed-40e9-9282-2857b82a7235 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.842479 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df377854-92ed-40e9-9282-2857b82a7235 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.847555 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5cba0-14d9-4324-a9d6-4196cd1a0e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.848741 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5cba0-14d9-4324-a9d6-4196cd1a0e4c admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.849259 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5cba0-14d9-4324-a9d6-4196cd1a0e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.849704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5cba0-14d9-4324-a9d6-4196cd1a0e4c admin admin] PATH_INFO: `/v3/users/6cb1515034ae4cf4921e9b2eb5f14f7e` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.851259 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5cba0-14d9-4324-a9d6-4196cd1a0e4c admin admin] RBAC: Authorizing `identity:get_user(user_id=6cb1515034ae4cf4921e9b2eb5f14f7e)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.853755 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5cba0-14d9-4324-a9d6-4196cd1a0e4c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.856123 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 49/93] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/users/6cb1515034ae4cf4921e9b2eb5f14f7e => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:21.862236 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e75afe-f91a-44d7-a7a5-c117afb5d853 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.873273 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e75afe-f91a-44d7-a7a5-c117afb5d853 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.878455 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589e9c0-2fff-4e6d-98af-a35c68e0ab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.879436 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589e9c0-2fff-4e6d-98af-a35c68e0ab4e admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.879990 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589e9c0-2fff-4e6d-98af-a35c68e0ab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.880439 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589e9c0-2fff-4e6d-98af-a35c68e0ab4e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.894396 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589e9c0-2fff-4e6d-98af-a35c68e0ab4e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.896575 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589e9c0-2fff-4e6d-98af-a35c68e0ab4e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.911386 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 45/94] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:21.917531 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5cba0-14d9-4324-a9d6-4196cd1a0e4c admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.931745 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5cba0-14d9-4324-a9d6-4196cd1a0e4c admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.936753 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5abdf-004c-46da-b105-6d9084e7d1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.937919 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5abdf-004c-46da-b105-6d9084e7d1ca admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.938377 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5abdf-004c-46da-b105-6d9084e7d1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.938880 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5abdf-004c-46da-b105-6d9084e7d1ca admin admin] PATH_INFO: `/v3/projects/de0b765453514d629b86882d62722721` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.940356 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5abdf-004c-46da-b105-6d9084e7d1ca admin admin] RBAC: Authorizing `identity:get_project(project_id=de0b765453514d629b86882d62722721)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.942851 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5abdf-004c-46da-b105-6d9084e7d1ca admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.945018 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 50/95] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/projects/de0b765453514d629b86882d62722721 => generated 312 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:21.952928 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589e9c0-2fff-4e6d-98af-a35c68e0ab4e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:21.960649 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589e9c0-2fff-4e6d-98af-a35c68e0ab4e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:21.971061 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3aa61f-18e9-4f2b-a47f-4938339159d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:21.971789 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3aa61f-18e9-4f2b-a47f-4938339159d5 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:21.972111 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3aa61f-18e9-4f2b-a47f-4938339159d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:21.972422 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3aa61f-18e9-4f2b-a47f-4938339159d5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:21.973315 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3aa61f-18e9-4f2b-a47f-4938339159d5 admin admin] RBAC: Adding query filter params (role.id=3c8f0c77d36b49608a0e17cfcff15691, scope.project.id=de0b765453514d629b86882d62722721, user.id=6cb1515034ae4cf4921e9b2eb5f14f7e) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:21.973630 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3aa61f-18e9-4f2b-a47f-4938339159d5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:21.975545 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3aa61f-18e9-4f2b-a47f-4938339159d5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:21.985355 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 46/96] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:37:21 2022] GET /identity/v3/role_assignments?user.id=6cb1515034ae4cf4921e9b2eb5f14f7e&scope.project.id=de0b765453514d629b86882d62722721&role.id=3c8f0c77d36b49608a0e17cfcff15691 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:24.192319 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d08aad-45d1-4d70-8d9d-761b94adf910 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:24.192843 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d08aad-45d1-4d70-8d9d-761b94adf910 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:24.192943 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d08aad-45d1-4d70-8d9d-761b94adf910 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:24.194871 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 51/97] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:24.202936 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c22d3-5323-44ef-a934-3bae9a0af200 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:24.203390 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c22d3-5323-44ef-a934-3bae9a0af200 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:24.203463 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c22d3-5323-44ef-a934-3bae9a0af200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:24.225743 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-f79c22d3-5323-44ef-a934-3bae9a0af200 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:24.226936 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f79c22d3-5323-44ef-a934-3bae9a0af200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:24.237731 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 47/98] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:37:24.267732 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d08aad-45d1-4d70-8d9d-761b94adf910 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:24.288485 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d08aad-45d1-4d70-8d9d-761b94adf910 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:24.292877 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d1d0f-f043-4364-9b40-342582149cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:24.293702 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d1d0f-f043-4364-9b40-342582149cde admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:24.293983 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d1d0f-f043-4364-9b40-342582149cde admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:24.294259 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d1d0f-f043-4364-9b40-342582149cde admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:24.314867 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d1d0f-f043-4364-9b40-342582149cde admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:24.327503 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-ea1d1d0f-f043-4364-9b40-342582149cde admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:37:24.330835 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 52/99] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:37:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:24.337151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c22d3-5323-44ef-a934-3bae9a0af200 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:24.351770 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c22d3-5323-44ef-a934-3bae9a0af200 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:24.363820 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5e37c-b28e-4429-b472-414a9594c8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:24.364523 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5e37c-b28e-4429-b472-414a9594c8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:24.364811 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5e37c-b28e-4429-b472-414a9594c8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:24.365116 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5e37c-b28e-4429-b472-414a9594c8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:24.365954 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5e37c-b28e-4429-b472-414a9594c8e6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:24.366271 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5e37c-b28e-4429-b472-414a9594c8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:24.368079 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5e37c-b28e-4429-b472-414a9594c8e6 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:24.384268 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 48/100] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:24.391442 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d1d0f-f043-4364-9b40-342582149cde admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:24.406320 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d1d0f-f043-4364-9b40-342582149cde admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:24.422152 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2081a0a-c96a-453e-bc81-910b2536bbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:24.423064 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2081a0a-c96a-453e-bc81-910b2536bbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:24.423346 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2081a0a-c96a-453e-bc81-910b2536bbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:24.423623 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2081a0a-c96a-453e-bc81-910b2536bbb9 admin admin] PATH_INFO: `/v3/users/8900330194a64240acfd4144b4e26c1b` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:24.426511 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2081a0a-c96a-453e-bc81-910b2536bbb9 admin admin] RBAC: Authorizing `identity:get_user(user_id=8900330194a64240acfd4144b4e26c1b)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:24.428425 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2081a0a-c96a-453e-bc81-910b2536bbb9 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:24.434508 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 53/101] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:24 2022] GET /identity/v3/users/8900330194a64240acfd4144b4e26c1b => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:24.443577 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5e37c-b28e-4429-b472-414a9594c8e6 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:24.458728 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5e37c-b28e-4429-b472-414a9594c8e6 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:24.467057 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410a353-b080-4b4b-9e1e-b9e3c2898f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:24.468344 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410a353-b080-4b4b-9e1e-b9e3c2898f8d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:24.468823 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410a353-b080-4b4b-9e1e-b9e3c2898f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:24.469833 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410a353-b080-4b4b-9e1e-b9e3c2898f8d admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:24.471263 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410a353-b080-4b4b-9e1e-b9e3c2898f8d admin admin] RBAC: Authorizing `identity:get_project(project_id=3e853ee55e324805acbbf0aff75277c3)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:24.475815 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410a353-b080-4b4b-9e1e-b9e3c2898f8d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:24.479286 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 49/102] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:24 2022] GET /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:24.484900 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2081a0a-c96a-453e-bc81-910b2536bbb9 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:24.498295 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2081a0a-c96a-453e-bc81-910b2536bbb9 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:24.506228 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451d253-3936-433c-a156-d2cd5c0c70b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:24.506375 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764adbb3-bb86-415d-a489-f0df46649be2 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:24.506660 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764adbb3-bb86-415d-a489-f0df46649be2 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:24.506946 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764adbb3-bb86-415d-a489-f0df46649be2 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:24.507888 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451d253-3936-433c-a156-d2cd5c0c70b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:24.508381 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451d253-3936-433c-a156-d2cd5c0c70b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:24.508884 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451d253-3936-433c-a156-d2cd5c0c70b8 admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3/users/8900330194a64240acfd4144b4e26c1b/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:24.508982 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 50/103] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:24.512024 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451d253-3936-433c-a156-d2cd5c0c70b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e853ee55e324805acbbf0aff75277c3, user_id=8900330194a64240acfd4144b4e26c1b, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:24.513305 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING py.warnings [None req-e451d253-3936-433c-a156-d2cd5c0c70b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:37:24.513305 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: warnings.warn(msg) Jan 10 17:37:24.513305 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: Jan 10 17:37:24.515749 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451d253-3936-433c-a156-d2cd5c0c70b8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:24.522751 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f7419-2a51-459d-95ee-c913a17d4fed None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:24.523384 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f7419-2a51-459d-95ee-c913a17d4fed None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:24.523668 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f7419-2a51-459d-95ee-c913a17d4fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:24.552964 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 54/104] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:37:24 2022] PUT /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3/users/8900330194a64240acfd4144b4e26c1b/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:37:24.568639 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-d40f7419-2a51-459d-95ee-c913a17d4fed None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:24.569896 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-d40f7419-2a51-459d-95ee-c913a17d4fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:24.680603 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 51/105] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:24.730338 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451d253-3936-433c-a156-d2cd5c0c70b8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:24.750164 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451d253-3936-433c-a156-d2cd5c0c70b8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:24.758988 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7176c6-d4e2-4ccb-8fc6-98bbd08caf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:24.759837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7176c6-d4e2-4ccb-8fc6-98bbd08caf71 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:24.760124 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7176c6-d4e2-4ccb-8fc6-98bbd08caf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:24.760406 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7176c6-d4e2-4ccb-8fc6-98bbd08caf71 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:24.780204 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7176c6-d4e2-4ccb-8fc6-98bbd08caf71 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:24.787497 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-5c7176c6-d4e2-4ccb-8fc6-98bbd08caf71 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 17:37:24.788949 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 55/106] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:24.795263 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f7419-2a51-459d-95ee-c913a17d4fed None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:24.812962 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f7419-2a51-459d-95ee-c913a17d4fed None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:24.829766 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846c5ca-3569-4a5f-bfdc-6de35a1825ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:24.830482 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846c5ca-3569-4a5f-bfdc-6de35a1825ad admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:24.830773 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846c5ca-3569-4a5f-bfdc-6de35a1825ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:24.831057 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846c5ca-3569-4a5f-bfdc-6de35a1825ad admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:24.831938 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846c5ca-3569-4a5f-bfdc-6de35a1825ad admin admin] RBAC: Adding query filter params (name=member) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:24.832250 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846c5ca-3569-4a5f-bfdc-6de35a1825ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:24.833988 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846c5ca-3569-4a5f-bfdc-6de35a1825ad admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:24.847233 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 52/107] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:24.853233 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7176c6-d4e2-4ccb-8fc6-98bbd08caf71 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:24.868599 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7176c6-d4e2-4ccb-8fc6-98bbd08caf71 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:24.874293 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c4cb9-a1db-45ba-81d2-33245fa2ea1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:24.875252 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c4cb9-a1db-45ba-81d2-33245fa2ea1a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:24.875536 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c4cb9-a1db-45ba-81d2-33245fa2ea1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:24.875818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c4cb9-a1db-45ba-81d2-33245fa2ea1a admin admin] PATH_INFO: `/v3/users/6cb1515034ae4cf4921e9b2eb5f14f7e` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:24.878033 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c4cb9-a1db-45ba-81d2-33245fa2ea1a admin admin] RBAC: Authorizing `identity:get_user(user_id=6cb1515034ae4cf4921e9b2eb5f14f7e)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:24.880522 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c4cb9-a1db-45ba-81d2-33245fa2ea1a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:24.882259 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 56/108] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:24 2022] GET /identity/v3/users/6cb1515034ae4cf4921e9b2eb5f14f7e => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:24.887909 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846c5ca-3569-4a5f-bfdc-6de35a1825ad admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:24.898528 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846c5ca-3569-4a5f-bfdc-6de35a1825ad admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:24.902992 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e1834-5750-443f-8315-e805974530dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:24.903863 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e1834-5750-443f-8315-e805974530dc admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:24.904149 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e1834-5750-443f-8315-e805974530dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:24.904427 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e1834-5750-443f-8315-e805974530dc admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:24.905675 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e1834-5750-443f-8315-e805974530dc admin admin] RBAC: Authorizing `identity:get_project(project_id=3e853ee55e324805acbbf0aff75277c3)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:24.907774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e1834-5750-443f-8315-e805974530dc admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:24.909852 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 53/109] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:24 2022] GET /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:24.916078 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c4cb9-a1db-45ba-81d2-33245fa2ea1a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:24.926092 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c4cb9-a1db-45ba-81d2-33245fa2ea1a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:24.935938 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e4381-33ee-498a-8792-a19acde37a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:24.936885 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e4381-33ee-498a-8792-a19acde37a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:24.937163 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e4381-33ee-498a-8792-a19acde37a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:24.937451 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e4381-33ee-498a-8792-a19acde37a6f admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3/users/6cb1515034ae4cf4921e9b2eb5f14f7e/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:24.942172 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e4381-33ee-498a-8792-a19acde37a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e853ee55e324805acbbf0aff75277c3, user_id=6cb1515034ae4cf4921e9b2eb5f14f7e, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:24.944920 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e4381-33ee-498a-8792-a19acde37a6f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:24.971072 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 57/110] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:37:24 2022] PUT /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3/users/6cb1515034ae4cf4921e9b2eb5f14f7e/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:37:25.074958 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df902dac-4429-4552-99ac-83682ddcc477 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:25.075272 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df902dac-4429-4552-99ac-83682ddcc477 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:25.075428 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df902dac-4429-4552-99ac-83682ddcc477 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:25.077239 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 54/111] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:25.082909 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfde38c-1032-4a0a-8014-78d39e99f99b None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:25.083196 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfde38c-1032-4a0a-8014-78d39e99f99b None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:25.083471 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfde38c-1032-4a0a-8014-78d39e99f99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:25.110058 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-1cfde38c-1032-4a0a-8014-78d39e99f99b None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:25.111429 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-1cfde38c-1032-4a0a-8014-78d39e99f99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:25.190225 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 58/112] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:25.234870 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df902dac-4429-4552-99ac-83682ddcc477 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:25.253713 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df902dac-4429-4552-99ac-83682ddcc477 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:25.260261 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c755a-d07b-4f06-a965-9c1d6fb38a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:25.261388 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c755a-d07b-4f06-a965-9c1d6fb38a86 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:25.261847 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c755a-d07b-4f06-a965-9c1d6fb38a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:25.262306 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c755a-d07b-4f06-a965-9c1d6fb38a86 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:25.279502 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c755a-d07b-4f06-a965-9c1d6fb38a86 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:25.287462 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-c90c755a-d07b-4f06-a965-9c1d6fb38a86 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 17:37:25.289421 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 55/113] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:37:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:25.294879 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfde38c-1032-4a0a-8014-78d39e99f99b None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:25.310606 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfde38c-1032-4a0a-8014-78d39e99f99b None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:25.319835 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc069b-3f00-441a-a421-2bfbed5b24d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:25.320909 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc069b-3f00-441a-a421-2bfbed5b24d8 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:25.321409 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc069b-3f00-441a-a421-2bfbed5b24d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:25.321881 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc069b-3f00-441a-a421-2bfbed5b24d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:25.322860 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc069b-3f00-441a-a421-2bfbed5b24d8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:25.323358 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc069b-3f00-441a-a421-2bfbed5b24d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:25.325334 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc069b-3f00-441a-a421-2bfbed5b24d8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:25.340535 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 59/114] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:37:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:25.346727 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c755a-d07b-4f06-a965-9c1d6fb38a86 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:25.357667 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c755a-d07b-4f06-a965-9c1d6fb38a86 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:25.367163 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5a6fd-d246-4957-b713-a2d6e1210bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:25.368118 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5a6fd-d246-4957-b713-a2d6e1210bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:25.368406 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5a6fd-d246-4957-b713-a2d6e1210bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:25.368683 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5a6fd-d246-4957-b713-a2d6e1210bc5 admin admin] PATH_INFO: `/v3/users/6cb1515034ae4cf4921e9b2eb5f14f7e` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:25.370923 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5a6fd-d246-4957-b713-a2d6e1210bc5 admin admin] RBAC: Authorizing `identity:get_user(user_id=6cb1515034ae4cf4921e9b2eb5f14f7e)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:25.373328 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5a6fd-d246-4957-b713-a2d6e1210bc5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:25.375094 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 56/115] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:25 2022] GET /identity/v3/users/6cb1515034ae4cf4921e9b2eb5f14f7e => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:25.380926 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc069b-3f00-441a-a421-2bfbed5b24d8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:25.394262 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc069b-3f00-441a-a421-2bfbed5b24d8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:25.403736 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45497b8d-946d-4582-a82c-f4a6290e092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:25.404917 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45497b8d-946d-4582-a82c-f4a6290e092a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:25.405418 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45497b8d-946d-4582-a82c-f4a6290e092a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:25.405884 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45497b8d-946d-4582-a82c-f4a6290e092a admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:25.409739 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45497b8d-946d-4582-a82c-f4a6290e092a admin admin] RBAC: Authorizing `identity:get_project(project_id=3e853ee55e324805acbbf0aff75277c3)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:25.412126 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45497b8d-946d-4582-a82c-f4a6290e092a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:25.414192 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 60/116] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:25 2022] GET /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:25.420101 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5a6fd-d246-4957-b713-a2d6e1210bc5 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:25.434001 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5a6fd-d246-4957-b713-a2d6e1210bc5 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:25.440626 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ba1e5-4b9a-4af9-91b1-9ce417118fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:25.441850 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ba1e5-4b9a-4af9-91b1-9ce417118fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:25.442331 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ba1e5-4b9a-4af9-91b1-9ce417118fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:25.442888 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ba1e5-4b9a-4af9-91b1-9ce417118fb8 admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3/users/6cb1515034ae4cf4921e9b2eb5f14f7e/roles/112bab30f846403ea40d96a74a04af2c` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:25.445379 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ba1e5-4b9a-4af9-91b1-9ce417118fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e853ee55e324805acbbf0aff75277c3, user_id=6cb1515034ae4cf4921e9b2eb5f14f7e, role_id=112bab30f846403ea40d96a74a04af2c)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:25.448380 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ba1e5-4b9a-4af9-91b1-9ce417118fb8 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:25.481343 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 57/117] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:37:25 2022] PUT /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3/users/6cb1515034ae4cf4921e9b2eb5f14f7e/roles/112bab30f846403ea40d96a74a04af2c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:37:25.942684 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eccd09-ccaa-411a-9081-22c2b4c6f65e None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:25.943058 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eccd09-ccaa-411a-9081-22c2b4c6f65e None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:25.943217 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eccd09-ccaa-411a-9081-22c2b4c6f65e None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:25.945280 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 61/118] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:25.951947 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1cdaa-f865-4633-8af8-faffdb5e98ce None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:25.952557 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1cdaa-f865-4633-8af8-faffdb5e98ce None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:25.953074 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1cdaa-f865-4633-8af8-faffdb5e98ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:25.957452 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e62cc6-d1e9-437e-967b-3f279df9affe None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:25.957974 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e62cc6-d1e9-437e-967b-3f279df9affe None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:25.958441 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e62cc6-d1e9-437e-967b-3f279df9affe None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:25.960662 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 62/119] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:25.965583 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038401d6-e15e-4f48-bbac-9bcdc01e97dc None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:25.966077 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038401d6-e15e-4f48-bbac-9bcdc01e97dc None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:25.966543 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038401d6-e15e-4f48-bbac-9bcdc01e97dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:25.995768 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-038401d6-e15e-4f48-bbac-9bcdc01e97dc None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:25.997985 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-00e1cdaa-f865-4633-8af8-faffdb5e98ce None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:25.998549 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-038401d6-e15e-4f48-bbac-9bcdc01e97dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:25.999889 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-00e1cdaa-f865-4633-8af8-faffdb5e98ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:26.098903 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 58/120] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:26.114177 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 63/121] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:37:26.153636 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1cdaa-f865-4633-8af8-faffdb5e98ce None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:26.156612 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038401d6-e15e-4f48-bbac-9bcdc01e97dc None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:26.166049 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1cdaa-f865-4633-8af8-faffdb5e98ce None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:26.169760 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038401d6-e15e-4f48-bbac-9bcdc01e97dc None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:26.173270 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bf501-33c0-4f8e-b4ca-48c764ab8b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:26.174189 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bf501-33c0-4f8e-b4ca-48c764ab8b18 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:26.174482 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bf501-33c0-4f8e-b4ca-48c764ab8b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:26.174784 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bf501-33c0-4f8e-b4ca-48c764ab8b18 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:26.176876 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431bf501-33c0-4f8e-b4ca-48c764ab8b18 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:26.177623 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347dc06-bed4-460a-8692-84430aa92e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:26.178607 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431bf501-33c0-4f8e-b4ca-48c764ab8b18 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:26.178840 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347dc06-bed4-460a-8692-84430aa92e4d admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:26.179304 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347dc06-bed4-460a-8692-84430aa92e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:26.179763 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347dc06-bed4-460a-8692-84430aa92e4d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:26.180342 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 59/122] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:37:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:26.185994 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bf501-33c0-4f8e-b4ca-48c764ab8b18 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:26.206899 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bf501-33c0-4f8e-b4ca-48c764ab8b18 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:26.211791 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347dc06-bed4-460a-8692-84430aa92e4d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:26.215557 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef8a9a-f1b4-4632-ba47-26fa01a5c118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:26.216230 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef8a9a-f1b4-4632-ba47-26fa01a5c118 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:26.216516 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef8a9a-f1b4-4632-ba47-26fa01a5c118 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:26.216844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef8a9a-f1b4-4632-ba47-26fa01a5c118 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:26.217670 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef8a9a-f1b4-4632-ba47-26fa01a5c118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:26.219664 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef8a9a-f1b4-4632-ba47-26fa01a5c118 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:26.220330 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-5347dc06-bed4-460a-8692-84430aa92e4d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 17:37:26.230276 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 64/123] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:37:26.236155 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347dc06-bed4-460a-8692-84430aa92e4d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:26.251938 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347dc06-bed4-460a-8692-84430aa92e4d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:26.265610 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbb1b6-9644-4c0a-b825-26e4691347c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:26.266426 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbb1b6-9644-4c0a-b825-26e4691347c4 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:26.266718 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbb1b6-9644-4c0a-b825-26e4691347c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:26.267007 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbb1b6-9644-4c0a-b825-26e4691347c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:26.267913 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbb1b6-9644-4c0a-b825-26e4691347c4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:26.268323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbb1b6-9644-4c0a-b825-26e4691347c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:26.270068 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbb1b6-9644-4c0a-b825-26e4691347c4 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:26.271994 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 60/124] 10.222.0.31 () {60 vars in 1162 bytes} [Mon Jan 10 17:37:26 2022] POST /identity/v3/projects => generated 302 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:37:26.284817 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 65/125] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:26.290535 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef8a9a-f1b4-4632-ba47-26fa01a5c118 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:26.382523 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef8a9a-f1b4-4632-ba47-26fa01a5c118 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:26.387132 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ac176-c735-4b95-85c1-225ec5506864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:26.388029 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ac176-c735-4b95-85c1-225ec5506864 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:26.388365 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ac176-c735-4b95-85c1-225ec5506864 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:26.388649 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ac176-c735-4b95-85c1-225ec5506864 admin admin] PATH_INFO: `/v3/users/6cb1515034ae4cf4921e9b2eb5f14f7e` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:26.389906 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ac176-c735-4b95-85c1-225ec5506864 admin admin] RBAC: Authorizing `identity:get_user(user_id=6cb1515034ae4cf4921e9b2eb5f14f7e)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:26.392107 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ac176-c735-4b95-85c1-225ec5506864 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:26.393983 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 61/126] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:26 2022] GET /identity/v3/users/6cb1515034ae4cf4921e9b2eb5f14f7e => generated 275 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:26.399877 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbb1b6-9644-4c0a-b825-26e4691347c4 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:26.419565 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbb1b6-9644-4c0a-b825-26e4691347c4 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:26.433269 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60958c7b-8a6f-4252-b903-aa66d7a38b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:26.434182 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60958c7b-8a6f-4252-b903-aa66d7a38b7d admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:26.434468 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60958c7b-8a6f-4252-b903-aa66d7a38b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:26.434748 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60958c7b-8a6f-4252-b903-aa66d7a38b7d admin admin] PATH_INFO: `/v3/projects/de0b765453514d629b86882d62722721` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:26.436093 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60958c7b-8a6f-4252-b903-aa66d7a38b7d admin admin] RBAC: Authorizing `identity:get_project(project_id=de0b765453514d629b86882d62722721)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:26.438284 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60958c7b-8a6f-4252-b903-aa66d7a38b7d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:26.440031 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 66/127] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:26 2022] GET /identity/v3/projects/de0b765453514d629b86882d62722721 => generated 312 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:26.446074 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ac176-c735-4b95-85c1-225ec5506864 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:26.458679 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ac176-c735-4b95-85c1-225ec5506864 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:26.465524 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e5cb3-586c-41a6-b5e2-47b8428a2167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:26.466452 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e5cb3-586c-41a6-b5e2-47b8428a2167 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:26.466733 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e5cb3-586c-41a6-b5e2-47b8428a2167 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:26.467010 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e5cb3-586c-41a6-b5e2-47b8428a2167 admin admin] PATH_INFO: `/v3/projects/de0b765453514d629b86882d62722721/users/6cb1515034ae4cf4921e9b2eb5f14f7e/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:26.469151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e5cb3-586c-41a6-b5e2-47b8428a2167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0b765453514d629b86882d62722721, user_id=6cb1515034ae4cf4921e9b2eb5f14f7e, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:26.471867 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e5cb3-586c-41a6-b5e2-47b8428a2167 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:26.497380 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 62/128] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:37:26 2022] PUT /identity/v3/projects/de0b765453514d629b86882d62722721/users/6cb1515034ae4cf4921e9b2eb5f14f7e/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:37:26.755111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1033d-668b-45b4-87b8-fa7880a9dce7 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:26.755421 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1033d-668b-45b4-87b8-fa7880a9dce7 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:26.755681 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1033d-668b-45b4-87b8-fa7880a9dce7 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:26.757492 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 67/129] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:26.763244 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6fe5d-1c9b-4000-b1cb-4d9045d0b051 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:26.763528 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6fe5d-1c9b-4000-b1cb-4d9045d0b051 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:26.763804 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6fe5d-1c9b-4000-b1cb-4d9045d0b051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:26.789540 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-54e6fe5d-1c9b-4000-b1cb-4d9045d0b051 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:26.790781 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-54e6fe5d-1c9b-4000-b1cb-4d9045d0b051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:26.875356 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 63/130] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:26.904293 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1033d-668b-45b4-87b8-fa7880a9dce7 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:26.918617 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1033d-668b-45b4-87b8-fa7880a9dce7 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:26.925017 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac121cf-ed98-4b3a-842f-63809f3c3662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:26.925936 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac121cf-ed98-4b3a-842f-63809f3c3662 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:26.926218 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac121cf-ed98-4b3a-842f-63809f3c3662 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:26.926493 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac121cf-ed98-4b3a-842f-63809f3c3662 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:26.939233 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac121cf-ed98-4b3a-842f-63809f3c3662 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:26.946277 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-2ac121cf-ed98-4b3a-842f-63809f3c3662 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 17:37:26.947717 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 68/131] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:26.953374 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6fe5d-1c9b-4000-b1cb-4d9045d0b051 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:26.967310 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6fe5d-1c9b-4000-b1cb-4d9045d0b051 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:26.971818 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838eeb0-bf68-49f7-997b-14971eb5bbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:26.972546 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838eeb0-bf68-49f7-997b-14971eb5bbca admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:26.972831 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838eeb0-bf68-49f7-997b-14971eb5bbca admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:26.973133 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838eeb0-bf68-49f7-997b-14971eb5bbca admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:26.973914 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838eeb0-bf68-49f7-997b-14971eb5bbca admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:26.974218 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838eeb0-bf68-49f7-997b-14971eb5bbca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:26.975871 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838eeb0-bf68-49f7-997b-14971eb5bbca admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:26.988573 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 64/132] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:26.994128 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac121cf-ed98-4b3a-842f-63809f3c3662 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:27.010024 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac121cf-ed98-4b3a-842f-63809f3c3662 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:27.017467 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d610cb-6f03-4a06-a062-5d7a1ec716ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:27.018370 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d610cb-6f03-4a06-a062-5d7a1ec716ea admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:27.018654 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d610cb-6f03-4a06-a062-5d7a1ec716ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:27.019003 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d610cb-6f03-4a06-a062-5d7a1ec716ea admin admin] PATH_INFO: `/v3/users/e3ff52062c82425b80b88670349ead2c` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:27.037618 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d610cb-6f03-4a06-a062-5d7a1ec716ea admin admin] RBAC: Authorizing `identity:get_user(user_id=e3ff52062c82425b80b88670349ead2c)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:27.039832 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d610cb-6f03-4a06-a062-5d7a1ec716ea admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:27.041594 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 69/133] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:26 2022] GET /identity/v3/users/e3ff52062c82425b80b88670349ead2c => generated 289 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:27.047247 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838eeb0-bf68-49f7-997b-14971eb5bbca admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:27.061856 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838eeb0-bf68-49f7-997b-14971eb5bbca admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:27.066446 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269011c-3102-4739-b8a7-54275a9fcca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:27.067101 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269011c-3102-4739-b8a7-54275a9fcca2 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:27.067384 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269011c-3102-4739-b8a7-54275a9fcca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:27.067667 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269011c-3102-4739-b8a7-54275a9fcca2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:27.081011 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269011c-3102-4739-b8a7-54275a9fcca2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:27.082919 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269011c-3102-4739-b8a7-54275a9fcca2 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:27.098614 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 65/134] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:27.103925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d610cb-6f03-4a06-a062-5d7a1ec716ea admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:27.117821 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d610cb-6f03-4a06-a062-5d7a1ec716ea admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:27.125475 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f1e73-c441-48c3-9a06-6432d443d4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:27.126355 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f1e73-c441-48c3-9a06-6432d443d4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:27.126638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f1e73-c441-48c3-9a06-6432d443d4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:27.126915 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f1e73-c441-48c3-9a06-6432d443d4a5 admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:27.128195 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f1e73-c441-48c3-9a06-6432d443d4a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e853ee55e324805acbbf0aff75277c3)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:27.130346 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f1e73-c441-48c3-9a06-6432d443d4a5 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:27.132265 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 70/135] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:27 2022] GET /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:27.137810 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269011c-3102-4739-b8a7-54275a9fcca2 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:27.147025 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269011c-3102-4739-b8a7-54275a9fcca2 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:27.155353 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc5ef2-e4c7-43f5-a120-9edc3b2291d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:27.156037 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc5ef2-e4c7-43f5-a120-9edc3b2291d5 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:27.156366 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc5ef2-e4c7-43f5-a120-9edc3b2291d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:27.156650 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc5ef2-e4c7-43f5-a120-9edc3b2291d5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:27.157608 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc5ef2-e4c7-43f5-a120-9edc3b2291d5 admin admin] RBAC: Adding query filter params (role.id=4c8859f798ea45efab8e71b3dc25a52a, scope.project.id=3e853ee55e324805acbbf0aff75277c3, user.id=e3ff52062c82425b80b88670349ead2c) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:27.157924 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc5ef2-e4c7-43f5-a120-9edc3b2291d5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:27.159902 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc5ef2-e4c7-43f5-a120-9edc3b2291d5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:27.166589 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 66/136] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:37:27 2022] GET /identity/v3/role_assignments?user.id=e3ff52062c82425b80b88670349ead2c&scope.project.id=3e853ee55e324805acbbf0aff75277c3&role.id=4c8859f798ea45efab8e71b3dc25a52a => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:27.732606 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cfbf2-2407-4ac3-99ab-eb71a053cced None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:27.733303 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cfbf2-2407-4ac3-99ab-eb71a053cced None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:27.733303 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cfbf2-2407-4ac3-99ab-eb71a053cced None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:27.735210 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 71/137] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:27.740700 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064fa3e-6a0d-4023-b4eb-e8e9ebf0c9a7 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:27.741195 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064fa3e-6a0d-4023-b4eb-e8e9ebf0c9a7 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:27.741335 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064fa3e-6a0d-4023-b4eb-e8e9ebf0c9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:27.765346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-b064fa3e-6a0d-4023-b4eb-e8e9ebf0c9a7 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:27.766600 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b064fa3e-6a0d-4023-b4eb-e8e9ebf0c9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:27.778498 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 67/138] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:27.815055 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589cfbf2-2407-4ac3-99ab-eb71a053cced None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:27.834969 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589cfbf2-2407-4ac3-99ab-eb71a053cced None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:27.844877 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb97dd-0ca1-453d-9c25-b7302323eacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:27.845692 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb97dd-0ca1-453d-9c25-b7302323eacf admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:27.845975 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb97dd-0ca1-453d-9c25-b7302323eacf admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:27.846249 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb97dd-0ca1-453d-9c25-b7302323eacf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:27.865722 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb97dd-0ca1-453d-9c25-b7302323eacf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:27.872983 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-7aeb97dd-0ca1-453d-9c25-b7302323eacf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:37:27.875169 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 72/139] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:37:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:27.880793 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064fa3e-6a0d-4023-b4eb-e8e9ebf0c9a7 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:27.890078 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064fa3e-6a0d-4023-b4eb-e8e9ebf0c9a7 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:27.901306 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3a7b6-318e-4e3a-a46c-0fd898d0984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:27.901983 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3a7b6-318e-4e3a-a46c-0fd898d0984c admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:27.902272 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3a7b6-318e-4e3a-a46c-0fd898d0984c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:27.902551 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3a7b6-318e-4e3a-a46c-0fd898d0984c admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:27.903502 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3a7b6-318e-4e3a-a46c-0fd898d0984c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:27.903813 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3a7b6-318e-4e3a-a46c-0fd898d0984c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:27.905480 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3a7b6-318e-4e3a-a46c-0fd898d0984c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:27.922680 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 68/140] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:27.928053 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb97dd-0ca1-453d-9c25-b7302323eacf admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:27.942754 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb97dd-0ca1-453d-9c25-b7302323eacf admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:27.952932 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2cb1e-4324-412f-8186-7507532a2b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:27.954216 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2cb1e-4324-412f-8186-7507532a2b04 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:27.954500 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2cb1e-4324-412f-8186-7507532a2b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:27.955184 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2cb1e-4324-412f-8186-7507532a2b04 admin admin] PATH_INFO: `/v3/users/8900330194a64240acfd4144b4e26c1b` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:27.961627 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2cb1e-4324-412f-8186-7507532a2b04 admin admin] RBAC: Authorizing `identity:get_user(user_id=8900330194a64240acfd4144b4e26c1b)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:27.963494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2cb1e-4324-412f-8186-7507532a2b04 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:27.965187 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 73/141] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:27 2022] GET /identity/v3/users/8900330194a64240acfd4144b4e26c1b => generated 247 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:27.970836 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3a7b6-318e-4e3a-a46c-0fd898d0984c admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:27.985526 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3a7b6-318e-4e3a-a46c-0fd898d0984c admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:27.990059 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9260d-b52b-469d-86a8-7c5ce76c8107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:27.990714 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9260d-b52b-469d-86a8-7c5ce76c8107 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:27.991001 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9260d-b52b-469d-86a8-7c5ce76c8107 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:27.991341 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9260d-b52b-469d-86a8-7c5ce76c8107 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:28.002459 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9260d-b52b-469d-86a8-7c5ce76c8107 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:28.004471 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9260d-b52b-469d-86a8-7c5ce76c8107 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:28.017321 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 69/142] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:28.022583 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2cb1e-4324-412f-8186-7507532a2b04 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:28.038394 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2cb1e-4324-412f-8186-7507532a2b04 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:28.045948 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f76b2-9676-4b51-bdec-e5d871ec98d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:28.046807 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f76b2-9676-4b51-bdec-e5d871ec98d4 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:28.047090 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f76b2-9676-4b51-bdec-e5d871ec98d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:28.047370 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f76b2-9676-4b51-bdec-e5d871ec98d4 admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:28.053587 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f76b2-9676-4b51-bdec-e5d871ec98d4 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e853ee55e324805acbbf0aff75277c3)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:28.055671 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f76b2-9676-4b51-bdec-e5d871ec98d4 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:28.057367 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 74/143] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:28 2022] GET /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:28.063498 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9260d-b52b-469d-86a8-7c5ce76c8107 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:28.073113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9260d-b52b-469d-86a8-7c5ce76c8107 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:28.084551 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35276405-e16a-4458-8568-3eface4c487a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:28.085236 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35276405-e16a-4458-8568-3eface4c487a admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:28.085521 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35276405-e16a-4458-8568-3eface4c487a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:28.085815 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35276405-e16a-4458-8568-3eface4c487a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:28.086698 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35276405-e16a-4458-8568-3eface4c487a admin admin] RBAC: Adding query filter params (role.id=3c05bedf79e04eb38d2ae66736030bfe, scope.project.id=3e853ee55e324805acbbf0aff75277c3, user.id=8900330194a64240acfd4144b4e26c1b) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:28.087017 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35276405-e16a-4458-8568-3eface4c487a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:28.089024 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35276405-e16a-4458-8568-3eface4c487a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:28.095406 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 70/144] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:37:28 2022] GET /identity/v3/role_assignments?user.id=8900330194a64240acfd4144b4e26c1b&scope.project.id=3e853ee55e324805acbbf0aff75277c3&role.id=3c05bedf79e04eb38d2ae66736030bfe => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:28.909896 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ab61b-9505-4bcb-86b4-7cbe80760eb3 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:28.910574 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ab61b-9505-4bcb-86b4-7cbe80760eb3 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:28.910574 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ab61b-9505-4bcb-86b4-7cbe80760eb3 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:28.912386 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 75/145] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:28.918748 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89a392-79be-4b96-b11c-df07581e3e92 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:28.919243 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89a392-79be-4b96-b11c-df07581e3e92 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:28.919390 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89a392-79be-4b96-b11c-df07581e3e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:28.945875 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-6a89a392-79be-4b96-b11c-df07581e3e92 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:28.947061 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-6a89a392-79be-4b96-b11c-df07581e3e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:28.954801 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 71/146] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:37:29.000233 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ab61b-9505-4bcb-86b4-7cbe80760eb3 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:29.017634 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eab675-9853-4458-b799-6b5f67cbbf81 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:29.018055 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eab675-9853-4458-b799-6b5f67cbbf81 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:29.018222 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eab675-9853-4458-b799-6b5f67cbbf81 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:29.020181 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 72/147] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:37:29.020638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ab61b-9505-4bcb-86b4-7cbe80760eb3 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:29.025623 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d67dc-81dd-442d-9cd5-d2b5d80e4340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:29.026431 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d67dc-81dd-442d-9cd5-d2b5d80e4340 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:29.026711 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d67dc-81dd-442d-9cd5-d2b5d80e4340 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:29.026983 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d67dc-81dd-442d-9cd5-d2b5d80e4340 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:29.038601 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd4a51-2e3a-4662-be58-d71d9a2f005c None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:29.038898 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd4a51-2e3a-4662-be58-d71d9a2f005c None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:29.039149 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd4a51-2e3a-4662-be58-d71d9a2f005c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:29.044386 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d67dc-81dd-442d-9cd5-d2b5d80e4340 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:29.051299 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-512d67dc-81dd-442d-9cd5-d2b5d80e4340 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 17:37:29.052526 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 76/148] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:29.068438 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d67dc-81dd-442d-9cd5-d2b5d80e4340 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:29.077714 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-21cd4a51-2e3a-4662-be58-d71d9a2f005c None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:29.079193 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-21cd4a51-2e3a-4662-be58-d71d9a2f005c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:29.084189 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d67dc-81dd-442d-9cd5-d2b5d80e4340 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:29.088224 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 73/149] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Jan 10 17:37:29.092192 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a05f2-5f9c-44d3-b4dd-04aa509eff9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:29.092880 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a05f2-5f9c-44d3-b4dd-04aa509eff9e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:29.093177 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a05f2-5f9c-44d3-b4dd-04aa509eff9e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:29.093451 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a05f2-5f9c-44d3-b4dd-04aa509eff9e admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:29.094225 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a05f2-5f9c-44d3-b4dd-04aa509eff9e admin admin] RBAC: Adding query filter params (name=member) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:29.094531 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a05f2-5f9c-44d3-b4dd-04aa509eff9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:29.096149 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a05f2-5f9c-44d3-b4dd-04aa509eff9e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:29.110894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 77/150] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:29.113981 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd4a51-2e3a-4662-be58-d71d9a2f005c None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:29.124104 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd4a51-2e3a-4662-be58-d71d9a2f005c None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:29.129313 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2579de-33de-4123-afe0-40e573098479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:29.129737 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a05f2-5f9c-44d3-b4dd-04aa509eff9e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:29.130867 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2579de-33de-4123-afe0-40e573098479 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:29.131706 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2579de-33de-4123-afe0-40e573098479 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:29.132182 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2579de-33de-4123-afe0-40e573098479 admin admin] PATH_INFO: `/v3/users/6cb1515034ae4cf4921e9b2eb5f14f7e` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:29.133655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2579de-33de-4123-afe0-40e573098479 admin admin] RBAC: Authorizing `identity:get_user(user_id=6cb1515034ae4cf4921e9b2eb5f14f7e)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:29.136319 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2579de-33de-4123-afe0-40e573098479 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:29.138338 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 74/151] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:29 2022] GET /identity/v3/users/6cb1515034ae4cf4921e9b2eb5f14f7e => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:29.144398 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2579de-33de-4123-afe0-40e573098479 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:29.144519 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a05f2-5f9c-44d3-b4dd-04aa509eff9e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:29.152344 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195b1ab-0098-4b61-ad6d-682da8f4b347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:29.153263 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195b1ab-0098-4b61-ad6d-682da8f4b347 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:29.153592 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195b1ab-0098-4b61-ad6d-682da8f4b347 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:29.153873 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195b1ab-0098-4b61-ad6d-682da8f4b347 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:29.154878 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2579de-33de-4123-afe0-40e573098479 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:29.159216 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7d288-4b18-4d19-9afc-cb9ff1071139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:29.159926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7d288-4b18-4d19-9afc-cb9ff1071139 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:29.160206 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7d288-4b18-4d19-9afc-cb9ff1071139 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:29.160483 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7d288-4b18-4d19-9afc-cb9ff1071139 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:29.168471 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7d288-4b18-4d19-9afc-cb9ff1071139 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:29.170303 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7d288-4b18-4d19-9afc-cb9ff1071139 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:29.179606 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 75/152] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:29.185113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7d288-4b18-4d19-9afc-cb9ff1071139 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:29.185777 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195b1ab-0098-4b61-ad6d-682da8f4b347 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:29.193049 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-b195b1ab-0098-4b61-ad6d-682da8f4b347 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 17:37:29.193715 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7d288-4b18-4d19-9afc-cb9ff1071139 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:29.194362 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 78/153] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:37:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:29.199848 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195b1ab-0098-4b61-ad6d-682da8f4b347 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:29.209833 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195b1ab-0098-4b61-ad6d-682da8f4b347 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:29.214494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ffb96-1515-4bf6-a662-0261f19952c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:29.215211 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ffb96-1515-4bf6-a662-0261f19952c8 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:29.215544 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ffb96-1515-4bf6-a662-0261f19952c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:29.215821 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ffb96-1515-4bf6-a662-0261f19952c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:29.216621 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ffb96-1515-4bf6-a662-0261f19952c8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:29.216962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ffb96-1515-4bf6-a662-0261f19952c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:29.217519 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be40940-3cca-400a-b0e7-581406d5d586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:29.218406 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be40940-3cca-400a-b0e7-581406d5d586 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:29.218645 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ffb96-1515-4bf6-a662-0261f19952c8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:29.218742 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be40940-3cca-400a-b0e7-581406d5d586 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:29.218947 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be40940-3cca-400a-b0e7-581406d5d586 admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:29.220178 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be40940-3cca-400a-b0e7-581406d5d586 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e853ee55e324805acbbf0aff75277c3)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:29.222320 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be40940-3cca-400a-b0e7-581406d5d586 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:29.224041 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 76/154] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:29 2022] GET /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:29.231882 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be40940-3cca-400a-b0e7-581406d5d586 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:29.233077 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 79/155] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:37:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:29.238563 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ffb96-1515-4bf6-a662-0261f19952c8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:29.248296 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ffb96-1515-4bf6-a662-0261f19952c8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:29.252354 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be40940-3cca-400a-b0e7-581406d5d586 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:29.252880 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e1ab3-cd3e-4485-a15c-c738637b8611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:29.253805 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e1ab3-cd3e-4485-a15c-c738637b8611 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:29.254088 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e1ab3-cd3e-4485-a15c-c738637b8611 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:29.254376 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e1ab3-cd3e-4485-a15c-c738637b8611 admin admin] PATH_INFO: `/v3/users/6cb1515034ae4cf4921e9b2eb5f14f7e` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:29.255666 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e1ab3-cd3e-4485-a15c-c738637b8611 admin admin] RBAC: Authorizing `identity:get_user(user_id=6cb1515034ae4cf4921e9b2eb5f14f7e)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:29.258085 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e1ab3-cd3e-4485-a15c-c738637b8611 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:29.260015 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 80/156] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:29 2022] GET /identity/v3/users/6cb1515034ae4cf4921e9b2eb5f14f7e => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:29.265184 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e1ab3-cd3e-4485-a15c-c738637b8611 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:29.269499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3356ed-bdfa-4f61-9388-9bf15950f10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:29.270164 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3356ed-bdfa-4f61-9388-9bf15950f10d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:29.270446 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3356ed-bdfa-4f61-9388-9bf15950f10d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:29.270724 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3356ed-bdfa-4f61-9388-9bf15950f10d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:29.271577 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3356ed-bdfa-4f61-9388-9bf15950f10d admin admin] RBAC: Adding query filter params (role.id=3c8f0c77d36b49608a0e17cfcff15691, scope.project.id=3e853ee55e324805acbbf0aff75277c3, user.id=6cb1515034ae4cf4921e9b2eb5f14f7e) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:29.271886 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3356ed-bdfa-4f61-9388-9bf15950f10d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:29.274127 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3356ed-bdfa-4f61-9388-9bf15950f10d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:29.275217 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e1ab3-cd3e-4485-a15c-c738637b8611 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:29.279604 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72070251-5cc9-40c6-a818-c0b574599f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:29.280273 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72070251-5cc9-40c6-a818-c0b574599f5b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:29.280603 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72070251-5cc9-40c6-a818-c0b574599f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:29.280913 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72070251-5cc9-40c6-a818-c0b574599f5b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:29.288614 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 77/157] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:37:29 2022] GET /identity/v3/role_assignments?user.id=6cb1515034ae4cf4921e9b2eb5f14f7e&scope.project.id=3e853ee55e324805acbbf0aff75277c3&role.id=3c8f0c77d36b49608a0e17cfcff15691 => generated 608 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:29.289389 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72070251-5cc9-40c6-a818-c0b574599f5b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:29.297917 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72070251-5cc9-40c6-a818-c0b574599f5b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:29.308021 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 81/158] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 17:37:29.313960 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3356ed-bdfa-4f61-9388-9bf15950f10d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:29.335662 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3356ed-bdfa-4f61-9388-9bf15950f10d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:29.347215 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf992f87-5932-4523-afce-822535e7aeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:29.348127 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf992f87-5932-4523-afce-822535e7aeba admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:29.348410 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf992f87-5932-4523-afce-822535e7aeba admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:29.348688 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf992f87-5932-4523-afce-822535e7aeba admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:29.353998 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf992f87-5932-4523-afce-822535e7aeba admin admin] RBAC: Authorizing `identity:get_project(project_id=3e853ee55e324805acbbf0aff75277c3)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:29.356242 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf992f87-5932-4523-afce-822535e7aeba admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:29.358208 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 78/159] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:29 2022] GET /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:29.364478 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72070251-5cc9-40c6-a818-c0b574599f5b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:29.374261 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72070251-5cc9-40c6-a818-c0b574599f5b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:29.386100 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ae835-4177-437b-8858-d4380d881562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:29.386776 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ae835-4177-437b-8858-d4380d881562 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:29.387050 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ae835-4177-437b-8858-d4380d881562 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:29.387317 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ae835-4177-437b-8858-d4380d881562 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:29.388174 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ae835-4177-437b-8858-d4380d881562 admin admin] RBAC: Adding query filter params (role.id=112bab30f846403ea40d96a74a04af2c, scope.project.id=3e853ee55e324805acbbf0aff75277c3, user.id=6cb1515034ae4cf4921e9b2eb5f14f7e) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:29.388529 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ae835-4177-437b-8858-d4380d881562 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:29.390540 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ae835-4177-437b-8858-d4380d881562 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:29.397350 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 82/160] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:37:29 2022] GET /identity/v3/role_assignments?user.id=6cb1515034ae4cf4921e9b2eb5f14f7e&scope.project.id=3e853ee55e324805acbbf0aff75277c3&role.id=112bab30f846403ea40d96a74a04af2c => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:29.814323 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f18ee2-d1f3-4c7d-91c5-d725628cc9b2 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:29.814722 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f18ee2-d1f3-4c7d-91c5-d725628cc9b2 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:29.814879 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f18ee2-d1f3-4c7d-91c5-d725628cc9b2 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:29.817002 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 79/161] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:29.824299 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2d218-dcd9-44b2-801c-68bfac58c012 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:29.824894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2d218-dcd9-44b2-801c-68bfac58c012 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:29.825361 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2d218-dcd9-44b2-801c-68bfac58c012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:29.844749 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-18c2d218-dcd9-44b2-801c-68bfac58c012 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:29.846314 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-18c2d218-dcd9-44b2-801c-68bfac58c012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:29.855292 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 83/162] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:29.881475 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f18ee2-d1f3-4c7d-91c5-d725628cc9b2 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:29.893848 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f18ee2-d1f3-4c7d-91c5-d725628cc9b2 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:29.898752 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3597e-a174-47e7-8a45-ed4497c6b95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:29.899774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3597e-a174-47e7-8a45-ed4497c6b95c admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:29.900239 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3597e-a174-47e7-8a45-ed4497c6b95c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:29.900693 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3597e-a174-47e7-8a45-ed4497c6b95c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:29.902061 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3597e-a174-47e7-8a45-ed4497c6b95c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:29.903929 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3597e-a174-47e7-8a45-ed4497c6b95c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:29.905768 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 80/163] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:37:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:29.911400 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2d218-dcd9-44b2-801c-68bfac58c012 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:29.920302 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2d218-dcd9-44b2-801c-68bfac58c012 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:29.924818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f4ab9-0fca-449c-a36d-6dc368e86677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:29.925622 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f4ab9-0fca-449c-a36d-6dc368e86677 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:29.925906 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f4ab9-0fca-449c-a36d-6dc368e86677 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:29.926180 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f4ab9-0fca-449c-a36d-6dc368e86677 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:29.926920 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f4ab9-0fca-449c-a36d-6dc368e86677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:29.927954 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING py.warnings [None req-225f4ab9-0fca-449c-a36d-6dc368e86677 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:37:29.927954 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: warnings.warn(msg) Jan 10 17:37:29.927954 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: Jan 10 17:37:29.929289 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f4ab9-0fca-449c-a36d-6dc368e86677 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:29.956210 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 84/164] 10.222.0.31 () {60 vars in 1153 bytes} [Mon Jan 10 17:37:29 2022] POST /identity/v3/users => generated 283 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:37:30.186929 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c21233-667d-4a2c-bcf9-d24d28e2fbcc None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:30.187469 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c21233-667d-4a2c-bcf9-d24d28e2fbcc None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:30.187469 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c21233-667d-4a2c-bcf9-d24d28e2fbcc None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:30.189295 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 81/165] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:30.194685 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bc044-6074-442c-90eb-4fb25fad0f48 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:30.195003 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bc044-6074-442c-90eb-4fb25fad0f48 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:30.195281 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bc044-6074-442c-90eb-4fb25fad0f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:30.214074 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-297bc044-6074-442c-90eb-4fb25fad0f48 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:30.215239 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-297bc044-6074-442c-90eb-4fb25fad0f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:30.223079 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 85/166] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:30.247878 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c21233-667d-4a2c-bcf9-d24d28e2fbcc None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:30.266704 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c21233-667d-4a2c-bcf9-d24d28e2fbcc None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:30.270983 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4376343-623a-4bdc-bfce-4e090be5481e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:30.271806 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4376343-623a-4bdc-bfce-4e090be5481e admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:30.272079 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4376343-623a-4bdc-bfce-4e090be5481e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:30.272347 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4376343-623a-4bdc-bfce-4e090be5481e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:30.283858 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4376343-623a-4bdc-bfce-4e090be5481e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:30.290829 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-a4376343-623a-4bdc-bfce-4e090be5481e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 17:37:30.292412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 82/167] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:30.298147 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bc044-6074-442c-90eb-4fb25fad0f48 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:30.308538 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bc044-6074-442c-90eb-4fb25fad0f48 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:30.313157 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729b3e4-ff5d-4a78-8e33-9890a7c116d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:30.313849 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729b3e4-ff5d-4a78-8e33-9890a7c116d6 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:30.314126 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729b3e4-ff5d-4a78-8e33-9890a7c116d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:30.314411 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729b3e4-ff5d-4a78-8e33-9890a7c116d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:30.315175 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729b3e4-ff5d-4a78-8e33-9890a7c116d6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:30.315478 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729b3e4-ff5d-4a78-8e33-9890a7c116d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:30.317239 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729b3e4-ff5d-4a78-8e33-9890a7c116d6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:30.326399 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 86/168] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:30.331823 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4376343-623a-4bdc-bfce-4e090be5481e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:30.342111 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4376343-623a-4bdc-bfce-4e090be5481e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:30.346346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c71e3-a077-4323-90e5-6cb44046cc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:30.347274 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c71e3-a077-4323-90e5-6cb44046cc91 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:30.347552 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c71e3-a077-4323-90e5-6cb44046cc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:30.347823 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c71e3-a077-4323-90e5-6cb44046cc91 admin admin] PATH_INFO: `/v3/users/6cb1515034ae4cf4921e9b2eb5f14f7e` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:30.349052 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c71e3-a077-4323-90e5-6cb44046cc91 admin admin] RBAC: Authorizing `identity:get_user(user_id=6cb1515034ae4cf4921e9b2eb5f14f7e)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:30.351285 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c71e3-a077-4323-90e5-6cb44046cc91 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:30.353143 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 83/169] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:30 2022] GET /identity/v3/users/6cb1515034ae4cf4921e9b2eb5f14f7e => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:30.358432 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729b3e4-ff5d-4a78-8e33-9890a7c116d6 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:30.368204 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729b3e4-ff5d-4a78-8e33-9890a7c116d6 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:30.372508 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379e756-c71d-45e0-adda-16e61d43dad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:30.373183 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379e756-c71d-45e0-adda-16e61d43dad0 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:30.373465 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379e756-c71d-45e0-adda-16e61d43dad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:30.373739 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379e756-c71d-45e0-adda-16e61d43dad0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:30.381938 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379e756-c71d-45e0-adda-16e61d43dad0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:30.383744 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379e756-c71d-45e0-adda-16e61d43dad0 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:30.393327 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 87/170] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:30.399039 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c71e3-a077-4323-90e5-6cb44046cc91 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:30.408767 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c71e3-a077-4323-90e5-6cb44046cc91 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:30.413331 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930fe1a-f46f-47bf-be69-ee48306e5ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:30.414219 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930fe1a-f46f-47bf-be69-ee48306e5ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:30.414492 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930fe1a-f46f-47bf-be69-ee48306e5ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:30.414764 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930fe1a-f46f-47bf-be69-ee48306e5ce0 admin admin] PATH_INFO: `/v3/projects/de0b765453514d629b86882d62722721` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:30.415966 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930fe1a-f46f-47bf-be69-ee48306e5ce0 admin admin] RBAC: Authorizing `identity:get_project(project_id=de0b765453514d629b86882d62722721)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:30.418075 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930fe1a-f46f-47bf-be69-ee48306e5ce0 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:30.419973 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 84/171] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:30 2022] GET /identity/v3/projects/de0b765453514d629b86882d62722721 => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:30.425562 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379e756-c71d-45e0-adda-16e61d43dad0 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:30.434517 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379e756-c71d-45e0-adda-16e61d43dad0 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:30.439036 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed05a15-554a-4f1c-b603-aca385d8a9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:30.439688 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed05a15-554a-4f1c-b603-aca385d8a9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:30.439970 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed05a15-554a-4f1c-b603-aca385d8a9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:30.440242 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed05a15-554a-4f1c-b603-aca385d8a9f7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:30.441237 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed05a15-554a-4f1c-b603-aca385d8a9f7 admin admin] RBAC: Adding query filter params (role.id=3c8f0c77d36b49608a0e17cfcff15691, scope.project.id=de0b765453514d629b86882d62722721, user.id=6cb1515034ae4cf4921e9b2eb5f14f7e) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:30.441546 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed05a15-554a-4f1c-b603-aca385d8a9f7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:30.443611 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed05a15-554a-4f1c-b603-aca385d8a9f7 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:30.445925 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f7611-35b6-4d78-a54f-6ecbe10a92b6 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:30.446410 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f7611-35b6-4d78-a54f-6ecbe10a92b6 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:30.446526 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f7611-35b6-4d78-a54f-6ecbe10a92b6 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:30.448240 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 85/172] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:37:30.451754 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 88/173] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:37:30 2022] GET /identity/v3/role_assignments?user.id=6cb1515034ae4cf4921e9b2eb5f14f7e&scope.project.id=de0b765453514d629b86882d62722721&role.id=3c8f0c77d36b49608a0e17cfcff15691 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:30.453408 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c79ab-de50-4e02-ae7c-a8981ade5a7c None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:30.453695 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c79ab-de50-4e02-ae7c-a8981ade5a7c None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:30.454021 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c79ab-de50-4e02-ae7c-a8981ade5a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:30.473804 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-cd6c79ab-de50-4e02-ae7c-a8981ade5a7c None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:30.474722 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-cd6c79ab-de50-4e02-ae7c-a8981ade5a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:30.486323 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 86/174] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:30.516732 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed05a15-554a-4f1c-b603-aca385d8a9f7 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:30.527912 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed05a15-554a-4f1c-b603-aca385d8a9f7 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:30.532764 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1955c2-c4a5-4dc8-8289-adf1e8955f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:30.533686 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1955c2-c4a5-4dc8-8289-adf1e8955f51 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:30.533978 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1955c2-c4a5-4dc8-8289-adf1e8955f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:30.534242 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1955c2-c4a5-4dc8-8289-adf1e8955f51 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:30.547038 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1955c2-c4a5-4dc8-8289-adf1e8955f51 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:30.554387 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-3f1955c2-c4a5-4dc8-8289-adf1e8955f51 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 17:37:30.555540 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 89/175] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:30.561595 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c79ab-de50-4e02-ae7c-a8981ade5a7c None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:30.575394 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c79ab-de50-4e02-ae7c-a8981ade5a7c None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:30.581288 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed2cc5-f744-4e71-ac4f-752b8054c133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:30.582168 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed2cc5-f744-4e71-ac4f-752b8054c133 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:30.582586 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed2cc5-f744-4e71-ac4f-752b8054c133 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:30.582998 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed2cc5-f744-4e71-ac4f-752b8054c133 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:30.583961 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed2cc5-f744-4e71-ac4f-752b8054c133 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:30.584434 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed2cc5-f744-4e71-ac4f-752b8054c133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:30.586232 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed2cc5-f744-4e71-ac4f-752b8054c133 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:30.597722 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 87/176] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:30.603896 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1955c2-c4a5-4dc8-8289-adf1e8955f51 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:30.616379 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1955c2-c4a5-4dc8-8289-adf1e8955f51 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:30.621334 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f0397-46b3-4af1-a8ae-c6b0df590e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:30.622473 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f0397-46b3-4af1-a8ae-c6b0df590e64 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:30.622942 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f0397-46b3-4af1-a8ae-c6b0df590e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:30.623348 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f0397-46b3-4af1-a8ae-c6b0df590e64 admin admin] PATH_INFO: `/v3/users/e3ff52062c82425b80b88670349ead2c` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:30.624839 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f0397-46b3-4af1-a8ae-c6b0df590e64 admin admin] RBAC: Authorizing `identity:get_user(user_id=e3ff52062c82425b80b88670349ead2c)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:30.627374 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f0397-46b3-4af1-a8ae-c6b0df590e64 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:30.629800 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 90/177] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:30 2022] GET /identity/v3/users/e3ff52062c82425b80b88670349ead2c => generated 289 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:30.635688 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed2cc5-f744-4e71-ac4f-752b8054c133 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:30.646901 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed2cc5-f744-4e71-ac4f-752b8054c133 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:30.652295 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166de74-c21d-4dc9-b32a-8543293c72db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:30.653466 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166de74-c21d-4dc9-b32a-8543293c72db admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:30.653888 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166de74-c21d-4dc9-b32a-8543293c72db admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:30.654333 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166de74-c21d-4dc9-b32a-8543293c72db admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:30.655782 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7166de74-c21d-4dc9-b32a-8543293c72db admin admin] RBAC: Authorizing `identity:get_project(project_id=3e853ee55e324805acbbf0aff75277c3)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:30.658175 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7166de74-c21d-4dc9-b32a-8543293c72db admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:30.660551 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 88/178] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:30 2022] GET /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:30.666722 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f0397-46b3-4af1-a8ae-c6b0df590e64 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:30.677575 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f0397-46b3-4af1-a8ae-c6b0df590e64 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:30.682484 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75222b49-6674-4605-b2b1-8751a7dfcde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:30.683668 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75222b49-6674-4605-b2b1-8751a7dfcde7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:30.684091 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75222b49-6674-4605-b2b1-8751a7dfcde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:30.684542 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75222b49-6674-4605-b2b1-8751a7dfcde7 admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3/users/e3ff52062c82425b80b88670349ead2c/roles/4c8859f798ea45efab8e71b3dc25a52a` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:30.686839 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75222b49-6674-4605-b2b1-8751a7dfcde7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e853ee55e324805acbbf0aff75277c3, user_id=e3ff52062c82425b80b88670349ead2c, role_id=4c8859f798ea45efab8e71b3dc25a52a)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:30.690003 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75222b49-6674-4605-b2b1-8751a7dfcde7 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:30.707455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 91/179] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:37:30 2022] PUT /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3/users/e3ff52062c82425b80b88670349ead2c/roles/4c8859f798ea45efab8e71b3dc25a52a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:37:32.514997 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f952504-8e58-4f18-bc1a-ba856f0f7ec1 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:32.516014 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f952504-8e58-4f18-bc1a-ba856f0f7ec1 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:32.516512 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f952504-8e58-4f18-bc1a-ba856f0f7ec1 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:32.518537 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 89/180] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:32.524455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bd53c-3e95-4c1e-81d2-5ab4a6f537c8 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:32.525320 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bd53c-3e95-4c1e-81d2-5ab4a6f537c8 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:32.525792 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bd53c-3e95-4c1e-81d2-5ab4a6f537c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:32.543817 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-856bd53c-3e95-4c1e-81d2-5ab4a6f537c8 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:32.545401 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-856bd53c-3e95-4c1e-81d2-5ab4a6f537c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:32.602436 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 92/181] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:32.627271 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f952504-8e58-4f18-bc1a-ba856f0f7ec1 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:32.640127 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f952504-8e58-4f18-bc1a-ba856f0f7ec1 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:32.644765 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef82ba1-7dfc-4fe5-849a-c750fac55e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:32.645834 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef82ba1-7dfc-4fe5-849a-c750fac55e78 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:32.646304 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef82ba1-7dfc-4fe5-849a-c750fac55e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:32.646767 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef82ba1-7dfc-4fe5-849a-c750fac55e78 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:32.658000 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef82ba1-7dfc-4fe5-849a-c750fac55e78 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:32.665184 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-7ef82ba1-7dfc-4fe5-849a-c750fac55e78 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:37:32.666607 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 90/182] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:37:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:32.672584 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bd53c-3e95-4c1e-81d2-5ab4a6f537c8 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:32.682494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bd53c-3e95-4c1e-81d2-5ab4a6f537c8 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:32.687079 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88873f-4d0f-44a2-a3d5-6b8898d68c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:32.687992 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88873f-4d0f-44a2-a3d5-6b8898d68c17 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:32.688473 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88873f-4d0f-44a2-a3d5-6b8898d68c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:32.688983 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88873f-4d0f-44a2-a3d5-6b8898d68c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:32.689958 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88873f-4d0f-44a2-a3d5-6b8898d68c17 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:32.690455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88873f-4d0f-44a2-a3d5-6b8898d68c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:32.692435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88873f-4d0f-44a2-a3d5-6b8898d68c17 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:32.702744 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 93/183] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:32.708975 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef82ba1-7dfc-4fe5-849a-c750fac55e78 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:32.720235 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef82ba1-7dfc-4fe5-849a-c750fac55e78 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:32.725368 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08a44a-1701-4897-9cb4-c4c54892414e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:32.726661 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08a44a-1701-4897-9cb4-c4c54892414e admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:32.727162 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08a44a-1701-4897-9cb4-c4c54892414e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:32.727636 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08a44a-1701-4897-9cb4-c4c54892414e admin admin] PATH_INFO: `/v3/users/2332de8dcbe34ace9c320398d626c4c5` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:32.742479 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08a44a-1701-4897-9cb4-c4c54892414e admin admin] RBAC: Authorizing `identity:get_user(user_id=2332de8dcbe34ace9c320398d626c4c5)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:32.744643 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08a44a-1701-4897-9cb4-c4c54892414e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:32.746416 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 91/184] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:32 2022] GET /identity/v3/users/2332de8dcbe34ace9c320398d626c4c5 => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:32.751962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88873f-4d0f-44a2-a3d5-6b8898d68c17 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:32.761576 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c29b28-e2a9-4230-8230-019303601e0c None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:32.761857 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c29b28-e2a9-4230-8230-019303601e0c None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:32.762049 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88873f-4d0f-44a2-a3d5-6b8898d68c17 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:32.762125 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c29b28-e2a9-4230-8230-019303601e0c None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:32.764148 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 92/185] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:32.766322 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc139c22-e810-4aba-99e6-2c80a62daf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:32.766905 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc139c22-e810-4aba-99e6-2c80a62daf15 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:32.767187 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc139c22-e810-4aba-99e6-2c80a62daf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:32.767459 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc139c22-e810-4aba-99e6-2c80a62daf15 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:32.769212 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243a6f4-1f75-4a38-a15f-72196fac4521 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:32.769491 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243a6f4-1f75-4a38-a15f-72196fac4521 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:32.769765 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243a6f4-1f75-4a38-a15f-72196fac4521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:32.777962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc139c22-e810-4aba-99e6-2c80a62daf15 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:32.779765 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc139c22-e810-4aba-99e6-2c80a62daf15 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:32.788647 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-3243a6f4-1f75-4a38-a15f-72196fac4521 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:32.789919 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 94/186] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:32.790179 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-3243a6f4-1f75-4a38-a15f-72196fac4521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:32.795502 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc139c22-e810-4aba-99e6-2c80a62daf15 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:32.801083 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 93/187] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:37:32.805061 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc139c22-e810-4aba-99e6-2c80a62daf15 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:32.822790 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb181d-5dbf-481f-bc4e-d0af191f6e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:32.823676 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb181d-5dbf-481f-bc4e-d0af191f6e03 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:32.823958 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb181d-5dbf-481f-bc4e-d0af191f6e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:32.824232 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb181d-5dbf-481f-bc4e-d0af191f6e03 admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:32.825497 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb181d-5dbf-481f-bc4e-d0af191f6e03 admin admin] RBAC: Authorizing `identity:get_project(project_id=f7f01e6ad70a496b8b8df89a6b770b4c)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:32.828281 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243a6f4-1f75-4a38-a15f-72196fac4521 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:32.829023 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb181d-5dbf-481f-bc4e-d0af191f6e03 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:32.831281 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 95/188] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:32 2022] GET /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:32.837269 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb181d-5dbf-481f-bc4e-d0af191f6e03 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:32.839454 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243a6f4-1f75-4a38-a15f-72196fac4521 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:32.844071 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11541234-bb89-4272-8f88-156012efbdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:32.844534 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11541234-bb89-4272-8f88-156012efbdee admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:32.844815 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11541234-bb89-4272-8f88-156012efbdee admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:32.845130 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11541234-bb89-4272-8f88-156012efbdee admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:32.848291 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb181d-5dbf-481f-bc4e-d0af191f6e03 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:32.852813 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe7291-83bc-4376-9939-14d64e142f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:32.853696 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe7291-83bc-4376-9939-14d64e142f67 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:32.854199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe7291-83bc-4376-9939-14d64e142f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:32.854661 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe7291-83bc-4376-9939-14d64e142f67 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:32.855749 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe7291-83bc-4376-9939-14d64e142f67 admin admin] RBAC: Adding query filter params (role.id=3c05bedf79e04eb38d2ae66736030bfe, scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c, user.id=2332de8dcbe34ace9c320398d626c4c5) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:32.856246 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe7291-83bc-4376-9939-14d64e142f67 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:32.856465 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11541234-bb89-4272-8f88-156012efbdee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:32.858511 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe7291-83bc-4376-9939-14d64e142f67 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:32.863817 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-11541234-bb89-4272-8f88-156012efbdee admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 17:37:32.864831 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 96/189] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:37:32 2022] GET /identity/v3/role_assignments?user.id=2332de8dcbe34ace9c320398d626c4c5&scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c&role.id=3c05bedf79e04eb38d2ae66736030bfe => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:32.869906 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c9de2-9d1a-4bc2-8bad-ff0e27fe218a None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:32.869906 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c9de2-9d1a-4bc2-8bad-ff0e27fe218a None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:32.869906 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c9de2-9d1a-4bc2-8bad-ff0e27fe218a None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:32.870200 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 94/190] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:37:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:37:32.870754 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 97/191] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:32.871773 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11541234-bb89-4272-8f88-156012efbdee admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:32.875827 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ddfd8-86c1-4295-ba3e-1b05c0de42e4 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:32.876116 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ddfd8-86c1-4295-ba3e-1b05c0de42e4 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:32.876397 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ddfd8-86c1-4295-ba3e-1b05c0de42e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:32.886334 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11541234-bb89-4272-8f88-156012efbdee admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:32.891115 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae65da-58b1-4a56-b2c5-7c983792ec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:32.891792 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae65da-58b1-4a56-b2c5-7c983792ec9e admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:32.892069 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae65da-58b1-4a56-b2c5-7c983792ec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:32.892340 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae65da-58b1-4a56-b2c5-7c983792ec9e admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:32.893175 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae65da-58b1-4a56-b2c5-7c983792ec9e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:32.893475 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae65da-58b1-4a56-b2c5-7c983792ec9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:32.895195 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae65da-58b1-4a56-b2c5-7c983792ec9e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:32.899879 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-a02ddfd8-86c1-4295-ba3e-1b05c0de42e4 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:32.901431 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-a02ddfd8-86c1-4295-ba3e-1b05c0de42e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:32.905256 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 95/192] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:37:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:32.910453 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 98/193] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:37:32.913971 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae65da-58b1-4a56-b2c5-7c983792ec9e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:32.924583 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae65da-58b1-4a56-b2c5-7c983792ec9e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:32.929620 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dde0e-fb58-41dd-9351-75e1b75ebcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:32.930814 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dde0e-fb58-41dd-9351-75e1b75ebcf2 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:32.931289 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dde0e-fb58-41dd-9351-75e1b75ebcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:32.931746 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dde0e-fb58-41dd-9351-75e1b75ebcf2 admin admin] PATH_INFO: `/v3/users/2332de8dcbe34ace9c320398d626c4c5` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:32.933429 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8dde0e-fb58-41dd-9351-75e1b75ebcf2 admin admin] RBAC: Authorizing `identity:get_user(user_id=2332de8dcbe34ace9c320398d626c4c5)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:32.935789 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8dde0e-fb58-41dd-9351-75e1b75ebcf2 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:32.937694 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ddfd8-86c1-4295-ba3e-1b05c0de42e4 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:32.938005 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 96/194] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:32 2022] GET /identity/v3/users/2332de8dcbe34ace9c320398d626c4c5 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:32.946731 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dde0e-fb58-41dd-9351-75e1b75ebcf2 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:32.948046 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ddfd8-86c1-4295-ba3e-1b05c0de42e4 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:32.952650 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7beecc7-5323-4072-a868-14bb7ecf6258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:32.953524 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7beecc7-5323-4072-a868-14bb7ecf6258 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:32.953804 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7beecc7-5323-4072-a868-14bb7ecf6258 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:32.954085 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7beecc7-5323-4072-a868-14bb7ecf6258 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:32.955398 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7beecc7-5323-4072-a868-14bb7ecf6258 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:32.957320 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7beecc7-5323-4072-a868-14bb7ecf6258 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:32.959007 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 99/195] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:37:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:32.959774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dde0e-fb58-41dd-9351-75e1b75ebcf2 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:32.964436 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7beecc7-5323-4072-a868-14bb7ecf6258 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:32.965257 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079b7c0-dce4-473e-8bcf-a1dc56bd05cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:32.966155 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079b7c0-dce4-473e-8bcf-a1dc56bd05cb admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:32.966694 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079b7c0-dce4-473e-8bcf-a1dc56bd05cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:32.967166 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079b7c0-dce4-473e-8bcf-a1dc56bd05cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:32.974754 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7beecc7-5323-4072-a868-14bb7ecf6258 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:32.977232 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079b7c0-dce4-473e-8bcf-a1dc56bd05cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:32.979401 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9e4d3-2cb1-4984-ae42-72012a9b1dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:32.979702 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079b7c0-dce4-473e-8bcf-a1dc56bd05cb admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:32.980203 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9e4d3-2cb1-4984-ae42-72012a9b1dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:32.980487 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9e4d3-2cb1-4984-ae42-72012a9b1dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:32.980760 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9e4d3-2cb1-4984-ae42-72012a9b1dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:32.981550 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9e4d3-2cb1-4984-ae42-72012a9b1dc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:32.983595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9e4d3-2cb1-4984-ae42-72012a9b1dc0 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:32.991377 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 97/196] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 17:37:32.997523 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079b7c0-dce4-473e-8bcf-a1dc56bd05cb admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:33.007563 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079b7c0-dce4-473e-8bcf-a1dc56bd05cb admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:33.009505 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 100/197] 10.222.0.31 () {60 vars in 1153 bytes} [Mon Jan 10 17:37:32 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:37:33.012916 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdbf9c-1f5e-4011-b9a3-08f058264d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:33.014170 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdbf9c-1f5e-4011-b9a3-08f058264d62 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:33.014671 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdbf9c-1f5e-4011-b9a3-08f058264d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:33.015141 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdbf9c-1f5e-4011-b9a3-08f058264d62 admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:33.016934 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdbf9c-1f5e-4011-b9a3-08f058264d62 admin admin] RBAC: Authorizing `identity:get_project(project_id=f7f01e6ad70a496b8b8df89a6b770b4c)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:33.019452 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdbf9c-1f5e-4011-b9a3-08f058264d62 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:33.021721 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 98/198] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:32 2022] GET /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:33.028696 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9e4d3-2cb1-4984-ae42-72012a9b1dc0 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:33.040007 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9e4d3-2cb1-4984-ae42-72012a9b1dc0 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:33.045124 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34196b-b8c2-4296-aee8-a43065651bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:33.046201 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34196b-b8c2-4296-aee8-a43065651bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:33.046699 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34196b-b8c2-4296-aee8-a43065651bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:33.047233 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34196b-b8c2-4296-aee8-a43065651bb9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:33.048421 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34196b-b8c2-4296-aee8-a43065651bb9 admin admin] RBAC: Adding query filter params (role.id=112bab30f846403ea40d96a74a04af2c, scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c, user.id=2332de8dcbe34ace9c320398d626c4c5) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:33.048980 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34196b-b8c2-4296-aee8-a43065651bb9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:33.051357 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34196b-b8c2-4296-aee8-a43065651bb9 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:33.058669 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 101/199] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:37:33 2022] GET /identity/v3/role_assignments?user.id=2332de8dcbe34ace9c320398d626c4c5&scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c&role.id=112bab30f846403ea40d96a74a04af2c => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:33.174822 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71600c-e3d3-4612-a342-77b7d8aab905 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:33.175548 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71600c-e3d3-4612-a342-77b7d8aab905 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:33.176035 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71600c-e3d3-4612-a342-77b7d8aab905 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:33.178499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 99/200] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:33.184042 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960d377-4b87-4144-8884-5dad226e4233 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:33.184386 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960d377-4b87-4144-8884-5dad226e4233 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:33.184662 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960d377-4b87-4144-8884-5dad226e4233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:33.203843 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b960d377-4b87-4144-8884-5dad226e4233 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:33.205118 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b960d377-4b87-4144-8884-5dad226e4233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:33.213335 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 102/201] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:33.238066 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71600c-e3d3-4612-a342-77b7d8aab905 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:33.250773 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71600c-e3d3-4612-a342-77b7d8aab905 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:33.255580 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c3a9a-5732-4d5e-bcb0-51ed5d499ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:33.256441 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c3a9a-5732-4d5e-bcb0-51ed5d499ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:33.256761 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c3a9a-5732-4d5e-bcb0-51ed5d499ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:33.257113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c3a9a-5732-4d5e-bcb0-51ed5d499ec4 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:33.270291 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c3a9a-5732-4d5e-bcb0-51ed5d499ec4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:33.277774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-bc7c3a9a-5732-4d5e-bcb0-51ed5d499ec4 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 17:37:33.279106 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 100/202] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:33.285195 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960d377-4b87-4144-8884-5dad226e4233 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:33.294514 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960d377-4b87-4144-8884-5dad226e4233 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:33.300194 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edfe15-2dd9-4743-ade0-6f615d8d36f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:33.300983 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edfe15-2dd9-4743-ade0-6f615d8d36f3 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:33.301268 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edfe15-2dd9-4743-ade0-6f615d8d36f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:33.301539 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edfe15-2dd9-4743-ade0-6f615d8d36f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:33.302340 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edfe15-2dd9-4743-ade0-6f615d8d36f3 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:33.302650 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edfe15-2dd9-4743-ade0-6f615d8d36f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:33.304412 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edfe15-2dd9-4743-ade0-6f615d8d36f3 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:33.314521 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 103/203] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:33.320206 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c3a9a-5732-4d5e-bcb0-51ed5d499ec4 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:33.330997 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c3a9a-5732-4d5e-bcb0-51ed5d499ec4 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:33.335766 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5fa36-bcd1-4e20-abbf-06ce5e44cfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:33.336676 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5fa36-bcd1-4e20-abbf-06ce5e44cfb0 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:33.337101 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5fa36-bcd1-4e20-abbf-06ce5e44cfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:33.337387 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5fa36-bcd1-4e20-abbf-06ce5e44cfb0 admin admin] PATH_INFO: `/v3/users/e3ff52062c82425b80b88670349ead2c` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:33.338730 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5fa36-bcd1-4e20-abbf-06ce5e44cfb0 admin admin] RBAC: Authorizing `identity:get_user(user_id=e3ff52062c82425b80b88670349ead2c)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:33.341063 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5fa36-bcd1-4e20-abbf-06ce5e44cfb0 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:33.342712 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 101/204] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:33 2022] GET /identity/v3/users/e3ff52062c82425b80b88670349ead2c => generated 289 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:33.348390 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edfe15-2dd9-4743-ade0-6f615d8d36f3 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:33.358375 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edfe15-2dd9-4743-ade0-6f615d8d36f3 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:33.362846 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba734f3a-c260-4c90-8661-0f9257e4cc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:33.363506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba734f3a-c260-4c90-8661-0f9257e4cc80 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:33.363783 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba734f3a-c260-4c90-8661-0f9257e4cc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:33.364058 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba734f3a-c260-4c90-8661-0f9257e4cc80 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:33.372380 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba734f3a-c260-4c90-8661-0f9257e4cc80 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:33.374205 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba734f3a-c260-4c90-8661-0f9257e4cc80 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:33.383815 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 104/205] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:33.389548 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5fa36-bcd1-4e20-abbf-06ce5e44cfb0 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:33.400127 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5fa36-bcd1-4e20-abbf-06ce5e44cfb0 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:33.405214 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fca16b-a027-4760-ae49-781eb37e796f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:33.406129 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fca16b-a027-4760-ae49-781eb37e796f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:33.406415 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fca16b-a027-4760-ae49-781eb37e796f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:33.406693 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fca16b-a027-4760-ae49-781eb37e796f admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:33.407898 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fca16b-a027-4760-ae49-781eb37e796f admin admin] RBAC: Authorizing `identity:get_project(project_id=3e853ee55e324805acbbf0aff75277c3)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:33.410122 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fca16b-a027-4760-ae49-781eb37e796f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:33.411830 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 102/206] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:33 2022] GET /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:33.417727 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba734f3a-c260-4c90-8661-0f9257e4cc80 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:33.426927 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba734f3a-c260-4c90-8661-0f9257e4cc80 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:33.431619 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426dd20-5d59-4abb-bf75-86bfcb40f1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:33.432284 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426dd20-5d59-4abb-bf75-86bfcb40f1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:33.432565 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426dd20-5d59-4abb-bf75-86bfcb40f1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:33.432842 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426dd20-5d59-4abb-bf75-86bfcb40f1b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:33.433723 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426dd20-5d59-4abb-bf75-86bfcb40f1b0 admin admin] RBAC: Adding query filter params (role.id=4c8859f798ea45efab8e71b3dc25a52a, scope.project.id=3e853ee55e324805acbbf0aff75277c3, user.id=e3ff52062c82425b80b88670349ead2c) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:33.434033 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426dd20-5d59-4abb-bf75-86bfcb40f1b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:33.435910 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426dd20-5d59-4abb-bf75-86bfcb40f1b0 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:33.442498 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 105/207] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:37:33 2022] GET /identity/v3/role_assignments?user.id=e3ff52062c82425b80b88670349ead2c&scope.project.id=3e853ee55e324805acbbf0aff75277c3&role.id=4c8859f798ea45efab8e71b3dc25a52a => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:35.385496 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefd26a-75bb-4bea-bc97-791dd1100c0a None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.386560 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefd26a-75bb-4bea-bc97-791dd1100c0a None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.387033 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefd26a-75bb-4bea-bc97-791dd1100c0a None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:35.389481 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 103/208] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:35.395805 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468572e-5547-4a78-9ef9-a3a3d130649f None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.396335 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468572e-5547-4a78-9ef9-a3a3d130649f None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.396408 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468572e-5547-4a78-9ef9-a3a3d130649f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:35.415764 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-7468572e-5547-4a78-9ef9-a3a3d130649f None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:35.416985 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-7468572e-5547-4a78-9ef9-a3a3d130649f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:35.424748 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 106/209] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:35.448652 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefd26a-75bb-4bea-bc97-791dd1100c0a None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:35.461171 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefd26a-75bb-4bea-bc97-791dd1100c0a None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:35.465675 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408038a-2a43-4058-a423-3d172e7c9bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:35.466467 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408038a-2a43-4058-a423-3d172e7c9bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.466748 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408038a-2a43-4058-a423-3d172e7c9bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.467024 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408038a-2a43-4058-a423-3d172e7c9bc3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:35.478166 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408038a-2a43-4058-a423-3d172e7c9bc3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:35.485104 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-5408038a-2a43-4058-a423-3d172e7c9bc3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:37:35.486348 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 104/210] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:37:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:35.492217 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468572e-5547-4a78-9ef9-a3a3d130649f None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:35.501463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468572e-5547-4a78-9ef9-a3a3d130649f None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:35.505965 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21e31b-a194-4215-b4bb-6db8428e3ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:35.506642 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21e31b-a194-4215-b4bb-6db8428e3ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.506926 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21e31b-a194-4215-b4bb-6db8428e3ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.507211 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21e31b-a194-4215-b4bb-6db8428e3ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:35.507984 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21e31b-a194-4215-b4bb-6db8428e3ff2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:35.508293 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21e31b-a194-4215-b4bb-6db8428e3ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:35.509944 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21e31b-a194-4215-b4bb-6db8428e3ff2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:35.511666 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d6dae-5e39-4345-bd68-ffea0f6a7040 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.511952 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d6dae-5e39-4345-bd68-ffea0f6a7040 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.512229 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d6dae-5e39-4345-bd68-ffea0f6a7040 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:35.514044 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 105/211] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:37:35.518889 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 107/212] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:35.519214 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd93297-9c52-40f7-81f5-3b422791307c None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.519503 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd93297-9c52-40f7-81f5-3b422791307c None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.519782 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd93297-9c52-40f7-81f5-3b422791307c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:35.525018 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21e31b-a194-4215-b4bb-6db8428e3ff2 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:35.535000 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21e31b-a194-4215-b4bb-6db8428e3ff2 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:35.539624 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bbf51-8c25-469d-9cb8-42c4ecbb6825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:35.540494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bbf51-8c25-469d-9cb8-42c4ecbb6825 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.540772 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bbf51-8c25-469d-9cb8-42c4ecbb6825 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.541070 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bbf51-8c25-469d-9cb8-42c4ecbb6825 admin admin] PATH_INFO: `/v3/users/2332de8dcbe34ace9c320398d626c4c5` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:35.542272 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bbf51-8c25-469d-9cb8-42c4ecbb6825 admin admin] RBAC: Authorizing `identity:get_user(user_id=2332de8dcbe34ace9c320398d626c4c5)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:35.543439 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-abd93297-9c52-40f7-81f5-3b422791307c None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:35.544419 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bbf51-8c25-469d-9cb8-42c4ecbb6825 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:35.544626 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-abd93297-9c52-40f7-81f5-3b422791307c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:35.546231 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 108/213] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:35 2022] GET /identity/v3/users/2332de8dcbe34ace9c320398d626c4c5 => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:35.551490 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bbf51-8c25-469d-9cb8-42c4ecbb6825 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:35.553978 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 106/214] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:37:35.562077 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bbf51-8c25-469d-9cb8-42c4ecbb6825 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:35.566561 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6305186-5c4f-432c-b245-632938c78621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:35.567416 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6305186-5c4f-432c-b245-632938c78621 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.567695 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6305186-5c4f-432c-b245-632938c78621 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.567964 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6305186-5c4f-432c-b245-632938c78621 admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:35.569170 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6305186-5c4f-432c-b245-632938c78621 admin admin] RBAC: Authorizing `identity:get_project(project_id=f7f01e6ad70a496b8b8df89a6b770b4c)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:35.571250 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6305186-5c4f-432c-b245-632938c78621 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:35.572932 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 109/215] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:35 2022] GET /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:35.578483 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd93297-9c52-40f7-81f5-3b422791307c None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:35.580275 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6305186-5c4f-432c-b245-632938c78621 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:35.588690 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd93297-9c52-40f7-81f5-3b422791307c None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:35.589684 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6305186-5c4f-432c-b245-632938c78621 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:35.594011 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54492a8-bc70-49e2-81c8-c83770d74556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:35.594235 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a986147-9ff4-45c5-9cf4-164fb4adb5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:35.594796 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54492a8-bc70-49e2-81c8-c83770d74556 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.594952 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a986147-9ff4-45c5-9cf4-164fb4adb5a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.595089 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54492a8-bc70-49e2-81c8-c83770d74556 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.595232 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a986147-9ff4-45c5-9cf4-164fb4adb5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.595366 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54492a8-bc70-49e2-81c8-c83770d74556 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:35.595497 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a986147-9ff4-45c5-9cf4-164fb4adb5a1 admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c/users/2332de8dcbe34ace9c320398d626c4c5/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:35.597710 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a986147-9ff4-45c5-9cf4-164fb4adb5a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f01e6ad70a496b8b8df89a6b770b4c, user_id=2332de8dcbe34ace9c320398d626c4c5, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:35.600347 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a986147-9ff4-45c5-9cf4-164fb4adb5a1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:35.606174 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54492a8-bc70-49e2-81c8-c83770d74556 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:35.613539 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-c54492a8-bc70-49e2-81c8-c83770d74556 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 17:37:35.619643 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 110/216] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:37:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:35.619769 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 107/217] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:37:35 2022] PUT /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c/users/2332de8dcbe34ace9c320398d626c4c5/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:37:35.621882 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54492a8-bc70-49e2-81c8-c83770d74556 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:35.633906 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54492a8-bc70-49e2-81c8-c83770d74556 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:35.676526 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1e506-84dc-4a48-b977-4254d0021b10 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.676810 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1e506-84dc-4a48-b977-4254d0021b10 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.677059 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1e506-84dc-4a48-b977-4254d0021b10 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:35.678933 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 108/218] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:35.686489 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dff97e-52f1-4b41-895e-ba0897b70a1e None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.687403 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dff97e-52f1-4b41-895e-ba0897b70a1e None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.687919 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dff97e-52f1-4b41-895e-ba0897b70a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:35.700597 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb0c1c-3d0b-4fab-8aa6-fad83b425b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:35.701334 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb0c1c-3d0b-4fab-8aa6-fad83b425b0d admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.701617 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb0c1c-3d0b-4fab-8aa6-fad83b425b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.701894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb0c1c-3d0b-4fab-8aa6-fad83b425b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:35.702683 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb0c1c-3d0b-4fab-8aa6-fad83b425b0d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:35.702992 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb0c1c-3d0b-4fab-8aa6-fad83b425b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:35.705558 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb0c1c-3d0b-4fab-8aa6-fad83b425b0d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:35.711593 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-85dff97e-52f1-4b41-895e-ba0897b70a1e None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:35.713165 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-85dff97e-52f1-4b41-895e-ba0897b70a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:35.721814 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 111/219] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:37:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:35.723514 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 109/220] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:37:35.736932 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb0c1c-3d0b-4fab-8aa6-fad83b425b0d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:35.749754 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb0c1c-3d0b-4fab-8aa6-fad83b425b0d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:35.755671 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dff97e-52f1-4b41-895e-ba0897b70a1e None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:35.758759 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05fc73-9b09-47a9-98af-611b189244f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:35.760545 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05fc73-9b09-47a9-98af-611b189244f8 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.761121 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05fc73-9b09-47a9-98af-611b189244f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.761538 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05fc73-9b09-47a9-98af-611b189244f8 admin admin] PATH_INFO: `/v3/users/2332de8dcbe34ace9c320398d626c4c5` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:35.764207 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05fc73-9b09-47a9-98af-611b189244f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=2332de8dcbe34ace9c320398d626c4c5)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:35.766318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dff97e-52f1-4b41-895e-ba0897b70a1e None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:35.769284 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05fc73-9b09-47a9-98af-611b189244f8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:35.771374 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b2450-e231-4cfa-9db7-5e3546d94841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:35.772418 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b2450-e231-4cfa-9db7-5e3546d94841 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.772872 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b2450-e231-4cfa-9db7-5e3546d94841 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.773414 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 112/221] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:35 2022] GET /identity/v3/users/2332de8dcbe34ace9c320398d626c4c5 => generated 283 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:35.776896 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b2450-e231-4cfa-9db7-5e3546d94841 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:35.780973 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05fc73-9b09-47a9-98af-611b189244f8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:35.790967 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b2450-e231-4cfa-9db7-5e3546d94841 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:35.793709 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05fc73-9b09-47a9-98af-611b189244f8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:35.798300 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0560cc9-f1fc-4ffc-94ab-7c56ce897e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:35.799188 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0560cc9-f1fc-4ffc-94ab-7c56ce897e20 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.799476 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0560cc9-f1fc-4ffc-94ab-7c56ce897e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.799770 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0560cc9-f1fc-4ffc-94ab-7c56ce897e20 admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:35.801004 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-8a7b2450-e231-4cfa-9db7-5e3546d94841 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 17:37:35.801323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0560cc9-f1fc-4ffc-94ab-7c56ce897e20 admin admin] RBAC: Authorizing `identity:get_project(project_id=f7f01e6ad70a496b8b8df89a6b770b4c)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:35.807618 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0560cc9-f1fc-4ffc-94ab-7c56ce897e20 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:35.807618 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 113/223] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:35 2022] GET /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:35.808334 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 110/223] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:35.813653 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0560cc9-f1fc-4ffc-94ab-7c56ce897e20 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:35.814137 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b2450-e231-4cfa-9db7-5e3546d94841 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:35.824962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0560cc9-f1fc-4ffc-94ab-7c56ce897e20 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:35.826916 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b2450-e231-4cfa-9db7-5e3546d94841 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:35.829844 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0836a2a-d106-4842-a22c-5e94afe2f3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:35.830547 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0836a2a-d106-4842-a22c-5e94afe2f3cf admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.830834 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0836a2a-d106-4842-a22c-5e94afe2f3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.831145 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0836a2a-d106-4842-a22c-5e94afe2f3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:35.832201 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0836a2a-d106-4842-a22c-5e94afe2f3cf admin admin] RBAC: Adding query filter params (name=member) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:35.832512 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0836a2a-d106-4842-a22c-5e94afe2f3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:35.833576 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557ca88-6fc1-46a7-be3f-0b8893f1975f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:35.834238 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0836a2a-d106-4842-a22c-5e94afe2f3cf admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:35.834958 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557ca88-6fc1-46a7-be3f-0b8893f1975f admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.835502 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557ca88-6fc1-46a7-be3f-0b8893f1975f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.836251 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557ca88-6fc1-46a7-be3f-0b8893f1975f admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c/users/2332de8dcbe34ace9c320398d626c4c5/roles/112bab30f846403ea40d96a74a04af2c` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:35.839381 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557ca88-6fc1-46a7-be3f-0b8893f1975f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f01e6ad70a496b8b8df89a6b770b4c, user_id=2332de8dcbe34ace9c320398d626c4c5, role_id=112bab30f846403ea40d96a74a04af2c)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:35.847992 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 114/224] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:35.848199 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557ca88-6fc1-46a7-be3f-0b8893f1975f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:35.854349 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0836a2a-d106-4842-a22c-5e94afe2f3cf admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:35.863840 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 111/225] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:37:35 2022] PUT /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c/users/2332de8dcbe34ace9c320398d626c4c5/roles/112bab30f846403ea40d96a74a04af2c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:37:35.865677 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83d2ea-7827-438a-bed2-a7c25e255358 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.865976 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83d2ea-7827-438a-bed2-a7c25e255358 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.866256 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83d2ea-7827-438a-bed2-a7c25e255358 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:35.868494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0836a2a-d106-4842-a22c-5e94afe2f3cf admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:35.869039 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 112/226] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:35.875295 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f1f27-0211-4171-b41e-0516d3c72785 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.875577 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f1f27-0211-4171-b41e-0516d3c72785 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.875888 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f1f27-0211-4171-b41e-0516d3c72785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:35.901053 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-275f1f27-0211-4171-b41e-0516d3c72785 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:35.902287 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-275f1f27-0211-4171-b41e-0516d3c72785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:35.935774 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded7a22-1e89-46d3-8575-85b7fc9aa8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:35.937245 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded7a22-1e89-46d3-8575-85b7fc9aa8be admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.938363 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded7a22-1e89-46d3-8575-85b7fc9aa8be admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.938892 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded7a22-1e89-46d3-8575-85b7fc9aa8be admin admin] PATH_INFO: `/v3/users/25d23c6069ff4f7ebece04b14fcbfe23` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:35.957374 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded7a22-1e89-46d3-8575-85b7fc9aa8be admin admin] RBAC: Authorizing `identity:get_user(user_id=25d23c6069ff4f7ebece04b14fcbfe23)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:35.960629 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded7a22-1e89-46d3-8575-85b7fc9aa8be admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:35.967902 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 115/227] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:35 2022] GET /identity/v3/users/25d23c6069ff4f7ebece04b14fcbfe23 => generated 297 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:35.970440 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded7a22-1e89-46d3-8575-85b7fc9aa8be admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:35.984172 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded7a22-1e89-46d3-8575-85b7fc9aa8be admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:35.989184 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b67357-2fee-4c07-8973-286f2d0c5bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:35.989704 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 113/228] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:35.990486 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b67357-2fee-4c07-8973-286f2d0c5bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:35.990973 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b67357-2fee-4c07-8973-286f2d0c5bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:35.991364 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b67357-2fee-4c07-8973-286f2d0c5bc3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:36.000431 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b67357-2fee-4c07-8973-286f2d0c5bc3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:36.002508 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b67357-2fee-4c07-8973-286f2d0c5bc3 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:36.016977 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 116/229] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:36.018901 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f1f27-0211-4171-b41e-0516d3c72785 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:36.019922 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b67357-2fee-4c07-8973-286f2d0c5bc3 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:36.029295 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f1f27-0211-4171-b41e-0516d3c72785 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:36.030815 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b67357-2fee-4c07-8973-286f2d0c5bc3 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:36.034363 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9d0fe-e3eb-450e-b8a4-89cca92e2f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:36.035371 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9d0fe-e3eb-450e-b8a4-89cca92e2f0b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:36.035893 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9d0fe-e3eb-450e-b8a4-89cca92e2f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:36.036259 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9d0fe-e3eb-450e-b8a4-89cca92e2f0b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:36.036492 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef227b-9d79-4948-866f-d0b76c43c4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:36.037661 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef227b-9d79-4948-866f-d0b76c43c4aa admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:36.037884 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9d0fe-e3eb-450e-b8a4-89cca92e2f0b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:36.038221 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef227b-9d79-4948-866f-d0b76c43c4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:36.038626 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef227b-9d79-4948-866f-d0b76c43c4aa admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:36.040084 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef227b-9d79-4948-866f-d0b76c43c4aa admin admin] RBAC: Authorizing `identity:get_project(project_id=f7f01e6ad70a496b8b8df89a6b770b4c)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:36.040285 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9d0fe-e3eb-450e-b8a4-89cca92e2f0b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:36.042495 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 114/230] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:37:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:36.043072 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef227b-9d79-4948-866f-d0b76c43c4aa admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:36.045200 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 117/231] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:36 2022] GET /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:36.051355 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9d0fe-e3eb-450e-b8a4-89cca92e2f0b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:36.053221 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef227b-9d79-4948-866f-d0b76c43c4aa admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:36.059225 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9d0fe-e3eb-450e-b8a4-89cca92e2f0b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:36.064440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2965ae-4ed3-49c9-adc8-a3fa0036233f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:36.065323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef227b-9d79-4948-866f-d0b76c43c4aa admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:36.065437 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2965ae-4ed3-49c9-adc8-a3fa0036233f admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:36.065807 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2965ae-4ed3-49c9-adc8-a3fa0036233f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:36.066210 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2965ae-4ed3-49c9-adc8-a3fa0036233f admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:36.067043 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2965ae-4ed3-49c9-adc8-a3fa0036233f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:36.069606 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2965ae-4ed3-49c9-adc8-a3fa0036233f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:36.070674 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f0b3c-2031-4dc2-93ab-ba52d1be4775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:36.071613 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f0b3c-2031-4dc2-93ab-ba52d1be4775 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:36.072024 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f0b3c-2031-4dc2-93ab-ba52d1be4775 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:36.072427 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f0b3c-2031-4dc2-93ab-ba52d1be4775 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:36.073444 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f0b3c-2031-4dc2-93ab-ba52d1be4775 admin admin] RBAC: Adding query filter params (role.id=3c8f0c77d36b49608a0e17cfcff15691, scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c, user.id=25d23c6069ff4f7ebece04b14fcbfe23) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:36.073885 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f0b3c-2031-4dc2-93ab-ba52d1be4775 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:36.075898 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f0b3c-2031-4dc2-93ab-ba52d1be4775 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:36.084034 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 118/232] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:37:36 2022] GET /identity/v3/role_assignments?user.id=25d23c6069ff4f7ebece04b14fcbfe23&scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c&role.id=3c8f0c77d36b49608a0e17cfcff15691 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:36.097190 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 115/233] 10.222.0.31 () {60 vars in 1153 bytes} [Mon Jan 10 17:37:36 2022] POST /identity/v3/users => generated 297 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:37:38.464837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc69fc-9369-4729-a49f-810e92512c60 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:38.465409 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc69fc-9369-4729-a49f-810e92512c60 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:38.465409 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc69fc-9369-4729-a49f-810e92512c60 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:38.467378 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 119/234] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:38.472708 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1687ec-67f4-4ea1-b341-60391bb9c593 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:38.473135 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1687ec-67f4-4ea1-b341-60391bb9c593 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:38.473317 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1687ec-67f4-4ea1-b341-60391bb9c593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:38.491265 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-ef1687ec-67f4-4ea1-b341-60391bb9c593 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:38.492425 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-ef1687ec-67f4-4ea1-b341-60391bb9c593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:38.501134 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 116/235] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:37:38.530024 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc69fc-9369-4729-a49f-810e92512c60 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:38.549802 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc69fc-9369-4729-a49f-810e92512c60 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:38.554634 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9974fb3-495f-4db2-88c4-4f2e548fba74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:38.555655 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9974fb3-495f-4db2-88c4-4f2e548fba74 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:38.556128 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9974fb3-495f-4db2-88c4-4f2e548fba74 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:38.556596 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9974fb3-495f-4db2-88c4-4f2e548fba74 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:38.577945 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9974fb3-495f-4db2-88c4-4f2e548fba74 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:38.585210 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-d9974fb3-495f-4db2-88c4-4f2e548fba74 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:37:38.586976 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 120/236] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:37:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:38.592432 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1687ec-67f4-4ea1-b341-60391bb9c593 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:38.601573 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1687ec-67f4-4ea1-b341-60391bb9c593 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:38.614022 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27df85-5fdd-47da-b53b-8ff7e63158d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:38.614686 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27df85-5fdd-47da-b53b-8ff7e63158d3 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:38.614963 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27df85-5fdd-47da-b53b-8ff7e63158d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:38.615235 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27df85-5fdd-47da-b53b-8ff7e63158d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:38.616004 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27df85-5fdd-47da-b53b-8ff7e63158d3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:38.616305 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27df85-5fdd-47da-b53b-8ff7e63158d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:38.617924 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27df85-5fdd-47da-b53b-8ff7e63158d3 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:38.632740 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 117/237] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:38.638006 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9974fb3-495f-4db2-88c4-4f2e548fba74 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:38.654343 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9974fb3-495f-4db2-88c4-4f2e548fba74 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:38.663821 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1338cb-13a0-46ae-b9d4-6de6bd1ab517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:38.664973 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1338cb-13a0-46ae-b9d4-6de6bd1ab517 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:38.665454 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1338cb-13a0-46ae-b9d4-6de6bd1ab517 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:38.665921 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1338cb-13a0-46ae-b9d4-6de6bd1ab517 admin admin] PATH_INFO: `/v3/users/2332de8dcbe34ace9c320398d626c4c5` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:38.671077 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1338cb-13a0-46ae-b9d4-6de6bd1ab517 admin admin] RBAC: Authorizing `identity:get_user(user_id=2332de8dcbe34ace9c320398d626c4c5)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:38.673553 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1338cb-13a0-46ae-b9d4-6de6bd1ab517 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:38.675454 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 121/238] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:38 2022] GET /identity/v3/users/2332de8dcbe34ace9c320398d626c4c5 => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:38.681158 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27df85-5fdd-47da-b53b-8ff7e63158d3 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:38.694067 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27df85-5fdd-47da-b53b-8ff7e63158d3 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:38.704495 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ab53c-b239-4b27-929d-7b3f1e3da906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:38.705175 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ab53c-b239-4b27-929d-7b3f1e3da906 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:38.705453 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ab53c-b239-4b27-929d-7b3f1e3da906 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:38.705725 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ab53c-b239-4b27-929d-7b3f1e3da906 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:38.714639 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ab53c-b239-4b27-929d-7b3f1e3da906 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:38.716934 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ab53c-b239-4b27-929d-7b3f1e3da906 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:38.726409 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 118/239] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:38.731898 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1338cb-13a0-46ae-b9d4-6de6bd1ab517 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:38.743662 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1338cb-13a0-46ae-b9d4-6de6bd1ab517 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:38.759177 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c9859-1d69-4f6c-ac0a-8f4eca2d018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:38.760059 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c9859-1d69-4f6c-ac0a-8f4eca2d018e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:38.760338 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c9859-1d69-4f6c-ac0a-8f4eca2d018e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:38.760611 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c9859-1d69-4f6c-ac0a-8f4eca2d018e admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:38.762719 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c9859-1d69-4f6c-ac0a-8f4eca2d018e admin admin] RBAC: Authorizing `identity:get_project(project_id=f7f01e6ad70a496b8b8df89a6b770b4c)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:38.764320 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fa1d9-8447-44a3-9280-56717f296544 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:38.764830 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fa1d9-8447-44a3-9280-56717f296544 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:38.764948 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c9859-1d69-4f6c-ac0a-8f4eca2d018e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:38.765402 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fa1d9-8447-44a3-9280-56717f296544 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:38.766884 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 122/240] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:38 2022] GET /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:38.768046 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 119/241] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:37:38.773785 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b84bc-0b25-4559-add5-d7eb5f33424b None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:38.774254 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b84bc-0b25-4559-add5-d7eb5f33424b None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:38.774380 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fa1d9-8447-44a3-9280-56717f296544 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:38.774784 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b84bc-0b25-4559-add5-d7eb5f33424b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:38.798436 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fa1d9-8447-44a3-9280-56717f296544 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:38.806211 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e910e-7a98-4fb9-a3cd-c5dca78ec300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:38.806864 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e910e-7a98-4fb9-a3cd-c5dca78ec300 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:38.807143 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e910e-7a98-4fb9-a3cd-c5dca78ec300 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:38.807416 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e910e-7a98-4fb9-a3cd-c5dca78ec300 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:38.808255 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e910e-7a98-4fb9-a3cd-c5dca78ec300 admin admin] RBAC: Adding query filter params (role.id=3c05bedf79e04eb38d2ae66736030bfe, scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c, user.id=2332de8dcbe34ace9c320398d626c4c5) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:38.808560 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e910e-7a98-4fb9-a3cd-c5dca78ec300 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:38.810429 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e910e-7a98-4fb9-a3cd-c5dca78ec300 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:38.811026 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b69b84bc-0b25-4559-add5-d7eb5f33424b None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:38.812222 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b69b84bc-0b25-4559-add5-d7eb5f33424b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:38.817219 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 120/242] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:37:38 2022] GET /identity/v3/role_assignments?user.id=2332de8dcbe34ace9c320398d626c4c5&scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c&role.id=3c05bedf79e04eb38d2ae66736030bfe => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:38.824522 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 123/243] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:38.862074 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e910e-7a98-4fb9-a3cd-c5dca78ec300 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:38.872739 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e910e-7a98-4fb9-a3cd-c5dca78ec300 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:38.881779 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852410a-f0a3-44b7-aadd-cdece778731a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:38.882651 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852410a-f0a3-44b7-aadd-cdece778731a admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:38.882931 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852410a-f0a3-44b7-aadd-cdece778731a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:38.883211 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852410a-f0a3-44b7-aadd-cdece778731a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:38.900056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852410a-f0a3-44b7-aadd-cdece778731a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:38.907381 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-6852410a-f0a3-44b7-aadd-cdece778731a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 17:37:38.908831 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 121/244] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:37:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:38.914461 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b84bc-0b25-4559-add5-d7eb5f33424b None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:38.930636 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b84bc-0b25-4559-add5-d7eb5f33424b None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:38.941465 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4a35d-78fa-4b86-b2a7-d42bf7df4769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:38.942534 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4a35d-78fa-4b86-b2a7-d42bf7df4769 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:38.943074 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4a35d-78fa-4b86-b2a7-d42bf7df4769 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:38.943555 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4a35d-78fa-4b86-b2a7-d42bf7df4769 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:38.944569 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4a35d-78fa-4b86-b2a7-d42bf7df4769 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:38.945106 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4a35d-78fa-4b86-b2a7-d42bf7df4769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:38.946981 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4a35d-78fa-4b86-b2a7-d42bf7df4769 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:38.962434 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 124/245] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:37:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:38.967803 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852410a-f0a3-44b7-aadd-cdece778731a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:38.983119 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852410a-f0a3-44b7-aadd-cdece778731a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:38.986017 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cc16b-c705-4c2d-af87-d5b577274074 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:38.986523 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cc16b-c705-4c2d-af87-d5b577274074 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:38.987036 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cc16b-c705-4c2d-af87-d5b577274074 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:38.989216 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 125/246] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:38.991991 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a11cf-7f4e-47e6-b62a-646d09ed7ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:38.992874 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a11cf-7f4e-47e6-b62a-646d09ed7ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:38.993160 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a11cf-7f4e-47e6-b62a-646d09ed7ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:38.993431 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a11cf-7f4e-47e6-b62a-646d09ed7ba0 admin admin] PATH_INFO: `/v3/users/2332de8dcbe34ace9c320398d626c4c5` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:38.994935 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a11cf-7f4e-47e6-b62a-646d09ed7ba0 admin admin] RBAC: Authorizing `identity:get_user(user_id=2332de8dcbe34ace9c320398d626c4c5)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:38.995913 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe73ca-5a19-41ef-903a-6062c05a129a None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:38.996472 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe73ca-5a19-41ef-903a-6062c05a129a None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:38.996970 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe73ca-5a19-41ef-903a-6062c05a129a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:38.997069 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a11cf-7f4e-47e6-b62a-646d09ed7ba0 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:38.998980 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 122/247] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:38 2022] GET /identity/v3/users/2332de8dcbe34ace9c320398d626c4c5 => generated 283 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:39.004181 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a11cf-7f4e-47e6-b62a-646d09ed7ba0 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:39.013812 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a11cf-7f4e-47e6-b62a-646d09ed7ba0 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:39.017534 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-f8fe73ca-5a19-41ef-903a-6062c05a129a None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:39.019104 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-f8fe73ca-5a19-41ef-903a-6062c05a129a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:39.026984 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e738f-1296-44cc-8570-9f21ca0dcb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:39.027643 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e738f-1296-44cc-8570-9f21ca0dcb30 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:39.027921 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e738f-1296-44cc-8570-9f21ca0dcb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:39.028193 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e738f-1296-44cc-8570-9f21ca0dcb30 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:39.028944 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 126/248] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:37:39.049086 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e738f-1296-44cc-8570-9f21ca0dcb30 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:39.051401 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e738f-1296-44cc-8570-9f21ca0dcb30 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:39.064116 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 123/249] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:39.069499 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe73ca-5a19-41ef-903a-6062c05a129a None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:39.080059 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe73ca-5a19-41ef-903a-6062c05a129a None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:39.089233 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8ae1e-236c-43c3-9951-37d060a2c78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:39.090486 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8ae1e-236c-43c3-9951-37d060a2c78e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:39.090987 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8ae1e-236c-43c3-9951-37d060a2c78e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:39.091455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8ae1e-236c-43c3-9951-37d060a2c78e admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:39.093531 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8ae1e-236c-43c3-9951-37d060a2c78e admin admin] RBAC: Authorizing `identity:get_project(project_id=f7f01e6ad70a496b8b8df89a6b770b4c)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:39.095990 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8ae1e-236c-43c3-9951-37d060a2c78e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:39.099094 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 127/250] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:39 2022] GET /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:39.104075 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e738f-1296-44cc-8570-9f21ca0dcb30 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:39.116367 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e738f-1296-44cc-8570-9f21ca0dcb30 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:39.121981 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8ae1e-236c-43c3-9951-37d060a2c78e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:39.128729 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c4290-42f2-4872-9a40-358724101548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:39.129913 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c4290-42f2-4872-9a40-358724101548 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:39.132453 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c4290-42f2-4872-9a40-358724101548 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:39.133100 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c4290-42f2-4872-9a40-358724101548 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:39.134163 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c4290-42f2-4872-9a40-358724101548 admin admin] RBAC: Adding query filter params (role.id=112bab30f846403ea40d96a74a04af2c, scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c, user.id=2332de8dcbe34ace9c320398d626c4c5) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:39.136584 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c4290-42f2-4872-9a40-358724101548 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:39.140888 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c4290-42f2-4872-9a40-358724101548 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:39.143258 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8ae1e-236c-43c3-9951-37d060a2c78e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:39.149126 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 124/251] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:37:39 2022] GET /identity/v3/role_assignments?user.id=2332de8dcbe34ace9c320398d626c4c5&scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c&role.id=112bab30f846403ea40d96a74a04af2c => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:39.150379 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbbce4-e36e-4d85-84ef-a9347dd2b57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:39.151334 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbbce4-e36e-4d85-84ef-a9347dd2b57e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:39.151617 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbbce4-e36e-4d85-84ef-a9347dd2b57e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:39.151888 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbbce4-e36e-4d85-84ef-a9347dd2b57e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:39.168136 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbbce4-e36e-4d85-84ef-a9347dd2b57e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:39.175543 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-f5dbbce4-e36e-4d85-84ef-a9347dd2b57e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 17:37:39.180883 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 128/252] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:39.183245 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c4290-42f2-4872-9a40-358724101548 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:39.194548 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c4290-42f2-4872-9a40-358724101548 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:39.199595 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae4fbd-45b9-47eb-a259-e96501150425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:39.200565 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae4fbd-45b9-47eb-a259-e96501150425 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:39.201040 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae4fbd-45b9-47eb-a259-e96501150425 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:39.201464 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae4fbd-45b9-47eb-a259-e96501150425 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:39.202420 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae4fbd-45b9-47eb-a259-e96501150425 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:39.202855 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae4fbd-45b9-47eb-a259-e96501150425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:39.204634 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae4fbd-45b9-47eb-a259-e96501150425 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:39.214755 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 125/253] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:39.220974 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbbce4-e36e-4d85-84ef-a9347dd2b57e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:39.232039 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbbce4-e36e-4d85-84ef-a9347dd2b57e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:39.237033 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b0647-95e3-4c73-9b59-1e5c0f211fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:39.238191 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b0647-95e3-4c73-9b59-1e5c0f211fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:39.238642 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b0647-95e3-4c73-9b59-1e5c0f211fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:39.239070 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b0647-95e3-4c73-9b59-1e5c0f211fe8 admin admin] PATH_INFO: `/v3/users/25d23c6069ff4f7ebece04b14fcbfe23` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:39.240624 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b0647-95e3-4c73-9b59-1e5c0f211fe8 admin admin] RBAC: Authorizing `identity:get_user(user_id=25d23c6069ff4f7ebece04b14fcbfe23)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:39.243018 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b0647-95e3-4c73-9b59-1e5c0f211fe8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:39.245374 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 129/254] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:39 2022] GET /identity/v3/users/25d23c6069ff4f7ebece04b14fcbfe23 => generated 297 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:39.251389 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae4fbd-45b9-47eb-a259-e96501150425 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:39.262397 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae4fbd-45b9-47eb-a259-e96501150425 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:39.267502 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec89236-fda7-4118-9a09-7f2c5cee5f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:39.268721 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec89236-fda7-4118-9a09-7f2c5cee5f3b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:39.269216 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec89236-fda7-4118-9a09-7f2c5cee5f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:39.269631 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec89236-fda7-4118-9a09-7f2c5cee5f3b admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:39.271258 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec89236-fda7-4118-9a09-7f2c5cee5f3b admin admin] RBAC: Authorizing `identity:get_project(project_id=f7f01e6ad70a496b8b8df89a6b770b4c)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:39.273946 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec89236-fda7-4118-9a09-7f2c5cee5f3b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:39.276339 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 126/255] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:39 2022] GET /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:39.282213 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b0647-95e3-4c73-9b59-1e5c0f211fe8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:39.293256 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b0647-95e3-4c73-9b59-1e5c0f211fe8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:39.297520 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e0763-ceca-472a-9ebf-e85d13dcfb10 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:39.298005 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e0763-ceca-472a-9ebf-e85d13dcfb10 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:39.298454 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e0763-ceca-472a-9ebf-e85d13dcfb10 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:39.299869 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35329896-14c7-447d-be09-5cb75df5fdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:39.300743 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 127/256] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:37:39.301415 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35329896-14c7-447d-be09-5cb75df5fdde admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:39.301703 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35329896-14c7-447d-be09-5cb75df5fdde admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:39.301976 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35329896-14c7-447d-be09-5cb75df5fdde admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c/users/25d23c6069ff4f7ebece04b14fcbfe23/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:39.308156 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35329896-14c7-447d-be09-5cb75df5fdde admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f01e6ad70a496b8b8df89a6b770b4c, user_id=25d23c6069ff4f7ebece04b14fcbfe23, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:39.310828 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2714cc-f042-480e-9441-beb032d22388 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:39.311379 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35329896-14c7-447d-be09-5cb75df5fdde admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:39.311634 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2714cc-f042-480e-9441-beb032d22388 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:39.312124 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2714cc-f042-480e-9441-beb032d22388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:39.330238 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 130/257] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:37:39 2022] PUT /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c/users/25d23c6069ff4f7ebece04b14fcbfe23/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:37:39.338153 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-6a2714cc-f042-480e-9441-beb032d22388 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:39.339378 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-6a2714cc-f042-480e-9441-beb032d22388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:39.351766 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2b829-6f13-4711-8ea8-eec69935f9f3 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:39.352420 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2b829-6f13-4711-8ea8-eec69935f9f3 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:39.352941 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2b829-6f13-4711-8ea8-eec69935f9f3 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:39.355889 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 131/258] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:39.361191 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf774fb-a91d-4f59-85de-e1453de101e6 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:39.361833 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf774fb-a91d-4f59-85de-e1453de101e6 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:39.362311 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf774fb-a91d-4f59-85de-e1453de101e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:39.383812 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-caf774fb-a91d-4f59-85de-e1453de101e6 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:39.386968 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-caf774fb-a91d-4f59-85de-e1453de101e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:39.420065 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 128/259] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:37:39.446111 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2714cc-f042-480e-9441-beb032d22388 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:39.455849 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2714cc-f042-480e-9441-beb032d22388 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:39.461683 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 132/260] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:39.468297 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9b6c8-7bf0-4ff5-b0c7-7aabe53ba1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:39.469234 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9b6c8-7bf0-4ff5-b0c7-7aabe53ba1eb admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:39.469582 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9b6c8-7bf0-4ff5-b0c7-7aabe53ba1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:39.469914 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9b6c8-7bf0-4ff5-b0c7-7aabe53ba1eb admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:39.482048 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9b6c8-7bf0-4ff5-b0c7-7aabe53ba1eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:39.488428 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf774fb-a91d-4f59-85de-e1453de101e6 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:39.491449 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-c6f9b6c8-7bf0-4ff5-b0c7-7aabe53ba1eb admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 17:37:39.492734 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 129/261] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:39.498526 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf774fb-a91d-4f59-85de-e1453de101e6 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:39.498918 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9b6c8-7bf0-4ff5-b0c7-7aabe53ba1eb admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:39.503458 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4abf04-c27e-458a-ac1a-9ec5df3bda0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:39.504525 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4abf04-c27e-458a-ac1a-9ec5df3bda0d admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:39.505026 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4abf04-c27e-458a-ac1a-9ec5df3bda0d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:39.505443 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4abf04-c27e-458a-ac1a-9ec5df3bda0d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:39.508961 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4abf04-c27e-458a-ac1a-9ec5df3bda0d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:39.509107 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4abf04-c27e-458a-ac1a-9ec5df3bda0d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:39.510091 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9b6c8-7bf0-4ff5-b0c7-7aabe53ba1eb admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:39.510867 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 133/262] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:37:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:39.515666 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bea05-a51c-463e-aec4-ff08a901d7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:39.516792 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4abf04-c27e-458a-ac1a-9ec5df3bda0d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:39.517808 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bea05-a51c-463e-aec4-ff08a901d7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:39.518083 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bea05-a51c-463e-aec4-ff08a901d7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:39.518344 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bea05-a51c-463e-aec4-ff08a901d7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:39.519181 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bea05-a51c-463e-aec4-ff08a901d7f5 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:39.519488 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bea05-a51c-463e-aec4-ff08a901d7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:39.521180 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bea05-a51c-463e-aec4-ff08a901d7f5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:39.532092 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4abf04-c27e-458a-ac1a-9ec5df3bda0d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:39.536306 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 130/263] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:39.537551 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70797aa0-2394-4d9a-9a5c-3352b1856061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:39.537861 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70797aa0-2394-4d9a-9a5c-3352b1856061 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:39.538290 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70797aa0-2394-4d9a-9a5c-3352b1856061 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:39.538657 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70797aa0-2394-4d9a-9a5c-3352b1856061 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:39.539503 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70797aa0-2394-4d9a-9a5c-3352b1856061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:39.541630 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70797aa0-2394-4d9a-9a5c-3352b1856061 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:39.542794 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bea05-a51c-463e-aec4-ff08a901d7f5 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:39.558727 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bea05-a51c-463e-aec4-ff08a901d7f5 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:39.563617 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e349519-7637-4e7f-ac2e-4b170d5f7336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:39.564674 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e349519-7637-4e7f-ac2e-4b170d5f7336 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:39.565118 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e349519-7637-4e7f-ac2e-4b170d5f7336 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:39.565562 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e349519-7637-4e7f-ac2e-4b170d5f7336 admin admin] PATH_INFO: `/v3/users/93d32c1f3d374e54bd0a6bf7495ab2d7` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:39.570382 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 134/264] 10.222.0.31 () {60 vars in 1153 bytes} [Mon Jan 10 17:37:39 2022] POST /identity/v3/users => generated 293 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:37:39.581348 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e349519-7637-4e7f-ac2e-4b170d5f7336 admin admin] RBAC: Authorizing `identity:get_user(user_id=93d32c1f3d374e54bd0a6bf7495ab2d7)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:39.583785 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e349519-7637-4e7f-ac2e-4b170d5f7336 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:39.586001 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 131/265] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:39 2022] GET /identity/v3/users/93d32c1f3d374e54bd0a6bf7495ab2d7 => generated 297 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:39.592352 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70797aa0-2394-4d9a-9a5c-3352b1856061 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:39.602915 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70797aa0-2394-4d9a-9a5c-3352b1856061 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:39.607716 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc337df-0167-4c8c-8e9c-7663d9ef8d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:39.608553 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc337df-0167-4c8c-8e9c-7663d9ef8d0e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:39.608975 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc337df-0167-4c8c-8e9c-7663d9ef8d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:39.609342 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc337df-0167-4c8c-8e9c-7663d9ef8d0e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:39.619389 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc337df-0167-4c8c-8e9c-7663d9ef8d0e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:39.621395 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc337df-0167-4c8c-8e9c-7663d9ef8d0e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:39.631273 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 135/266] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:39.637178 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e349519-7637-4e7f-ac2e-4b170d5f7336 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:39.650214 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e349519-7637-4e7f-ac2e-4b170d5f7336 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:39.654792 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6071617-7b3d-4327-ba31-034a2fd3f0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:39.655783 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6071617-7b3d-4327-ba31-034a2fd3f0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:39.656167 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6071617-7b3d-4327-ba31-034a2fd3f0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:39.656546 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6071617-7b3d-4327-ba31-034a2fd3f0a1 admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:39.657956 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6071617-7b3d-4327-ba31-034a2fd3f0a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=f7f01e6ad70a496b8b8df89a6b770b4c)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:39.660180 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6071617-7b3d-4327-ba31-034a2fd3f0a1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:39.662377 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 132/267] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:39 2022] GET /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:39.668700 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc337df-0167-4c8c-8e9c-7663d9ef8d0e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:39.678100 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc337df-0167-4c8c-8e9c-7663d9ef8d0e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:39.682602 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823b522-d364-4753-942c-6445f87e0d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:39.683358 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823b522-d364-4753-942c-6445f87e0d97 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:39.683700 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823b522-d364-4753-942c-6445f87e0d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:39.684033 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823b522-d364-4753-942c-6445f87e0d97 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:39.684993 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823b522-d364-4753-942c-6445f87e0d97 admin admin] RBAC: Adding query filter params (role.id=4c8859f798ea45efab8e71b3dc25a52a, scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c, user.id=93d32c1f3d374e54bd0a6bf7495ab2d7) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:39.685363 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823b522-d364-4753-942c-6445f87e0d97 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:39.687300 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823b522-d364-4753-942c-6445f87e0d97 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:39.693500 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 136/268] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:37:39 2022] GET /identity/v3/role_assignments?user.id=93d32c1f3d374e54bd0a6bf7495ab2d7&scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c&role.id=4c8859f798ea45efab8e71b3dc25a52a => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:41.782656 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c02acf-7604-426a-988e-c8fddbe572a4 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:41.783171 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c02acf-7604-426a-988e-c8fddbe572a4 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:41.783171 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c02acf-7604-426a-988e-c8fddbe572a4 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:41.785094 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 133/269] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:41.790349 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ed6ff-b751-4b58-98a5-3e876c1a6dcd None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:41.790782 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ed6ff-b751-4b58-98a5-3e876c1a6dcd None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:41.790953 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ed6ff-b751-4b58-98a5-3e876c1a6dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:41.808605 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-742ed6ff-b751-4b58-98a5-3e876c1a6dcd None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:41.809830 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-742ed6ff-b751-4b58-98a5-3e876c1a6dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:41.817642 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 137/270] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:37:41.842101 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c02acf-7604-426a-988e-c8fddbe572a4 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:41.854231 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c02acf-7604-426a-988e-c8fddbe572a4 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:41.858534 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed6fe8-4645-4106-9b49-be3baaba59b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:41.859320 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed6fe8-4645-4106-9b49-be3baaba59b2 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:41.859596 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed6fe8-4645-4106-9b49-be3baaba59b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:41.859864 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed6fe8-4645-4106-9b49-be3baaba59b2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:41.870101 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed6fe8-4645-4106-9b49-be3baaba59b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:41.876904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-38ed6fe8-4645-4106-9b49-be3baaba59b2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 17:37:41.878138 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 134/271] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:41.883868 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ed6ff-b751-4b58-98a5-3e876c1a6dcd None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:41.892829 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ed6ff-b751-4b58-98a5-3e876c1a6dcd None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:41.897262 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e268a92-3ce2-45fc-bccd-f6992fc00259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:41.897925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e268a92-3ce2-45fc-bccd-f6992fc00259 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:41.898549 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e268a92-3ce2-45fc-bccd-f6992fc00259 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:41.898817 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e268a92-3ce2-45fc-bccd-f6992fc00259 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:41.899589 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e268a92-3ce2-45fc-bccd-f6992fc00259 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:41.899893 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e268a92-3ce2-45fc-bccd-f6992fc00259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:41.901533 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e268a92-3ce2-45fc-bccd-f6992fc00259 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:41.910030 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 138/272] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:41.915530 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed6fe8-4645-4106-9b49-be3baaba59b2 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:41.925303 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed6fe8-4645-4106-9b49-be3baaba59b2 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:41.929607 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9926f-f88d-4621-abfa-9470452d4b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:41.930474 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9926f-f88d-4621-abfa-9470452d4b67 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:41.930755 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9926f-f88d-4621-abfa-9470452d4b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:41.931029 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9926f-f88d-4621-abfa-9470452d4b67 admin admin] PATH_INFO: `/v3/users/25d23c6069ff4f7ebece04b14fcbfe23` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:41.932251 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9926f-f88d-4621-abfa-9470452d4b67 admin admin] RBAC: Authorizing `identity:get_user(user_id=25d23c6069ff4f7ebece04b14fcbfe23)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:41.934414 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9926f-f88d-4621-abfa-9470452d4b67 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:41.936016 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 135/273] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:41 2022] GET /identity/v3/users/25d23c6069ff4f7ebece04b14fcbfe23 => generated 297 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:41.941563 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e268a92-3ce2-45fc-bccd-f6992fc00259 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:41.951128 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e268a92-3ce2-45fc-bccd-f6992fc00259 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:41.955427 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd1e10-dfc7-43f5-95c0-adc3f31580f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:41.956128 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd1e10-dfc7-43f5-95c0-adc3f31580f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:41.956408 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd1e10-dfc7-43f5-95c0-adc3f31580f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:41.956680 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd1e10-dfc7-43f5-95c0-adc3f31580f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:41.964433 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd1e10-dfc7-43f5-95c0-adc3f31580f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:41.966218 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd1e10-dfc7-43f5-95c0-adc3f31580f7 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:41.975067 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 139/274] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 17:37:41.980933 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9926f-f88d-4621-abfa-9470452d4b67 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:41.991267 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9926f-f88d-4621-abfa-9470452d4b67 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:41.999678 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ae2a9-61f0-4522-b76c-f0124b94a8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:42.000779 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ae2a9-61f0-4522-b76c-f0124b94a8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:42.001273 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ae2a9-61f0-4522-b76c-f0124b94a8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:42.001731 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ae2a9-61f0-4522-b76c-f0124b94a8d3 admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:42.003140 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ae2a9-61f0-4522-b76c-f0124b94a8d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=f7f01e6ad70a496b8b8df89a6b770b4c)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:42.005409 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ae2a9-61f0-4522-b76c-f0124b94a8d3 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:42.007283 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 136/275] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:41 2022] GET /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:42.013119 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd1e10-dfc7-43f5-95c0-adc3f31580f7 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:42.022292 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd1e10-dfc7-43f5-95c0-adc3f31580f7 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:42.027010 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc5e87-e17e-4118-a5bd-ce22e86debb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:42.027657 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc5e87-e17e-4118-a5bd-ce22e86debb9 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:42.027938 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc5e87-e17e-4118-a5bd-ce22e86debb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:42.028211 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc5e87-e17e-4118-a5bd-ce22e86debb9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:42.029080 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc5e87-e17e-4118-a5bd-ce22e86debb9 admin admin] RBAC: Adding query filter params (role.id=3c8f0c77d36b49608a0e17cfcff15691, scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c, user.id=25d23c6069ff4f7ebece04b14fcbfe23) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:42.029436 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc5e87-e17e-4118-a5bd-ce22e86debb9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:42.031293 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc5e87-e17e-4118-a5bd-ce22e86debb9 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:42.037701 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 140/276] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:37:42 2022] GET /identity/v3/role_assignments?user.id=25d23c6069ff4f7ebece04b14fcbfe23&scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c&role.id=3c8f0c77d36b49608a0e17cfcff15691 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:42.100445 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a16816-62cb-4550-96f8-e5533e102c79 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:42.101098 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a16816-62cb-4550-96f8-e5533e102c79 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:42.101615 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a16816-62cb-4550-96f8-e5533e102c79 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:42.104041 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 137/277] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:42.110162 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ec37a-3c2c-46dc-9e5f-f5e251835dcf None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:42.110510 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ec37a-3c2c-46dc-9e5f-f5e251835dcf None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:42.110796 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ec37a-3c2c-46dc-9e5f-f5e251835dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:42.113458 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac6655-a800-46f5-b5ab-ade642f9e41f None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:42.113744 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac6655-a800-46f5-b5ab-ade642f9e41f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:42.114020 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac6655-a800-46f5-b5ab-ade642f9e41f None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:42.115853 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 138/278] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:37:42.121666 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cfd28-e539-4d78-8342-79cf30fc85c1 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:42.122246 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cfd28-e539-4d78-8342-79cf30fc85c1 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:42.122759 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cfd28-e539-4d78-8342-79cf30fc85c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:42.129796 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-9a5ec37a-3c2c-46dc-9e5f-f5e251835dcf None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:42.131514 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-9a5ec37a-3c2c-46dc-9e5f-f5e251835dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:42.143925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 141/279] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:42.143925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dddc40-e6fb-4485-bd88-bdf81b42f119 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:42.143925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dddc40-e6fb-4485-bd88-bdf81b42f119 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:42.143925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dddc40-e6fb-4485-bd88-bdf81b42f119 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:42.143925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 142/280] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:42.147524 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-321cfd28-e539-4d78-8342-79cf30fc85c1 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:42.147524 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-321cfd28-e539-4d78-8342-79cf30fc85c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:42.149669 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6137c9-c28a-4b46-9f63-97c6ff42d2ac None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:42.150030 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6137c9-c28a-4b46-9f63-97c6ff42d2ac None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:42.150354 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6137c9-c28a-4b46-9f63-97c6ff42d2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:42.155382 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 139/281] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:37:42.171102 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-9e6137c9-c28a-4b46-9f63-97c6ff42d2ac None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:42.172381 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-9e6137c9-c28a-4b46-9f63-97c6ff42d2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:42.173171 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321cfd28-e539-4d78-8342-79cf30fc85c1 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:42.180906 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 143/282] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:37:42.183659 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321cfd28-e539-4d78-8342-79cf30fc85c1 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:42.185172 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6137c9-c28a-4b46-9f63-97c6ff42d2ac None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:42.188229 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7a4ba-7baa-4ec2-ade5-cfdf6c6bbc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:42.189093 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7a4ba-7baa-4ec2-ade5-cfdf6c6bbc63 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:42.189374 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7a4ba-7baa-4ec2-ade5-cfdf6c6bbc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:42.189646 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7a4ba-7baa-4ec2-ade5-cfdf6c6bbc63 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:42.197981 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6137c9-c28a-4b46-9f63-97c6ff42d2ac None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:42.201428 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7a4ba-7baa-4ec2-ade5-cfdf6c6bbc63 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:42.203543 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1e4b6-96ec-4c37-8053-4688b72cb584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:42.204568 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1e4b6-96ec-4c37-8053-4688b72cb584 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:42.205049 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1e4b6-96ec-4c37-8053-4688b72cb584 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:42.205491 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1e4b6-96ec-4c37-8053-4688b72cb584 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:42.208942 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-43f7a4ba-7baa-4ec2-ade5-cfdf6c6bbc63 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 17:37:42.210439 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 140/283] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:37:42.215771 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7a4ba-7baa-4ec2-ade5-cfdf6c6bbc63 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:42.217950 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1e4b6-96ec-4c37-8053-4688b72cb584 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:42.225138 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-dcd1e4b6-96ec-4c37-8053-4688b72cb584 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 17:37:42.225765 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7a4ba-7baa-4ec2-ade5-cfdf6c6bbc63 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:42.226408 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 144/284] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:42.226408 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1e4b6-96ec-4c37-8053-4688b72cb584 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:42.234675 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0fb45e-6447-4689-951b-315169eb57b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:42.235520 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fb45e-6447-4689-951b-315169eb57b4 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:42.235803 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fb45e-6447-4689-951b-315169eb57b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:42.236075 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fb45e-6447-4689-951b-315169eb57b4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:42.237380 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0fb45e-6447-4689-951b-315169eb57b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:42.239122 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0fb45e-6447-4689-951b-315169eb57b4 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:42.240221 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1e4b6-96ec-4c37-8053-4688b72cb584 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:42.240785 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 141/285] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:37:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:42.241663 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0fb45e-6447-4689-951b-315169eb57b4 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:42.249923 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f2952-7fb1-4793-bf28-f829e78b5dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:42.250615 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f2952-7fb1-4793-bf28-f829e78b5dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:42.250894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f2952-7fb1-4793-bf28-f829e78b5dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:42.251166 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f2952-7fb1-4793-bf28-f829e78b5dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:42.251855 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0fb45e-6447-4689-951b-315169eb57b4 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:42.251953 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f2952-7fb1-4793-bf28-f829e78b5dd2 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:42.252240 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f2952-7fb1-4793-bf28-f829e78b5dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:42.254057 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f2952-7fb1-4793-bf28-f829e78b5dd2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:42.256197 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be25b7-e9f5-4505-9096-d9a78a2d814a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:42.256924 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be25b7-e9f5-4505-9096-d9a78a2d814a admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:42.257379 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be25b7-e9f5-4505-9096-d9a78a2d814a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:42.257691 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be25b7-e9f5-4505-9096-d9a78a2d814a admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:42.260026 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be25b7-e9f5-4505-9096-d9a78a2d814a admin admin] RBAC: Adding query filter params (name=member) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:42.260026 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be25b7-e9f5-4505-9096-d9a78a2d814a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:42.261975 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be25b7-e9f5-4505-9096-d9a78a2d814a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:42.265534 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 145/286] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:42.266399 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f2952-7fb1-4793-bf28-f829e78b5dd2 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:42.274574 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 142/287] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:42.275625 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be25b7-e9f5-4505-9096-d9a78a2d814a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:42.280841 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f2952-7fb1-4793-bf28-f829e78b5dd2 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:42.285165 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be25b7-e9f5-4505-9096-d9a78a2d814a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:42.285428 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f7edd-c155-49fb-91f0-e40afbf1fbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:42.286105 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f7edd-c155-49fb-91f0-e40afbf1fbe5 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:42.286380 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f7edd-c155-49fb-91f0-e40afbf1fbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:42.286651 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f7edd-c155-49fb-91f0-e40afbf1fbe5 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:42.287398 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f7edd-c155-49fb-91f0-e40afbf1fbe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:42.289335 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f7edd-c155-49fb-91f0-e40afbf1fbe5 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:42.290599 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071660f0-c7a5-4e06-b263-190df626951a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:42.291474 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071660f0-c7a5-4e06-b263-190df626951a admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:42.291756 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071660f0-c7a5-4e06-b263-190df626951a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:42.292029 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071660f0-c7a5-4e06-b263-190df626951a admin admin] PATH_INFO: `/v3/users/93d32c1f3d374e54bd0a6bf7495ab2d7` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:42.293263 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071660f0-c7a5-4e06-b263-190df626951a admin admin] RBAC: Authorizing `identity:get_user(user_id=93d32c1f3d374e54bd0a6bf7495ab2d7)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:42.295363 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071660f0-c7a5-4e06-b263-190df626951a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:42.298042 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 143/288] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:42 2022] GET /identity/v3/users/93d32c1f3d374e54bd0a6bf7495ab2d7 => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:42.298802 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071660f0-c7a5-4e06-b263-190df626951a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:42.312131 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071660f0-c7a5-4e06-b263-190df626951a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:42.313084 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 146/289] 10.222.0.31 () {60 vars in 1153 bytes} [Mon Jan 10 17:37:42 2022] POST /identity/v3/users => generated 293 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:37:42.313967 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f7edd-c155-49fb-91f0-e40afbf1fbe5 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:42.323793 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f7edd-c155-49fb-91f0-e40afbf1fbe5 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:42.332809 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b55b9e-e1ab-4e21-a58e-67e03588a500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:42.334289 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b55b9e-e1ab-4e21-a58e-67e03588a500 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:42.334780 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b55b9e-e1ab-4e21-a58e-67e03588a500 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:42.335178 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b55b9e-e1ab-4e21-a58e-67e03588a500 admin admin] PATH_INFO: `/v3/users/b684adffbed44c779231664cf14266c9` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:42.335444 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7e5e7-b6d9-4481-aa25-ed29e2ee142c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:42.336625 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7e5e7-b6d9-4481-aa25-ed29e2ee142c admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:42.336984 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7e5e7-b6d9-4481-aa25-ed29e2ee142c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:42.337259 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7e5e7-b6d9-4481-aa25-ed29e2ee142c admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:42.338635 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7e5e7-b6d9-4481-aa25-ed29e2ee142c admin admin] RBAC: Authorizing `identity:get_project(project_id=f7f01e6ad70a496b8b8df89a6b770b4c)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:42.342410 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7e5e7-b6d9-4481-aa25-ed29e2ee142c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:42.348455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 147/290] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:42 2022] GET /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:42.356040 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7e5e7-b6d9-4481-aa25-ed29e2ee142c admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:42.362245 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b55b9e-e1ab-4e21-a58e-67e03588a500 admin admin] RBAC: Authorizing `identity:get_user(user_id=b684adffbed44c779231664cf14266c9)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:42.364470 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b55b9e-e1ab-4e21-a58e-67e03588a500 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:42.368903 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 144/291] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:42 2022] GET /identity/v3/users/b684adffbed44c779231664cf14266c9 => generated 293 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:42.370428 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7e5e7-b6d9-4481-aa25-ed29e2ee142c admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:42.375291 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b55b9e-e1ab-4e21-a58e-67e03588a500 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:42.383460 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25977d32-1e9f-47a6-80ab-5216b31de823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:42.384589 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25977d32-1e9f-47a6-80ab-5216b31de823 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:42.385081 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25977d32-1e9f-47a6-80ab-5216b31de823 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:42.385451 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25977d32-1e9f-47a6-80ab-5216b31de823 admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c/users/93d32c1f3d374e54bd0a6bf7495ab2d7/roles/4c8859f798ea45efab8e71b3dc25a52a` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:42.390467 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25977d32-1e9f-47a6-80ab-5216b31de823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f01e6ad70a496b8b8df89a6b770b4c, user_id=93d32c1f3d374e54bd0a6bf7495ab2d7, role_id=4c8859f798ea45efab8e71b3dc25a52a)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:42.392038 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b55b9e-e1ab-4e21-a58e-67e03588a500 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:42.392173 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25977d32-1e9f-47a6-80ab-5216b31de823 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:42.398897 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ea01c-e879-48b7-a27c-25666effa170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:42.399621 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ea01c-e879-48b7-a27c-25666effa170 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:42.399925 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ea01c-e879-48b7-a27c-25666effa170 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:42.400276 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ea01c-e879-48b7-a27c-25666effa170 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:42.401305 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ea01c-e879-48b7-a27c-25666effa170 admin admin] RBAC: Adding query filter params (role.id=3c8f0c77d36b49608a0e17cfcff15691, user.id=b684adffbed44c779231664cf14266c9, scope.system=all) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:42.401515 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ea01c-e879-48b7-a27c-25666effa170 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:42.404282 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ea01c-e879-48b7-a27c-25666effa170 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:42.408512 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 148/292] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:37:42 2022] PUT /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c/users/93d32c1f3d374e54bd0a6bf7495ab2d7/roles/4c8859f798ea45efab8e71b3dc25a52a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:37:42.412736 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 145/293] 10.222.0.31 () {56 vars in 1329 bytes} [Mon Jan 10 17:37:42 2022] GET /identity/v3/role_assignments?user.id=b684adffbed44c779231664cf14266c9&scope.system=all&role.id=3c8f0c77d36b49608a0e17cfcff15691 => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:44.824169 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19225869-e03b-4dc0-9f13-7237e3160552 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:44.824686 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1e878-e7e6-484a-978c-3d4f40dc2ea0 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:44.825078 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19225869-e03b-4dc0-9f13-7237e3160552 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:44.825152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1e878-e7e6-484a-978c-3d4f40dc2ea0 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:44.825216 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19225869-e03b-4dc0-9f13-7237e3160552 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:44.825279 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1e878-e7e6-484a-978c-3d4f40dc2ea0 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:44.826531 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 149/294] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:44.826820 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 146/295] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:44.831540 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c92a67-069d-4685-89a9-79003fccad8c None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:44.831827 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c92a67-069d-4685-89a9-79003fccad8c None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:44.832105 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c92a67-069d-4685-89a9-79003fccad8c None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:44.832426 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8007bff-3325-41db-a3a9-e3af8b63575e None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:44.832711 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8007bff-3325-41db-a3a9-e3af8b63575e None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:44.833028 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8007bff-3325-41db-a3a9-e3af8b63575e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:44.833906 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 150/296] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:44.834823 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea28a1-4f36-4d63-ba3d-af9c79b22bbe None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:44.835096 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea28a1-4f36-4d63-ba3d-af9c79b22bbe None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:44.835371 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea28a1-4f36-4d63-ba3d-af9c79b22bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:44.852988 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-7dea28a1-4f36-4d63-ba3d-af9c79b22bbe None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:44.854069 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-f8007bff-3325-41db-a3a9-e3af8b63575e None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:44.854176 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-7dea28a1-4f36-4d63-ba3d-af9c79b22bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:44.855493 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f8007bff-3325-41db-a3a9-e3af8b63575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:44.908735 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 151/297] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:44.910353 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 147/298] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:44.913779 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f8617-54eb-42e1-8e67-3ae0c34b82fb None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:44.913857 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af806-82f2-46bb-9d0c-7996be6735de None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:44.917870 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f8617-54eb-42e1-8e67-3ae0c34b82fb None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:44.917963 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af806-82f2-46bb-9d0c-7996be6735de None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:44.918057 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f8617-54eb-42e1-8e67-3ae0c34b82fb None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:44.918128 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af806-82f2-46bb-9d0c-7996be6735de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:44.918194 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 148/299] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:44.919910 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7ec77-bf36-47ff-a3ab-145dba8e2626 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:44.920366 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7ec77-bf36-47ff-a3ab-145dba8e2626 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:44.920933 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7ec77-bf36-47ff-a3ab-145dba8e2626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:44.933965 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-298af806-82f2-46bb-9d0c-7996be6735de None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:44.935300 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-298af806-82f2-46bb-9d0c-7996be6735de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:44.942358 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-b3a7ec77-bf36-47ff-a3ab-145dba8e2626 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:44.942851 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 152/300] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:44.943489 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b3a7ec77-bf36-47ff-a3ab-145dba8e2626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:44.943622 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298af806-82f2-46bb-9d0c-7996be6735de None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:44.956877 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 149/301] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:44.957033 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298af806-82f2-46bb-9d0c-7996be6735de None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:44.957123 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7ec77-bf36-47ff-a3ab-145dba8e2626 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:44.965408 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda0317-909c-4a1d-910b-65c6e59a18fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:44.965920 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7ec77-bf36-47ff-a3ab-145dba8e2626 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:44.966418 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda0317-909c-4a1d-910b-65c6e59a18fe admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:44.966699 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda0317-909c-4a1d-910b-65c6e59a18fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:44.966974 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda0317-909c-4a1d-910b-65c6e59a18fe admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:44.971363 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558b99b-0122-4545-896d-161356df228d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:44.972198 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558b99b-0122-4545-896d-161356df228d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:44.972477 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558b99b-0122-4545-896d-161356df228d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:44.972752 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558b99b-0122-4545-896d-161356df228d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:44.978206 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda0317-909c-4a1d-910b-65c6e59a18fe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:44.983051 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558b99b-0122-4545-896d-161356df228d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:44.985084 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-edda0317-909c-4a1d-910b-65c6e59a18fe admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 17:37:44.986287 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 153/302] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:44.987034 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda0317-909c-4a1d-910b-65c6e59a18fe admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:44.989865 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-5558b99b-0122-4545-896d-161356df228d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 17:37:44.991151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 150/303] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:44.991821 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558b99b-0122-4545-896d-161356df228d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:44.997098 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda0317-909c-4a1d-910b-65c6e59a18fe admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:45.000669 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558b99b-0122-4545-896d-161356df228d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:45.001310 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ba965-0161-4482-b1a4-d19d9abc33a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:45.002048 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ba965-0161-4482-b1a4-d19d9abc33a4 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:45.002330 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ba965-0161-4482-b1a4-d19d9abc33a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:45.002603 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ba965-0161-4482-b1a4-d19d9abc33a4 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:45.004845 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f68c98-0f48-4406-a9f5-7ac09e530100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:45.005570 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f68c98-0f48-4406-a9f5-7ac09e530100 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:45.005843 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f68c98-0f48-4406-a9f5-7ac09e530100 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:45.006112 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f68c98-0f48-4406-a9f5-7ac09e530100 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:45.007247 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f68c98-0f48-4406-a9f5-7ac09e530100 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:45.008961 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f68c98-0f48-4406-a9f5-7ac09e530100 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:45.010483 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 151/304] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:37:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:45.011184 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f68c98-0f48-4406-a9f5-7ac09e530100 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:45.014009 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ba965-0161-4482-b1a4-d19d9abc33a4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:45.020325 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f68c98-0f48-4406-a9f5-7ac09e530100 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:45.020880 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-ac8ba965-0161-4482-b1a4-d19d9abc33a4 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 17:37:45.022182 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 154/305] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:45.022785 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ba965-0161-4482-b1a4-d19d9abc33a4 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:45.025499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeec353-541f-44ee-9978-6cfc9470a29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:45.026095 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeec353-541f-44ee-9978-6cfc9470a29e admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:45.026372 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeec353-541f-44ee-9978-6cfc9470a29e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:45.026671 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeec353-541f-44ee-9978-6cfc9470a29e admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:45.027364 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeec353-541f-44ee-9978-6cfc9470a29e admin admin] RBAC: Adding query filter params (name=member) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:45.027661 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeec353-541f-44ee-9978-6cfc9470a29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:45.029237 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeec353-541f-44ee-9978-6cfc9470a29e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:45.031961 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ba965-0161-4482-b1a4-d19d9abc33a4 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:45.036444 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ae9ed-5299-4b7d-bdd2-4b19621ec0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:45.037076 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ae9ed-5299-4b7d-bdd2-4b19621ec0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:45.037329 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ae9ed-5299-4b7d-bdd2-4b19621ec0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:45.037441 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 152/306] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:45.037600 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ae9ed-5299-4b7d-bdd2-4b19621ec0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:45.038055 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeec353-541f-44ee-9978-6cfc9470a29e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:45.038395 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ae9ed-5299-4b7d-bdd2-4b19621ec0c9 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:45.038640 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ae9ed-5299-4b7d-bdd2-4b19621ec0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:45.040236 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ae9ed-5299-4b7d-bdd2-4b19621ec0c9 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:45.048251 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 155/307] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:45.049026 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ae9ed-5299-4b7d-bdd2-4b19621ec0c9 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:45.050208 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeec353-541f-44ee-9978-6cfc9470a29e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:45.054737 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a23e3c-e546-4fb2-bc72-adef761d09ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:45.055359 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a23e3c-e546-4fb2-bc72-adef761d09ae admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:45.055635 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a23e3c-e546-4fb2-bc72-adef761d09ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:45.055907 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a23e3c-e546-4fb2-bc72-adef761d09ae admin admin] PATH_INFO: `/v3/groups` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:45.056592 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a23e3c-e546-4fb2-bc72-adef761d09ae admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:45.057623 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING py.warnings [None req-b8a23e3c-e546-4fb2-bc72-adef761d09ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:37:45.057623 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: warnings.warn(msg) Jan 10 17:37:45.057623 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: Jan 10 17:37:45.057996 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ae9ed-5299-4b7d-bdd2-4b19621ec0c9 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:45.058795 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a23e3c-e546-4fb2-bc72-adef761d09ae admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:45.062148 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebebdf-6cd6-449d-ba39-ec6f793a4780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:45.062755 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebebdf-6cd6-449d-ba39-ec6f793a4780 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:45.063031 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebebdf-6cd6-449d-ba39-ec6f793a4780 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:45.063268 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebebdf-6cd6-449d-ba39-ec6f793a4780 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:45.064010 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebebdf-6cd6-449d-ba39-ec6f793a4780 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:45.064312 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebebdf-6cd6-449d-ba39-ec6f793a4780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:45.065966 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebebdf-6cd6-449d-ba39-ec6f793a4780 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:45.074579 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 153/308] 10.222.0.31 () {60 vars in 1155 bytes} [Mon Jan 10 17:37:45 2022] POST /identity/v3/groups => generated 229 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:37:45.085637 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 156/309] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:45.085796 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a23e3c-e546-4fb2-bc72-adef761d09ae admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:45.085874 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebebdf-6cd6-449d-ba39-ec6f793a4780 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:45.086370 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a23e3c-e546-4fb2-bc72-adef761d09ae admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:45.086984 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebebdf-6cd6-449d-ba39-ec6f793a4780 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:45.091627 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debea6e-9bf7-4bf1-880e-00fb9f14d8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:45.091846 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cda61-8053-40a3-a847-8135f9d7e4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:45.092530 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debea6e-9bf7-4bf1-880e-00fb9f14d8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:45.092623 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cda61-8053-40a3-a847-8135f9d7e4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:45.092805 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debea6e-9bf7-4bf1-880e-00fb9f14d8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:45.092932 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cda61-8053-40a3-a847-8135f9d7e4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:45.093102 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debea6e-9bf7-4bf1-880e-00fb9f14d8e8 admin admin] PATH_INFO: `/v3/users/93d32c1f3d374e54bd0a6bf7495ab2d7` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:45.093192 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cda61-8053-40a3-a847-8135f9d7e4e0 admin admin] PATH_INFO: `/v3/users/b684adffbed44c779231664cf14266c9` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:45.094506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debea6e-9bf7-4bf1-880e-00fb9f14d8e8 admin admin] RBAC: Authorizing `identity:get_user(user_id=93d32c1f3d374e54bd0a6bf7495ab2d7)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:45.094615 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439cda61-8053-40a3-a847-8135f9d7e4e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=b684adffbed44c779231664cf14266c9)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:45.096767 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debea6e-9bf7-4bf1-880e-00fb9f14d8e8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:45.096921 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439cda61-8053-40a3-a847-8135f9d7e4e0 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:45.098720 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 157/310] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:45 2022] GET /identity/v3/users/93d32c1f3d374e54bd0a6bf7495ab2d7 => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:45.099323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debea6e-9bf7-4bf1-880e-00fb9f14d8e8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:45.101123 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 154/311] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:45 2022] GET /identity/v3/users/b684adffbed44c779231664cf14266c9 => generated 293 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:45.109125 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cda61-8053-40a3-a847-8135f9d7e4e0 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:45.113415 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debea6e-9bf7-4bf1-880e-00fb9f14d8e8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:45.118150 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c53c95-012c-4861-b41e-b76c39fc4bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:45.119047 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c53c95-012c-4861-b41e-b76c39fc4bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:45.119323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c53c95-012c-4861-b41e-b76c39fc4bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:45.119588 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c53c95-012c-4861-b41e-b76c39fc4bc8 admin admin] PATH_INFO: `/v3/users/5654ce6ff70d46c99a0ce0ed528e4b1a` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:45.119684 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cda61-8053-40a3-a847-8135f9d7e4e0 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:45.124082 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1610d-1afc-478c-bad6-da313b84b024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:45.124992 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1610d-1afc-478c-bad6-da313b84b024 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:45.125272 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1610d-1afc-478c-bad6-da313b84b024 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:45.125545 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1610d-1afc-478c-bad6-da313b84b024 admin admin] PATH_INFO: `/v3/system/users/b684adffbed44c779231664cf14266c9/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:45.127046 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1610d-1afc-478c-bad6-da313b84b024 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b684adffbed44c779231664cf14266c9, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:45.128119 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING py.warnings [None req-a4a1610d-1afc-478c-bad6-da313b84b024 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:37:45.128119 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: warnings.warn(msg) Jan 10 17:37:45.128119 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: Jan 10 17:37:45.129039 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1610d-1afc-478c-bad6-da313b84b024 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:45.136530 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c53c95-012c-4861-b41e-b76c39fc4bc8 admin admin] RBAC: Authorizing `identity:get_user(user_id=5654ce6ff70d46c99a0ce0ed528e4b1a)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:45.138324 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c53c95-012c-4861-b41e-b76c39fc4bc8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:45.140321 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 158/312] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:45 2022] GET /identity/v3/users/5654ce6ff70d46c99a0ce0ed528e4b1a => generated 293 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:45.141001 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c53c95-012c-4861-b41e-b76c39fc4bc8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:45.141168 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 155/313] 10.222.0.31 () {58 vars in 1355 bytes} [Mon Jan 10 17:37:45 2022] PUT /identity/v3/system/users/b684adffbed44c779231664cf14266c9/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:37:45.155124 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1610d-1afc-478c-bad6-da313b84b024 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:45.156244 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c53c95-012c-4861-b41e-b76c39fc4bc8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:45.165240 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a7a5b-0961-4980-954d-45a78bf15fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:45.166037 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a7a5b-0961-4980-954d-45a78bf15fee admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:45.166376 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a7a5b-0961-4980-954d-45a78bf15fee admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:45.166666 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a7a5b-0961-4980-954d-45a78bf15fee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:45.167847 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1610d-1afc-478c-bad6-da313b84b024 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:45.173465 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd50a90-d429-4b91-8ecd-bae16d5cc7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:45.174502 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd50a90-d429-4b91-8ecd-bae16d5cc7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:45.175084 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd50a90-d429-4b91-8ecd-bae16d5cc7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:45.175562 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd50a90-d429-4b91-8ecd-bae16d5cc7b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:45.176715 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd50a90-d429-4b91-8ecd-bae16d5cc7b8 admin admin] RBAC: Adding query filter params (role.id=4c8859f798ea45efab8e71b3dc25a52a, user.id=5654ce6ff70d46c99a0ce0ed528e4b1a, scope.system=all) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:45.177291 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd50a90-d429-4b91-8ecd-bae16d5cc7b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:45.177524 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a7a5b-0961-4980-954d-45a78bf15fee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:45.179493 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a7a5b-0961-4980-954d-45a78bf15fee admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:45.180088 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd50a90-d429-4b91-8ecd-bae16d5cc7b8 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:45.186938 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 156/314] 10.222.0.31 () {56 vars in 1329 bytes} [Mon Jan 10 17:37:45 2022] GET /identity/v3/role_assignments?user.id=5654ce6ff70d46c99a0ce0ed528e4b1a&scope.system=all&role.id=4c8859f798ea45efab8e71b3dc25a52a => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:45.198719 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 159/315] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:45.206347 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd50a90-d429-4b91-8ecd-bae16d5cc7b8 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:45.217862 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd50a90-d429-4b91-8ecd-bae16d5cc7b8 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:45.223426 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa557dcc-d18f-4d54-9813-00cab728f9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:45.224973 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa557dcc-d18f-4d54-9813-00cab728f9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:45.225641 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa557dcc-d18f-4d54-9813-00cab728f9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:45.226151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa557dcc-d18f-4d54-9813-00cab728f9e5 admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:45.228042 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa557dcc-d18f-4d54-9813-00cab728f9e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=f7f01e6ad70a496b8b8df89a6b770b4c)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:45.230735 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa557dcc-d18f-4d54-9813-00cab728f9e5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:45.233181 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 157/316] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:45 2022] GET /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:45.239550 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a7a5b-0961-4980-954d-45a78bf15fee admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:45.249903 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a7a5b-0961-4980-954d-45a78bf15fee admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:45.255145 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9f55c-3edd-422f-8c62-f1cedc8a9032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:45.256210 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9f55c-3edd-422f-8c62-f1cedc8a9032 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:45.256686 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9f55c-3edd-422f-8c62-f1cedc8a9032 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:45.257242 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9f55c-3edd-422f-8c62-f1cedc8a9032 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:45.258352 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9f55c-3edd-422f-8c62-f1cedc8a9032 admin admin] RBAC: Adding query filter params (role.id=4c8859f798ea45efab8e71b3dc25a52a, scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c, user.id=93d32c1f3d374e54bd0a6bf7495ab2d7) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:45.258987 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9f55c-3edd-422f-8c62-f1cedc8a9032 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:45.261251 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9f55c-3edd-422f-8c62-f1cedc8a9032 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:45.268904 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 160/317] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:37:45 2022] GET /identity/v3/role_assignments?user.id=93d32c1f3d374e54bd0a6bf7495ab2d7&scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c&role.id=4c8859f798ea45efab8e71b3dc25a52a => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:47.498657 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf46175-1035-4a02-984b-95e006155b5b None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:47.499198 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf46175-1035-4a02-984b-95e006155b5b None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:47.499198 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf46175-1035-4a02-984b-95e006155b5b None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:47.501163 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 158/318] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:37:47.506219 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cfd00-149b-46c4-bfe1-39a4c676cf94 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:47.506647 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cfd00-149b-46c4-bfe1-39a4c676cf94 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:47.506730 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cfd00-149b-46c4-bfe1-39a4c676cf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:47.521156 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aac6c-61a4-4c35-9a53-914402ac15b8 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:47.521450 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aac6c-61a4-4c35-9a53-914402ac15b8 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:47.521714 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aac6c-61a4-4c35-9a53-914402ac15b8 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:47.524003 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 159/319] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:37:47.525329 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-df1cfd00-149b-46c4-bfe1-39a4c676cf94 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:47.526505 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-df1cfd00-149b-46c4-bfe1-39a4c676cf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:47.528905 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95e19a-462f-4245-bdb9-ccea8f9c4d7d None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:47.529199 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95e19a-462f-4245-bdb9-ccea8f9c4d7d None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:47.529484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95e19a-462f-4245-bdb9-ccea8f9c4d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:47.534184 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 161/320] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:47.549845 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-0a95e19a-462f-4245-bdb9-ccea8f9c4d7d None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:47.551054 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-0a95e19a-462f-4245-bdb9-ccea8f9c4d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:47.558405 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 160/321] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:47.559030 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cfd00-149b-46c4-bfe1-39a4c676cf94 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:47.568405 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cfd00-149b-46c4-bfe1-39a4c676cf94 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:47.572950 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15625fc-fe8a-4458-baf8-d76c97634efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:47.573733 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15625fc-fe8a-4458-baf8-d76c97634efb admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:47.574012 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15625fc-fe8a-4458-baf8-d76c97634efb admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:47.574284 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15625fc-fe8a-4458-baf8-d76c97634efb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:47.575445 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15625fc-fe8a-4458-baf8-d76c97634efb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:47.577174 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15625fc-fe8a-4458-baf8-d76c97634efb admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:47.578972 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 162/322] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:37:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:47.582705 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95e19a-462f-4245-bdb9-ccea8f9c4d7d None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:47.584480 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47667c2e-db2a-4560-ac50-9bc7b9078dc7 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:47.584771 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47667c2e-db2a-4560-ac50-9bc7b9078dc7 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:47.585099 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47667c2e-db2a-4560-ac50-9bc7b9078dc7 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:47.586805 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 163/323] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:47.587543 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47667c2e-db2a-4560-ac50-9bc7b9078dc7 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:47.591475 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95e19a-462f-4245-bdb9-ccea8f9c4d7d None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:47.595599 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023f397-e84d-436c-bcfb-b0edc7296cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:47.596380 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023f397-e84d-436c-bcfb-b0edc7296cca admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:47.596711 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023f397-e84d-436c-bcfb-b0edc7296cca admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:47.597035 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023f397-e84d-436c-bcfb-b0edc7296cca admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:47.599555 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47667c2e-db2a-4560-ac50-9bc7b9078dc7 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:47.603679 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0051853-d782-42f5-b587-63bf30e3c129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:47.604304 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0051853-d782-42f5-b587-63bf30e3c129 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:47.604585 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0051853-d782-42f5-b587-63bf30e3c129 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:47.604888 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0051853-d782-42f5-b587-63bf30e3c129 admin admin] PATH_INFO: `/v3/groups` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:47.605586 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0051853-d782-42f5-b587-63bf30e3c129 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:47.606604 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING py.warnings [None req-c0051853-d782-42f5-b587-63bf30e3c129 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:37:47.606604 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: warnings.warn(msg) Jan 10 17:37:47.606604 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: Jan 10 17:37:47.606859 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023f397-e84d-436c-bcfb-b0edc7296cca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:47.607808 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0051853-d782-42f5-b587-63bf30e3c129 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:47.613707 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-1023f397-e84d-436c-bcfb-b0edc7296cca admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 17:37:47.614877 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 161/324] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:47.618273 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ee062-165a-4453-9263-3d3b66d83f5a None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:47.618663 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ee062-165a-4453-9263-3d3b66d83f5a None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:47.618999 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ee062-165a-4453-9263-3d3b66d83f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:47.625870 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 164/325] 10.222.0.31 () {60 vars in 1155 bytes} [Mon Jan 10 17:37:47 2022] POST /identity/v3/groups => generated 226 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:37:47.632908 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0051853-d782-42f5-b587-63bf30e3c129 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:47.637140 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0051853-d782-42f5-b587-63bf30e3c129 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:47.638791 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-912ee062-165a-4453-9263-3d3b66d83f5a None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:47.640010 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-912ee062-165a-4453-9263-3d3b66d83f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:47.641737 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9228132-c615-4925-a411-a0a3a9ef1ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:47.642518 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9228132-c615-4925-a411-a0a3a9ef1ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:47.642775 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9228132-c615-4925-a411-a0a3a9ef1ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:47.643049 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9228132-c615-4925-a411-a0a3a9ef1ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:47.643949 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9228132-c615-4925-a411-a0a3a9ef1ca1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:47.644258 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9228132-c615-4925-a411-a0a3a9ef1ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:47.646267 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9228132-c615-4925-a411-a0a3a9ef1ca1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:47.647799 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 162/326] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:47.656681 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 165/327] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:47.662585 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ee062-165a-4453-9263-3d3b66d83f5a None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:47.672655 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9228132-c615-4925-a411-a0a3a9ef1ca1 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:47.673207 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ee062-165a-4453-9263-3d3b66d83f5a None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:47.677544 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df13073-6960-4a38-8e3d-e1e028a7a78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:47.678439 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df13073-6960-4a38-8e3d-e1e028a7a78f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:47.678723 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df13073-6960-4a38-8e3d-e1e028a7a78f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:47.678997 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df13073-6960-4a38-8e3d-e1e028a7a78f admin admin] PATH_INFO: `/v3/users/b684adffbed44c779231664cf14266c9` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:47.680536 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df13073-6960-4a38-8e3d-e1e028a7a78f admin admin] RBAC: Authorizing `identity:get_user(user_id=b684adffbed44c779231664cf14266c9)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:47.683012 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df13073-6960-4a38-8e3d-e1e028a7a78f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:47.683226 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9228132-c615-4925-a411-a0a3a9ef1ca1 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:47.684960 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 163/328] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:47 2022] GET /identity/v3/users/b684adffbed44c779231664cf14266c9 => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:47.688702 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e9dce-ea35-4bb3-b790-29387763b9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:47.689575 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e9dce-ea35-4bb3-b790-29387763b9ca admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:47.690165 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e9dce-ea35-4bb3-b790-29387763b9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:47.690492 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e9dce-ea35-4bb3-b790-29387763b9ca admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:47.691060 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df13073-6960-4a38-8e3d-e1e028a7a78f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:47.701233 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df13073-6960-4a38-8e3d-e1e028a7a78f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:47.704922 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e9dce-ea35-4bb3-b790-29387763b9ca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:47.705651 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d88768-a749-4243-af26-5e6cfd3a96d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:47.706349 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d88768-a749-4243-af26-5e6cfd3a96d6 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:47.706632 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d88768-a749-4243-af26-5e6cfd3a96d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:47.706908 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d88768-a749-4243-af26-5e6cfd3a96d6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:47.707789 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d88768-a749-4243-af26-5e6cfd3a96d6 admin admin] RBAC: Adding query filter params (role.id=3c8f0c77d36b49608a0e17cfcff15691, user.id=b684adffbed44c779231664cf14266c9, scope.system=all) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:47.708099 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d88768-a749-4243-af26-5e6cfd3a96d6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:47.710018 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d88768-a749-4243-af26-5e6cfd3a96d6 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:47.714486 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-132e9dce-ea35-4bb3-b790-29387763b9ca admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 17:37:47.716202 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 166/329] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:47.722350 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e9dce-ea35-4bb3-b790-29387763b9ca admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:47.730728 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 164/330] 10.222.0.31 () {56 vars in 1329 bytes} [Mon Jan 10 17:37:47 2022] GET /identity/v3/role_assignments?user.id=b684adffbed44c779231664cf14266c9&scope.system=all&role.id=3c8f0c77d36b49608a0e17cfcff15691 => generated 510 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:47.736387 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e9dce-ea35-4bb3-b790-29387763b9ca admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:47.741105 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004f4c5-b5ae-4039-92c2-acc111f82ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:47.741805 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004f4c5-b5ae-4039-92c2-acc111f82ffe admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:47.742086 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004f4c5-b5ae-4039-92c2-acc111f82ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:47.742358 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004f4c5-b5ae-4039-92c2-acc111f82ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:47.743151 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004f4c5-b5ae-4039-92c2-acc111f82ffe admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:47.743455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004f4c5-b5ae-4039-92c2-acc111f82ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:47.745151 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004f4c5-b5ae-4039-92c2-acc111f82ffe admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:47.755256 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 167/331] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:47.761186 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d88768-a749-4243-af26-5e6cfd3a96d6 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:47.771800 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d88768-a749-4243-af26-5e6cfd3a96d6 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:47.776974 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b8a40-0ef0-40a6-a525-90ecae402c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:47.778033 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b8a40-0ef0-40a6-a525-90ecae402c02 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:47.778318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b8a40-0ef0-40a6-a525-90ecae402c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:47.778595 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b8a40-0ef0-40a6-a525-90ecae402c02 admin admin] PATH_INFO: `/v3/users/5654ce6ff70d46c99a0ce0ed528e4b1a` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:47.779979 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b8a40-0ef0-40a6-a525-90ecae402c02 admin admin] RBAC: Authorizing `identity:get_user(user_id=5654ce6ff70d46c99a0ce0ed528e4b1a)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:47.782267 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b8a40-0ef0-40a6-a525-90ecae402c02 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:47.784211 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 165/332] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:47 2022] GET /identity/v3/users/5654ce6ff70d46c99a0ce0ed528e4b1a => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:47.789925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004f4c5-b5ae-4039-92c2-acc111f82ffe admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:47.800433 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004f4c5-b5ae-4039-92c2-acc111f82ffe admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:47.805188 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e742c-e2b2-4978-8487-1501ed40f418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:47.806219 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e742c-e2b2-4978-8487-1501ed40f418 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:47.806569 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e742c-e2b2-4978-8487-1501ed40f418 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:47.806926 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e742c-e2b2-4978-8487-1501ed40f418 admin admin] PATH_INFO: `/v3/system/users/5654ce6ff70d46c99a0ce0ed528e4b1a/roles/4c8859f798ea45efab8e71b3dc25a52a` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:47.808698 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e742c-e2b2-4978-8487-1501ed40f418 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5654ce6ff70d46c99a0ce0ed528e4b1a, role_id=4c8859f798ea45efab8e71b3dc25a52a)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:47.810019 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING py.warnings [None req-c38e742c-e2b2-4978-8487-1501ed40f418 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:37:47.810019 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: warnings.warn(msg) Jan 10 17:37:47.810019 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: Jan 10 17:37:47.811029 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e742c-e2b2-4978-8487-1501ed40f418 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:47.824639 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 168/333] 10.222.0.31 () {58 vars in 1355 bytes} [Mon Jan 10 17:37:47 2022] PUT /identity/v3/system/users/5654ce6ff70d46c99a0ce0ed528e4b1a/roles/4c8859f798ea45efab8e71b3dc25a52a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:37:50.472406 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4a319-2726-457c-876b-5ccb0f0d4af3 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:50.473464 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4a319-2726-457c-876b-5ccb0f0d4af3 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:50.473956 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4a319-2726-457c-876b-5ccb0f0d4af3 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:50.476274 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 166/334] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:50.482159 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1e118-10a4-47ef-9142-acffc0aa6fde None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:50.483036 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1e118-10a4-47ef-9142-acffc0aa6fde None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:50.483504 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1e118-10a4-47ef-9142-acffc0aa6fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:50.504323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-93e1e118-10a4-47ef-9142-acffc0aa6fde None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:50.505889 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-93e1e118-10a4-47ef-9142-acffc0aa6fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:50.514617 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 169/335] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:50.540886 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4a319-2726-457c-876b-5ccb0f0d4af3 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:50.555597 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4a319-2726-457c-876b-5ccb0f0d4af3 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:50.560181 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cff7de-9066-41f1-8663-ec5cd598881a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:50.561256 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cff7de-9066-41f1-8663-ec5cd598881a admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:50.561735 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cff7de-9066-41f1-8663-ec5cd598881a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:50.562218 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cff7de-9066-41f1-8663-ec5cd598881a admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:50.578919 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cff7de-9066-41f1-8663-ec5cd598881a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:50.586391 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-11cff7de-9066-41f1-8663-ec5cd598881a admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 17:37:50.588129 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 167/336] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:50.594054 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1e118-10a4-47ef-9142-acffc0aa6fde None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:50.603492 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1e118-10a4-47ef-9142-acffc0aa6fde None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:50.608167 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e5b67-b385-407c-a208-9c1cbdd1df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:50.609106 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e5b67-b385-407c-a208-9c1cbdd1df17 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:50.609581 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e5b67-b385-407c-a208-9c1cbdd1df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:50.610094 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e5b67-b385-407c-a208-9c1cbdd1df17 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:50.611072 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e5b67-b385-407c-a208-9c1cbdd1df17 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:50.611567 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e5b67-b385-407c-a208-9c1cbdd1df17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:50.613477 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e5b67-b385-407c-a208-9c1cbdd1df17 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:50.631494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 170/337] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:50.636960 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cff7de-9066-41f1-8663-ec5cd598881a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:50.650180 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cff7de-9066-41f1-8663-ec5cd598881a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:50.660519 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffa6d0-8d70-48fc-a784-c9745bd7c68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:50.661716 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffa6d0-8d70-48fc-a784-c9745bd7c68a admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:50.662191 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffa6d0-8d70-48fc-a784-c9745bd7c68a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:50.662651 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffa6d0-8d70-48fc-a784-c9745bd7c68a admin admin] PATH_INFO: `/v3/users/5654ce6ff70d46c99a0ce0ed528e4b1a` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:50.664234 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffa6d0-8d70-48fc-a784-c9745bd7c68a admin admin] RBAC: Authorizing `identity:get_user(user_id=5654ce6ff70d46c99a0ce0ed528e4b1a)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:50.666602 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffa6d0-8d70-48fc-a784-c9745bd7c68a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:50.668447 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 168/338] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:37:50 2022] GET /identity/v3/users/5654ce6ff70d46c99a0ce0ed528e4b1a => generated 293 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:50.675017 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e5b67-b385-407c-a208-9c1cbdd1df17 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:50.690393 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e5b67-b385-407c-a208-9c1cbdd1df17 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:50.701314 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27148e9-199c-4060-b72e-b144c82ec490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:50.701999 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27148e9-199c-4060-b72e-b144c82ec490 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:50.702282 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27148e9-199c-4060-b72e-b144c82ec490 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:50.702562 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27148e9-199c-4060-b72e-b144c82ec490 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:50.703435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27148e9-199c-4060-b72e-b144c82ec490 admin admin] RBAC: Adding query filter params (role.id=4c8859f798ea45efab8e71b3dc25a52a, user.id=5654ce6ff70d46c99a0ce0ed528e4b1a, scope.system=all) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:50.703740 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27148e9-199c-4060-b72e-b144c82ec490 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:50.705685 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27148e9-199c-4060-b72e-b144c82ec490 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:50.740907 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 171/339] 10.222.0.31 () {56 vars in 1329 bytes} [Mon Jan 10 17:37:50 2022] GET /identity/v3/role_assignments?user.id=5654ce6ff70d46c99a0ce0ed528e4b1a&scope.system=all&role.id=4c8859f798ea45efab8e71b3dc25a52a => generated 510 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:50.966597 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a10ad9-b7b3-4571-9f35-672f335ce5e1 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:50.967339 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a10ad9-b7b3-4571-9f35-672f335ce5e1 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:50.967841 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a10ad9-b7b3-4571-9f35-672f335ce5e1 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:50.970222 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 169/340] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:50.982830 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b38bad-94e9-40a7-a6a4-4472fef944f1 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:50.983561 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b38bad-94e9-40a7-a6a4-4472fef944f1 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:50.984053 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b38bad-94e9-40a7-a6a4-4472fef944f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.009405 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-60b38bad-94e9-40a7-a6a4-4472fef944f1 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:51.011088 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-60b38bad-94e9-40a7-a6a4-4472fef944f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:51.012045 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b8644-f9dc-411a-a389-ab50bd2a1582 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.012632 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b8644-f9dc-411a-a389-ab50bd2a1582 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.013129 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b8644-f9dc-411a-a389-ab50bd2a1582 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.015333 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 170/341] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:51.027106 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41d00e-3357-457a-b46e-b81cba81462f None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.027730 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41d00e-3357-457a-b46e-b81cba81462f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.028136 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 172/342] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:51.028451 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41d00e-3357-457a-b46e-b81cba81462f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.058512 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-7f41d00e-3357-457a-b46e-b81cba81462f None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:51.060073 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-7f41d00e-3357-457a-b46e-b81cba81462f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:51.071218 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 171/343] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:51.077108 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b38bad-94e9-40a7-a6a4-4472fef944f1 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:51.093071 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b38bad-94e9-40a7-a6a4-4472fef944f1 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:51.098380 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41d00e-3357-457a-b46e-b81cba81462f None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:51.101172 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43033233-51f3-45e1-8924-7d6029a8eeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:51.102004 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43033233-51f3-45e1-8924-7d6029a8eeeb admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.102288 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43033233-51f3-45e1-8924-7d6029a8eeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.102566 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43033233-51f3-45e1-8924-7d6029a8eeeb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.112116 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41d00e-3357-457a-b46e-b81cba81462f None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:51.122258 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf54e6-4063-47c6-8797-b8a4b4f7252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:51.123376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf54e6-4063-47c6-8797-b8a4b4f7252e admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.124572 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf54e6-4063-47c6-8797-b8a4b4f7252e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.127021 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf54e6-4063-47c6-8797-b8a4b4f7252e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.129859 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43033233-51f3-45e1-8924-7d6029a8eeeb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:51.136703 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-43033233-51f3-45e1-8924-7d6029a8eeeb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 17:37:51.138042 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 173/344] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:51.144823 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43033233-51f3-45e1-8924-7d6029a8eeeb admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:51.149538 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf54e6-4063-47c6-8797-b8a4b4f7252e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:51.156549 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-5ecf54e6-4063-47c6-8797-b8a4b4f7252e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 17:37:51.161003 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 172/345] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:37:51.161141 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43033233-51f3-45e1-8924-7d6029a8eeeb admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:51.163835 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf54e6-4063-47c6-8797-b8a4b4f7252e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:51.175268 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627611b-a2f2-4077-bd0f-242239a4cbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:51.175966 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627611b-a2f2-4077-bd0f-242239a4cbda admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.176248 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627611b-a2f2-4077-bd0f-242239a4cbda admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.176522 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627611b-a2f2-4077-bd0f-242239a4cbda admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.177422 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627611b-a2f2-4077-bd0f-242239a4cbda admin admin] RBAC: Adding query filter params (name=member) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:51.177736 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627611b-a2f2-4077-bd0f-242239a4cbda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:51.179445 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627611b-a2f2-4077-bd0f-242239a4cbda admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:51.183589 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf54e6-4063-47c6-8797-b8a4b4f7252e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:51.194878 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fe3ef-99e8-4188-bf84-e0851f3e2bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:51.195558 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fe3ef-99e8-4188-bf84-e0851f3e2bad admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.195865 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fe3ef-99e8-4188-bf84-e0851f3e2bad admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.196115 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fe3ef-99e8-4188-bf84-e0851f3e2bad admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.196913 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49fe3ef-99e8-4188-bf84-e0851f3e2bad admin admin] RBAC: Adding query filter params (name=member) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:51.197221 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49fe3ef-99e8-4188-bf84-e0851f3e2bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:51.198863 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49fe3ef-99e8-4188-bf84-e0851f3e2bad admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:51.202740 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 174/346] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:51.215134 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 173/347] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:51.216563 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627611b-a2f2-4077-bd0f-242239a4cbda admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:51.223474 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fe3ef-99e8-4188-bf84-e0851f3e2bad admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:51.231628 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627611b-a2f2-4077-bd0f-242239a4cbda admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:51.238873 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846a042-d5d0-4946-8358-aa34b2847cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:51.239471 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846a042-d5d0-4946-8358-aa34b2847cec admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.239757 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846a042-d5d0-4946-8358-aa34b2847cec admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.240033 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846a042-d5d0-4946-8358-aa34b2847cec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.247244 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fe3ef-99e8-4188-bf84-e0851f3e2bad admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:51.253631 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846a042-d5d0-4946-8358-aa34b2847cec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:51.255427 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846a042-d5d0-4946-8358-aa34b2847cec admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:51.261572 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e66b1-b3f4-4a9e-8403-9cabc92279fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:51.262375 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e66b1-b3f4-4a9e-8403-9cabc92279fb admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.262499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e66b1-b3f4-4a9e-8403-9cabc92279fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.262764 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e66b1-b3f4-4a9e-8403-9cabc92279fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.271662 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 175/348] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:51.275461 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e66b1-b3f4-4a9e-8403-9cabc92279fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:51.277324 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e66b1-b3f4-4a9e-8403-9cabc92279fb admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:51.277980 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846a042-d5d0-4946-8358-aa34b2847cec admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:51.291642 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846a042-d5d0-4946-8358-aa34b2847cec admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:51.292047 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 174/349] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:51.297834 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e66b1-b3f4-4a9e-8403-9cabc92279fb admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:51.302730 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d1820-a95b-437e-9794-afdebdc0bb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:51.303620 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d1820-a95b-437e-9794-afdebdc0bb2d admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.303904 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d1820-a95b-437e-9794-afdebdc0bb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.304181 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d1820-a95b-437e-9794-afdebdc0bb2d admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.305447 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d1820-a95b-437e-9794-afdebdc0bb2d admin admin] RBAC: Authorizing `identity:get_project(project_id=3e853ee55e324805acbbf0aff75277c3)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:51.308507 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d1820-a95b-437e-9794-afdebdc0bb2d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:51.309812 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e66b1-b3f4-4a9e-8403-9cabc92279fb admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:51.314929 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 176/350] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:51 2022] GET /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:51.315999 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d1820-a95b-437e-9794-afdebdc0bb2d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:51.326557 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419123e9-0119-4995-ab70-3b6b8fd4683c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:51.327501 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419123e9-0119-4995-ab70-3b6b8fd4683c admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.327716 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419123e9-0119-4995-ab70-3b6b8fd4683c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.328015 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419123e9-0119-4995-ab70-3b6b8fd4683c admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.330969 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d1820-a95b-437e-9794-afdebdc0bb2d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:51.333695 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419123e9-0119-4995-ab70-3b6b8fd4683c admin admin] RBAC: Authorizing `identity:get_project(project_id=f7f01e6ad70a496b8b8df89a6b770b4c)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:51.335750 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419123e9-0119-4995-ab70-3b6b8fd4683c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:51.337839 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 175/351] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:51 2022] GET /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:51.342980 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419123e9-0119-4995-ab70-3b6b8fd4683c admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:51.345144 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359424d4-92d1-420e-beab-97065d343da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:51.346036 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359424d4-92d1-420e-beab-97065d343da9 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.346318 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359424d4-92d1-420e-beab-97065d343da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.346661 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359424d4-92d1-420e-beab-97065d343da9 admin admin] PATH_INFO: `/v3/groups/233427fb69b44494afbf0c690d57c9b0` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.358951 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359424d4-92d1-420e-beab-97065d343da9 admin admin] RBAC: Authorizing `identity:get_group(group_id=233427fb69b44494afbf0c690d57c9b0)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:51.360011 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING py.warnings [None req-359424d4-92d1-420e-beab-97065d343da9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:37:51.360011 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: warnings.warn(msg) Jan 10 17:37:51.360011 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: Jan 10 17:37:51.361300 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359424d4-92d1-420e-beab-97065d343da9 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:51.366980 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419123e9-0119-4995-ab70-3b6b8fd4683c admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:51.367681 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 177/352] 10.222.0.31 () {56 vars in 1201 bytes} [Mon Jan 10 17:37:51 2022] GET /identity/v3/groups/233427fb69b44494afbf0c690d57c9b0 => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:51.370436 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359424d4-92d1-420e-beab-97065d343da9 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:51.380966 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f23c3a-c12f-4aef-94e7-7fa32bd8893a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:51.382126 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f23c3a-c12f-4aef-94e7-7fa32bd8893a admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.382408 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f23c3a-c12f-4aef-94e7-7fa32bd8893a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.382681 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f23c3a-c12f-4aef-94e7-7fa32bd8893a admin admin] PATH_INFO: `/v3/groups/233427fb69b44494afbf0c690d57c9b0` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.384035 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f23c3a-c12f-4aef-94e7-7fa32bd8893a admin admin] RBAC: Authorizing `identity:get_group(group_id=233427fb69b44494afbf0c690d57c9b0)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:51.385103 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING py.warnings [None req-09f23c3a-c12f-4aef-94e7-7fa32bd8893a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:37:51.385103 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: warnings.warn(msg) Jan 10 17:37:51.385103 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: Jan 10 17:37:51.386322 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f23c3a-c12f-4aef-94e7-7fa32bd8893a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:51.386969 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359424d4-92d1-420e-beab-97065d343da9 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:51.392735 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 176/353] 10.222.0.31 () {56 vars in 1201 bytes} [Mon Jan 10 17:37:51 2022] GET /identity/v3/groups/233427fb69b44494afbf0c690d57c9b0 => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:51.394038 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f23c3a-c12f-4aef-94e7-7fa32bd8893a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:51.405569 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f23c3a-c12f-4aef-94e7-7fa32bd8893a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:51.407466 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7179c1-8ba7-49bb-9397-3f4760afdd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:51.408272 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7179c1-8ba7-49bb-9397-3f4760afdd02 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.408659 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7179c1-8ba7-49bb-9397-3f4760afdd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.409113 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7179c1-8ba7-49bb-9397-3f4760afdd02 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.409986 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7179c1-8ba7-49bb-9397-3f4760afdd02 admin admin] RBAC: Adding query filter params (group.id=233427fb69b44494afbf0c690d57c9b0, role.id=3c8f0c77d36b49608a0e17cfcff15691, scope.project.id=3e853ee55e324805acbbf0aff75277c3) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:51.410340 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7179c1-8ba7-49bb-9397-3f4760afdd02 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:51.412363 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7179c1-8ba7-49bb-9397-3f4760afdd02 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:51.412536 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94b231-b008-4b5d-be76-394ed9c1b588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:51.413242 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94b231-b008-4b5d-be76-394ed9c1b588 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.413525 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94b231-b008-4b5d-be76-394ed9c1b588 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.413897 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94b231-b008-4b5d-be76-394ed9c1b588 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.414750 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94b231-b008-4b5d-be76-394ed9c1b588 admin admin] RBAC: Adding query filter params (group.id=233427fb69b44494afbf0c690d57c9b0, role.id=3c8f0c77d36b49608a0e17cfcff15691, scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:51.415109 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94b231-b008-4b5d-be76-394ed9c1b588 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:51.417142 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94b231-b008-4b5d-be76-394ed9c1b588 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:51.423000 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 178/354] 10.222.0.31 () {56 vars in 1397 bytes} [Mon Jan 10 17:37:51 2022] GET /identity/v3/role_assignments?group.id=233427fb69b44494afbf0c690d57c9b0&scope.project.id=3e853ee55e324805acbbf0aff75277c3&role.id=3c8f0c77d36b49608a0e17cfcff15691 => generated 260 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:51.424907 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf46cc-04f6-42c8-91c1-ed7886454980 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.424907 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf46cc-04f6-42c8-91c1-ed7886454980 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.424907 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf46cc-04f6-42c8-91c1-ed7886454980 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.426821 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 179/355] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:51.430844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 177/356] 10.222.0.31 () {56 vars in 1397 bytes} [Mon Jan 10 17:37:51 2022] GET /identity/v3/role_assignments?group.id=233427fb69b44494afbf0c690d57c9b0&scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c&role.id=3c8f0c77d36b49608a0e17cfcff15691 => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:51.450724 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655edc5-56ba-4b7f-94f0-5907dd505059 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.451040 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655edc5-56ba-4b7f-94f0-5907dd505059 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.451287 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655edc5-56ba-4b7f-94f0-5907dd505059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.478718 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b655edc5-56ba-4b7f-94f0-5907dd505059 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:51.479918 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b655edc5-56ba-4b7f-94f0-5907dd505059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:51.495194 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 180/357] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:51.533486 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94b231-b008-4b5d-be76-394ed9c1b588 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:51.549555 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94b231-b008-4b5d-be76-394ed9c1b588 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:51.557350 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06332184-766a-4130-bd0d-4cc07bdfacbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:51.558194 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06332184-766a-4130-bd0d-4cc07bdfacbe admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.558478 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06332184-766a-4130-bd0d-4cc07bdfacbe admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.558752 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06332184-766a-4130-bd0d-4cc07bdfacbe admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.577691 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06332184-766a-4130-bd0d-4cc07bdfacbe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:51.585223 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-06332184-766a-4130-bd0d-4cc07bdfacbe admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 17:37:51.586846 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 178/358] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:37:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:51.592767 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655edc5-56ba-4b7f-94f0-5907dd505059 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:51.606470 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655edc5-56ba-4b7f-94f0-5907dd505059 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:51.616916 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcebb22-74d0-4ff0-a5cd-dc4739680c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:51.617622 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcebb22-74d0-4ff0-a5cd-dc4739680c7e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.617908 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcebb22-74d0-4ff0-a5cd-dc4739680c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.618182 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcebb22-74d0-4ff0-a5cd-dc4739680c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.618966 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcebb22-74d0-4ff0-a5cd-dc4739680c7e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:51.619279 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcebb22-74d0-4ff0-a5cd-dc4739680c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:51.620958 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcebb22-74d0-4ff0-a5cd-dc4739680c7e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:51.633350 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 181/359] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:37:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:51.639061 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06332184-766a-4130-bd0d-4cc07bdfacbe admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:51.655062 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06332184-766a-4130-bd0d-4cc07bdfacbe admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:51.661152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774dffd-008d-4798-9bfa-ec40ee15f8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:51.661810 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774dffd-008d-4798-9bfa-ec40ee15f8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.662095 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774dffd-008d-4798-9bfa-ec40ee15f8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.662360 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774dffd-008d-4798-9bfa-ec40ee15f8b6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.673704 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774dffd-008d-4798-9bfa-ec40ee15f8b6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:51.675829 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774dffd-008d-4798-9bfa-ec40ee15f8b6 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:51.689841 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 179/360] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:51.695497 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcebb22-74d0-4ff0-a5cd-dc4739680c7e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:51.710413 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcebb22-74d0-4ff0-a5cd-dc4739680c7e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:51.726745 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371f698-7395-421e-afc9-3d694bbef111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:51.727642 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371f698-7395-421e-afc9-3d694bbef111 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.727932 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371f698-7395-421e-afc9-3d694bbef111 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.728213 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371f698-7395-421e-afc9-3d694bbef111 admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.734594 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371f698-7395-421e-afc9-3d694bbef111 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e853ee55e324805acbbf0aff75277c3)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:51.736706 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371f698-7395-421e-afc9-3d694bbef111 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:51.742754 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 182/361] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:51 2022] GET /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:51.749677 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774dffd-008d-4798-9bfa-ec40ee15f8b6 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:51.760585 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774dffd-008d-4798-9bfa-ec40ee15f8b6 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:51.770659 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b790c-23d8-420f-b60f-c8b2cdd24fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:51.771550 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b790c-23d8-420f-b60f-c8b2cdd24fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.771858 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b790c-23d8-420f-b60f-c8b2cdd24fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.772113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b790c-23d8-420f-b60f-c8b2cdd24fa1 admin admin] PATH_INFO: `/v3/groups/233427fb69b44494afbf0c690d57c9b0` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.773736 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b790c-23d8-420f-b60f-c8b2cdd24fa1 admin admin] RBAC: Authorizing `identity:get_group(group_id=233427fb69b44494afbf0c690d57c9b0)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:51.775849 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b790c-23d8-420f-b60f-c8b2cdd24fa1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:51.777835 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 180/362] 10.222.0.31 () {56 vars in 1201 bytes} [Mon Jan 10 17:37:51 2022] GET /identity/v3/groups/233427fb69b44494afbf0c690d57c9b0 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:51.783422 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371f698-7395-421e-afc9-3d694bbef111 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:51.796608 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371f698-7395-421e-afc9-3d694bbef111 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:51.804263 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cd751-02b6-4ba4-b59f-fa8c1b8cd66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:51.805003 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cd751-02b6-4ba4-b59f-fa8c1b8cd66c admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:51.805289 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cd751-02b6-4ba4-b59f-fa8c1b8cd66c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:51.805562 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cd751-02b6-4ba4-b59f-fa8c1b8cd66c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:51.806417 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cd751-02b6-4ba4-b59f-fa8c1b8cd66c admin admin] RBAC: Adding query filter params (group.id=233427fb69b44494afbf0c690d57c9b0, role.id=112bab30f846403ea40d96a74a04af2c, scope.project.id=3e853ee55e324805acbbf0aff75277c3) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:51.806730 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cd751-02b6-4ba4-b59f-fa8c1b8cd66c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:51.808599 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cd751-02b6-4ba4-b59f-fa8c1b8cd66c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:51.818025 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 183/363] 10.222.0.31 () {56 vars in 1397 bytes} [Mon Jan 10 17:37:51 2022] GET /identity/v3/role_assignments?group.id=233427fb69b44494afbf0c690d57c9b0&scope.project.id=3e853ee55e324805acbbf0aff75277c3&role.id=112bab30f846403ea40d96a74a04af2c => generated 260 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:52.113850 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b0497-33ea-42e0-8c23-893782a0a6ff None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:52.114537 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b0497-33ea-42e0-8c23-893782a0a6ff None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:52.115044 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b0497-33ea-42e0-8c23-893782a0a6ff None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:52.117472 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 181/364] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:52.124354 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c99afc-d152-4605-b0fe-e834f7aa3093 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:52.125094 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c99afc-d152-4605-b0fe-e834f7aa3093 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:52.125582 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c99afc-d152-4605-b0fe-e834f7aa3093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:52.146786 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-36c99afc-d152-4605-b0fe-e834f7aa3093 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:52.148703 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-36c99afc-d152-4605-b0fe-e834f7aa3093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:52.157945 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 184/365] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:52.184170 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b0497-33ea-42e0-8c23-893782a0a6ff None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:52.197533 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b0497-33ea-42e0-8c23-893782a0a6ff None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:52.203335 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c630fb-aa83-47ee-9223-e79ed2a6c84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:52.204513 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c630fb-aa83-47ee-9223-e79ed2a6c84e admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:52.205095 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c630fb-aa83-47ee-9223-e79ed2a6c84e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:52.205610 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c630fb-aa83-47ee-9223-e79ed2a6c84e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:52.223288 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c630fb-aa83-47ee-9223-e79ed2a6c84e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:52.231163 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-b4c630fb-aa83-47ee-9223-e79ed2a6c84e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 17:37:52.232605 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 182/366] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:37:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:52.238678 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c99afc-d152-4605-b0fe-e834f7aa3093 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:52.248341 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c99afc-d152-4605-b0fe-e834f7aa3093 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:52.257376 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e01ecb-be2c-4b52-a3d4-31fa97c34320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:52.258479 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e01ecb-be2c-4b52-a3d4-31fa97c34320 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:52.258970 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e01ecb-be2c-4b52-a3d4-31fa97c34320 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:52.259435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e01ecb-be2c-4b52-a3d4-31fa97c34320 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:52.260483 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e01ecb-be2c-4b52-a3d4-31fa97c34320 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:52.261069 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e01ecb-be2c-4b52-a3d4-31fa97c34320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:52.262916 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e01ecb-be2c-4b52-a3d4-31fa97c34320 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:52.277545 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 185/367] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:37:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:52.283474 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c630fb-aa83-47ee-9223-e79ed2a6c84e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:52.298550 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c630fb-aa83-47ee-9223-e79ed2a6c84e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:52.313731 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5d91e-fbb8-40f3-91c4-e885de1d0b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:52.314405 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5d91e-fbb8-40f3-91c4-e885de1d0b28 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:52.314689 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5d91e-fbb8-40f3-91c4-e885de1d0b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:52.314964 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5d91e-fbb8-40f3-91c4-e885de1d0b28 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:52.333377 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5d91e-fbb8-40f3-91c4-e885de1d0b28 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:52.335159 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5d91e-fbb8-40f3-91c4-e885de1d0b28 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:52.347882 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 183/368] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:52.355311 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e01ecb-be2c-4b52-a3d4-31fa97c34320 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:52.366853 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e01ecb-be2c-4b52-a3d4-31fa97c34320 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:52.377851 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8da3df-f077-4b8c-be99-e6ee19f7cc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:52.379134 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8da3df-f077-4b8c-be99-e6ee19f7cc0f admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:52.379665 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8da3df-f077-4b8c-be99-e6ee19f7cc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:52.380142 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8da3df-f077-4b8c-be99-e6ee19f7cc0f admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:52.381655 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8da3df-f077-4b8c-be99-e6ee19f7cc0f admin admin] RBAC: Authorizing `identity:get_project(project_id=f7f01e6ad70a496b8b8df89a6b770b4c)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:52.384078 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8da3df-f077-4b8c-be99-e6ee19f7cc0f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:52.386067 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 186/369] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:52 2022] GET /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:52.394868 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5d91e-fbb8-40f3-91c4-e885de1d0b28 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:52.409988 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5d91e-fbb8-40f3-91c4-e885de1d0b28 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:52.416839 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb11e6a-467d-47a5-8e1e-8f299abf8293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:52.417722 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb11e6a-467d-47a5-8e1e-8f299abf8293 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:52.417998 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb11e6a-467d-47a5-8e1e-8f299abf8293 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:52.418269 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb11e6a-467d-47a5-8e1e-8f299abf8293 admin admin] PATH_INFO: `/v3/groups/233427fb69b44494afbf0c690d57c9b0` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:52.425617 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb11e6a-467d-47a5-8e1e-8f299abf8293 admin admin] RBAC: Authorizing `identity:get_group(group_id=233427fb69b44494afbf0c690d57c9b0)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:52.427536 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb11e6a-467d-47a5-8e1e-8f299abf8293 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:52.429528 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 184/370] 10.222.0.31 () {56 vars in 1201 bytes} [Mon Jan 10 17:37:52 2022] GET /identity/v3/groups/233427fb69b44494afbf0c690d57c9b0 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:52.435727 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8da3df-f077-4b8c-be99-e6ee19f7cc0f admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:52.446601 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8da3df-f077-4b8c-be99-e6ee19f7cc0f admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:52.455637 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3758a-7f84-4e5e-ad37-db2e1e27a044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:52.456679 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3758a-7f84-4e5e-ad37-db2e1e27a044 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:52.457170 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3758a-7f84-4e5e-ad37-db2e1e27a044 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:52.457686 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3758a-7f84-4e5e-ad37-db2e1e27a044 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:52.458769 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3758a-7f84-4e5e-ad37-db2e1e27a044 admin admin] RBAC: Adding query filter params (group.id=233427fb69b44494afbf0c690d57c9b0, role.id=112bab30f846403ea40d96a74a04af2c, scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:52.459277 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3758a-7f84-4e5e-ad37-db2e1e27a044 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:52.461514 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3758a-7f84-4e5e-ad37-db2e1e27a044 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:52.475055 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 187/371] 10.222.0.31 () {56 vars in 1397 bytes} [Mon Jan 10 17:37:52 2022] GET /identity/v3/role_assignments?group.id=233427fb69b44494afbf0c690d57c9b0&scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c&role.id=112bab30f846403ea40d96a74a04af2c => generated 260 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:52.616785 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d8770-9985-41e1-8022-2ed32ab92aec None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:52.617381 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d8770-9985-41e1-8022-2ed32ab92aec None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:52.617381 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d8770-9985-41e1-8022-2ed32ab92aec None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:52.619443 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 185/372] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:52.624762 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264be45c-b1cf-47e7-aee0-cf1b0c4434d7 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:52.625303 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264be45c-b1cf-47e7-aee0-cf1b0c4434d7 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:52.625379 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264be45c-b1cf-47e7-aee0-cf1b0c4434d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:52.649814 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-264be45c-b1cf-47e7-aee0-cf1b0c4434d7 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:52.651068 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-264be45c-b1cf-47e7-aee0-cf1b0c4434d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:52.663803 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 188/373] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:37:52.701898 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d8770-9985-41e1-8022-2ed32ab92aec None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:52.722885 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d8770-9985-41e1-8022-2ed32ab92aec None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:52.737147 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1d7c7-2c1b-4dd1-bf70-98ef5ec76fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:52.737971 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1d7c7-2c1b-4dd1-bf70-98ef5ec76fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:52.738256 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1d7c7-2c1b-4dd1-bf70-98ef5ec76fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:52.738535 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1d7c7-2c1b-4dd1-bf70-98ef5ec76fb2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:52.765322 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1d7c7-2c1b-4dd1-bf70-98ef5ec76fb2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:52.777761 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-8db1d7c7-2c1b-4dd1-bf70-98ef5ec76fb2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:37:52.782555 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 186/374] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:37:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:52.785411 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264be45c-b1cf-47e7-aee0-cf1b0c4434d7 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:52.799349 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264be45c-b1cf-47e7-aee0-cf1b0c4434d7 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:52.814502 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f08eaa-54c9-4e74-a784-e40b661cddde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:52.815261 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f08eaa-54c9-4e74-a784-e40b661cddde admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:52.815545 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f08eaa-54c9-4e74-a784-e40b661cddde admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:52.815821 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f08eaa-54c9-4e74-a784-e40b661cddde admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:52.816602 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f08eaa-54c9-4e74-a784-e40b661cddde admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:52.816930 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f08eaa-54c9-4e74-a784-e40b661cddde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:52.818570 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f08eaa-54c9-4e74-a784-e40b661cddde admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:52.836475 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 189/375] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:52.842012 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1d7c7-2c1b-4dd1-bf70-98ef5ec76fb2 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:52.857909 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1d7c7-2c1b-4dd1-bf70-98ef5ec76fb2 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:52.864992 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0f91d-467b-434c-ba8a-fd30e4630618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:52.865649 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0f91d-467b-434c-ba8a-fd30e4630618 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:52.865932 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0f91d-467b-434c-ba8a-fd30e4630618 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:52.866208 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0f91d-467b-434c-ba8a-fd30e4630618 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:52.885089 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0f91d-467b-434c-ba8a-fd30e4630618 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:52.886852 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0f91d-467b-434c-ba8a-fd30e4630618 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:52.898892 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 187/376] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:52.904622 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f08eaa-54c9-4e74-a784-e40b661cddde admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:52.918039 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f08eaa-54c9-4e74-a784-e40b661cddde admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:52.928864 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95068a-28af-4be3-8e32-d5d331e79fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:52.929761 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95068a-28af-4be3-8e32-d5d331e79fdf admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:52.930050 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95068a-28af-4be3-8e32-d5d331e79fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:52.930321 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95068a-28af-4be3-8e32-d5d331e79fdf admin admin] PATH_INFO: `/v3/projects/ef5870ae6e4a4492ac99ab89391674b9` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:52.931546 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95068a-28af-4be3-8e32-d5d331e79fdf admin admin] RBAC: Authorizing `identity:get_project(project_id=ef5870ae6e4a4492ac99ab89391674b9)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:52.933412 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95068a-28af-4be3-8e32-d5d331e79fdf admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:52.935415 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 190/377] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:52 2022] GET /identity/v3/projects/ef5870ae6e4a4492ac99ab89391674b9 => generated 344 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:52.940938 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0f91d-467b-434c-ba8a-fd30e4630618 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:52.951187 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0f91d-467b-434c-ba8a-fd30e4630618 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:52.959745 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f7757-3ca9-4e73-9192-cb91b3dbd502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:52.960915 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f7757-3ca9-4e73-9192-cb91b3dbd502 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:52.961429 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f7757-3ca9-4e73-9192-cb91b3dbd502 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:52.961904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f7757-3ca9-4e73-9192-cb91b3dbd502 admin admin] PATH_INFO: `/v3/groups/9a3cfd4b8afe49aba4e83a67aed62967` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:52.973614 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f7757-3ca9-4e73-9192-cb91b3dbd502 admin admin] RBAC: Authorizing `identity:get_group(group_id=9a3cfd4b8afe49aba4e83a67aed62967)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:52.975842 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f7757-3ca9-4e73-9192-cb91b3dbd502 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:52.977761 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 188/378] 10.222.0.31 () {56 vars in 1201 bytes} [Mon Jan 10 17:37:52 2022] GET /identity/v3/groups/9a3cfd4b8afe49aba4e83a67aed62967 => generated 229 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:52.983589 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95068a-28af-4be3-8e32-d5d331e79fdf admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:52.997898 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95068a-28af-4be3-8e32-d5d331e79fdf admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:53.004839 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70f1b6-be6a-4d03-affd-f46015368d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:53.005518 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70f1b6-be6a-4d03-affd-f46015368d96 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:53.005809 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70f1b6-be6a-4d03-affd-f46015368d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:53.006086 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70f1b6-be6a-4d03-affd-f46015368d96 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:53.006937 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70f1b6-be6a-4d03-affd-f46015368d96 admin admin] RBAC: Adding query filter params (group.id=9a3cfd4b8afe49aba4e83a67aed62967, role.id=3c05bedf79e04eb38d2ae66736030bfe, scope.project.id=ef5870ae6e4a4492ac99ab89391674b9) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:53.007249 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70f1b6-be6a-4d03-affd-f46015368d96 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:53.009144 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70f1b6-be6a-4d03-affd-f46015368d96 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:53.021317 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 191/379] 10.222.0.31 () {56 vars in 1397 bytes} [Mon Jan 10 17:37:52 2022] GET /identity/v3/role_assignments?group.id=9a3cfd4b8afe49aba4e83a67aed62967&scope.project.id=ef5870ae6e4a4492ac99ab89391674b9&role.id=3c05bedf79e04eb38d2ae66736030bfe => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:54.482074 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4791f-4e39-44e8-b844-561838612af5 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:54.483108 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4791f-4e39-44e8-b844-561838612af5 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:54.483587 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4791f-4e39-44e8-b844-561838612af5 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:54.485865 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 189/380] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:54.498448 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b736e7-6ab8-4c3a-8468-132780019b61 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:54.498956 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b736e7-6ab8-4c3a-8468-132780019b61 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:54.499040 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b736e7-6ab8-4c3a-8468-132780019b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:54.520649 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-d9b736e7-6ab8-4c3a-8468-132780019b61 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:54.521846 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-d9b736e7-6ab8-4c3a-8468-132780019b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:54.535639 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 192/381] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:54.572514 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4791f-4e39-44e8-b844-561838612af5 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:54.594395 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4791f-4e39-44e8-b844-561838612af5 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:54.599231 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b4e44-8ad4-4fff-9559-cd3f1752a475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:54.600269 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b4e44-8ad4-4fff-9559-cd3f1752a475 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:54.600740 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b4e44-8ad4-4fff-9559-cd3f1752a475 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:54.601238 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b4e44-8ad4-4fff-9559-cd3f1752a475 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:54.612708 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b4e44-8ad4-4fff-9559-cd3f1752a475 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:54.622442 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-362b4e44-8ad4-4fff-9559-cd3f1752a475 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 17:37:54.623921 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 190/382] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:54.629776 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b736e7-6ab8-4c3a-8468-132780019b61 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:54.641763 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b736e7-6ab8-4c3a-8468-132780019b61 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:54.650312 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbace7-e501-46ee-bbaf-6f60b8ef88f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:54.650993 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbace7-e501-46ee-bbaf-6f60b8ef88f1 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:54.651269 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbace7-e501-46ee-bbaf-6f60b8ef88f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:54.651539 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbace7-e501-46ee-bbaf-6f60b8ef88f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:54.652309 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbace7-e501-46ee-bbaf-6f60b8ef88f1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:54.652610 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbace7-e501-46ee-bbaf-6f60b8ef88f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:54.654260 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbace7-e501-46ee-bbaf-6f60b8ef88f1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:54.667615 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 193/383] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:54.673227 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b4e44-8ad4-4fff-9559-cd3f1752a475 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:54.685314 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b4e44-8ad4-4fff-9559-cd3f1752a475 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:54.693126 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14924ef9-db76-4639-9147-927c6f1b2755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:54.694235 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14924ef9-db76-4639-9147-927c6f1b2755 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:54.694718 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14924ef9-db76-4639-9147-927c6f1b2755 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:54.695200 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14924ef9-db76-4639-9147-927c6f1b2755 admin admin] PATH_INFO: `/v3/groups/233427fb69b44494afbf0c690d57c9b0` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:54.696660 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14924ef9-db76-4639-9147-927c6f1b2755 admin admin] RBAC: Authorizing `identity:get_group(group_id=233427fb69b44494afbf0c690d57c9b0)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:54.698993 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14924ef9-db76-4639-9147-927c6f1b2755 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:54.700879 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 191/384] 10.222.0.31 () {56 vars in 1201 bytes} [Mon Jan 10 17:37:54 2022] GET /identity/v3/groups/233427fb69b44494afbf0c690d57c9b0 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:54.706401 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbace7-e501-46ee-bbaf-6f60b8ef88f1 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:54.727339 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbace7-e501-46ee-bbaf-6f60b8ef88f1 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:54.740565 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1a1d9-f428-4112-84dc-7d2b345cceec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:54.741488 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1a1d9-f428-4112-84dc-7d2b345cceec admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:54.741760 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1a1d9-f428-4112-84dc-7d2b345cceec admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:54.742031 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1a1d9-f428-4112-84dc-7d2b345cceec admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:54.743246 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1a1d9-f428-4112-84dc-7d2b345cceec admin admin] RBAC: Authorizing `identity:get_project(project_id=f7f01e6ad70a496b8b8df89a6b770b4c)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:54.745340 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1a1d9-f428-4112-84dc-7d2b345cceec admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:54.747328 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 194/385] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:54 2022] GET /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:54.752717 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14924ef9-db76-4639-9147-927c6f1b2755 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:54.770199 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14924ef9-db76-4639-9147-927c6f1b2755 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:54.785748 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe90296-b7cf-48cd-abf1-5d9b67b68950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:54.786668 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe90296-b7cf-48cd-abf1-5d9b67b68950 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:54.786948 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe90296-b7cf-48cd-abf1-5d9b67b68950 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:54.787219 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe90296-b7cf-48cd-abf1-5d9b67b68950 admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c/groups/233427fb69b44494afbf0c690d57c9b0/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:54.789354 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe90296-b7cf-48cd-abf1-5d9b67b68950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f01e6ad70a496b8b8df89a6b770b4c, group_id=233427fb69b44494afbf0c690d57c9b0, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:54.791991 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe90296-b7cf-48cd-abf1-5d9b67b68950 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:54.817559 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 192/386] 10.222.0.31 () {58 vars in 1463 bytes} [Mon Jan 10 17:37:54 2022] PUT /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c/groups/233427fb69b44494afbf0c690d57c9b0/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:37:54.966238 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f4b6f-9494-42a6-97a5-d7497a5d7158 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:54.966879 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f4b6f-9494-42a6-97a5-d7497a5d7158 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:54.967383 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f4b6f-9494-42a6-97a5-d7497a5d7158 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:54.969714 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 195/387] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:54.976060 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7078049-b33d-42a5-9c92-c5e0de903ddf None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:54.976634 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7078049-b33d-42a5-9c92-c5e0de903ddf None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:54.977142 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7078049-b33d-42a5-9c92-c5e0de903ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:55.001729 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-a7078049-b33d-42a5-9c92-c5e0de903ddf None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:55.003346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a7078049-b33d-42a5-9c92-c5e0de903ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:55.072347 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4f909-6048-4261-a4c4-f308be38e861 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:55.072683 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4f909-6048-4261-a4c4-f308be38e861 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:55.072970 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4f909-6048-4261-a4c4-f308be38e861 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:55.074727 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 196/388] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:37:55.083042 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 193/389] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:55.090992 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d527c-a95f-4780-b797-ae58bf17cccc None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:55.091288 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d527c-a95f-4780-b797-ae58bf17cccc None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:55.091558 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d527c-a95f-4780-b797-ae58bf17cccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:55.112387 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7078049-b33d-42a5-9c92-c5e0de903ddf None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:55.125438 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7078049-b33d-42a5-9c92-c5e0de903ddf None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:55.129952 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b07d527c-a95f-4780-b797-ae58bf17cccc None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:55.131176 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b07d527c-a95f-4780-b797-ae58bf17cccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:55.132451 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d385d7-1d5c-49a1-94f1-0a8b41d50550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:55.133770 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d385d7-1d5c-49a1-94f1-0a8b41d50550 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:55.134243 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d385d7-1d5c-49a1-94f1-0a8b41d50550 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:55.134709 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d385d7-1d5c-49a1-94f1-0a8b41d50550 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:55.144573 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 197/390] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:55.149660 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d385d7-1d5c-49a1-94f1-0a8b41d50550 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:55.157581 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-68d385d7-1d5c-49a1-94f1-0a8b41d50550 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 17:37:55.159724 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 194/391] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:37:55.166302 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d527c-a95f-4780-b797-ae58bf17cccc None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:55.177181 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d527c-a95f-4780-b797-ae58bf17cccc None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:55.182362 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e01f48-0a83-42f1-84c6-014537f8241e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:55.184441 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d385d7-1d5c-49a1-94f1-0a8b41d50550 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:55.185177 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e01f48-0a83-42f1-84c6-014537f8241e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:55.185497 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e01f48-0a83-42f1-84c6-014537f8241e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:55.185776 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e01f48-0a83-42f1-84c6-014537f8241e admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:55.186616 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e01f48-0a83-42f1-84c6-014537f8241e admin admin] RBAC: Adding query filter params (name=member) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:55.186926 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e01f48-0a83-42f1-84c6-014537f8241e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:55.188597 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e01f48-0a83-42f1-84c6-014537f8241e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:55.203192 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d385d7-1d5c-49a1-94f1-0a8b41d50550 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:55.211541 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 198/392] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:55.212912 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e01f48-0a83-42f1-84c6-014537f8241e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:55.213935 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e7648-273e-4055-a7f0-217d3e438e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:55.215168 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e7648-273e-4055-a7f0-217d3e438e3e admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:55.215693 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e7648-273e-4055-a7f0-217d3e438e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:55.216160 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e7648-273e-4055-a7f0-217d3e438e3e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:55.232344 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e7648-273e-4055-a7f0-217d3e438e3e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:55.233494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e01f48-0a83-42f1-84c6-014537f8241e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:55.241195 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-f29e7648-273e-4055-a7f0-217d3e438e3e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 17:37:55.243263 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 195/393] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:37:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:37:55.245148 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b3ba8-ecab-4142-91d4-c1f6fa085086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:55.246018 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b3ba8-ecab-4142-91d4-c1f6fa085086 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:55.246295 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b3ba8-ecab-4142-91d4-c1f6fa085086 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:55.246561 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b3ba8-ecab-4142-91d4-c1f6fa085086 admin admin] PATH_INFO: `/v3/groups/233427fb69b44494afbf0c690d57c9b0` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:55.247735 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b3ba8-ecab-4142-91d4-c1f6fa085086 admin admin] RBAC: Authorizing `identity:get_group(group_id=233427fb69b44494afbf0c690d57c9b0)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:55.251316 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b3ba8-ecab-4142-91d4-c1f6fa085086 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:55.251575 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 199/394] 10.222.0.31 () {56 vars in 1201 bytes} [Mon Jan 10 17:37:55 2022] GET /identity/v3/groups/233427fb69b44494afbf0c690d57c9b0 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:55.258371 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b3ba8-ecab-4142-91d4-c1f6fa085086 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:55.258704 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e7648-273e-4055-a7f0-217d3e438e3e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:55.271373 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b3ba8-ecab-4142-91d4-c1f6fa085086 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:55.275422 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e7648-273e-4055-a7f0-217d3e438e3e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:55.281550 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afcd1d-ccb9-495a-8a36-122cc40a2f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:55.282425 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afcd1d-ccb9-495a-8a36-122cc40a2f12 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:55.282699 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afcd1d-ccb9-495a-8a36-122cc40a2f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:55.282971 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afcd1d-ccb9-495a-8a36-122cc40a2f12 admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:55.284697 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afcd1d-ccb9-495a-8a36-122cc40a2f12 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e853ee55e324805acbbf0aff75277c3)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:55.286806 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afcd1d-ccb9-495a-8a36-122cc40a2f12 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:55.288634 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 200/395] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:55 2022] GET /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:55.289136 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fc54c-c169-4d4b-951b-4d307ea8bb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:55.289793 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fc54c-c169-4d4b-951b-4d307ea8bb4e admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:55.290061 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fc54c-c169-4d4b-951b-4d307ea8bb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:55.290333 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fc54c-c169-4d4b-951b-4d307ea8bb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:55.291200 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fc54c-c169-4d4b-951b-4d307ea8bb4e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:55.291504 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fc54c-c169-4d4b-951b-4d307ea8bb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:55.293106 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fc54c-c169-4d4b-951b-4d307ea8bb4e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:55.300096 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afcd1d-ccb9-495a-8a36-122cc40a2f12 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:55.306905 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 196/396] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:37:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:55.309837 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fc54c-c169-4d4b-951b-4d307ea8bb4e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:55.319252 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afcd1d-ccb9-495a-8a36-122cc40a2f12 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:55.322091 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fc54c-c169-4d4b-951b-4d307ea8bb4e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:55.329598 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a044da-5df1-4062-8d0a-5072f64c1c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:55.330506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a044da-5df1-4062-8d0a-5072f64c1c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:55.330827 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a044da-5df1-4062-8d0a-5072f64c1c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:55.331084 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91379373-5a91-408b-ba95-2bc2d0773066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:55.331197 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a044da-5df1-4062-8d0a-5072f64c1c37 admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3/groups/233427fb69b44494afbf0c690d57c9b0/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:55.332420 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91379373-5a91-408b-ba95-2bc2d0773066 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:55.332947 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91379373-5a91-408b-ba95-2bc2d0773066 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:55.333409 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91379373-5a91-408b-ba95-2bc2d0773066 admin admin] PATH_INFO: `/v3/groups/233427fb69b44494afbf0c690d57c9b0` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:55.334803 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91379373-5a91-408b-ba95-2bc2d0773066 admin admin] RBAC: Authorizing `identity:get_group(group_id=233427fb69b44494afbf0c690d57c9b0)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:55.335979 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a044da-5df1-4062-8d0a-5072f64c1c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e853ee55e324805acbbf0aff75277c3, group_id=233427fb69b44494afbf0c690d57c9b0, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:55.337303 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91379373-5a91-408b-ba95-2bc2d0773066 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:55.338677 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a044da-5df1-4062-8d0a-5072f64c1c37 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:55.339387 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 197/397] 10.222.0.31 () {56 vars in 1201 bytes} [Mon Jan 10 17:37:55 2022] GET /identity/v3/groups/233427fb69b44494afbf0c690d57c9b0 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:55.345320 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91379373-5a91-408b-ba95-2bc2d0773066 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:55.356829 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91379373-5a91-408b-ba95-2bc2d0773066 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:55.357195 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 201/398] 10.222.0.31 () {58 vars in 1463 bytes} [Mon Jan 10 17:37:55 2022] PUT /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3/groups/233427fb69b44494afbf0c690d57c9b0/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:37:55.428525 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c04cf2-c261-4d7c-9755-417066035949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:55.429749 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c04cf2-c261-4d7c-9755-417066035949 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:55.430170 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c04cf2-c261-4d7c-9755-417066035949 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:55.430584 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c04cf2-c261-4d7c-9755-417066035949 admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:55.432133 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c04cf2-c261-4d7c-9755-417066035949 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e853ee55e324805acbbf0aff75277c3)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:55.434519 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c04cf2-c261-4d7c-9755-417066035949 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:55.436650 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 198/399] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:55 2022] GET /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3 => generated 298 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:55.442898 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a044da-5df1-4062-8d0a-5072f64c1c37 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:55.453876 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a044da-5df1-4062-8d0a-5072f64c1c37 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:55.458905 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bda35f-931f-40c0-b1c0-3ca7a8b89369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:55.460094 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bda35f-931f-40c0-b1c0-3ca7a8b89369 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:55.460522 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bda35f-931f-40c0-b1c0-3ca7a8b89369 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:55.461004 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bda35f-931f-40c0-b1c0-3ca7a8b89369 admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3/groups/233427fb69b44494afbf0c690d57c9b0/roles/112bab30f846403ea40d96a74a04af2c` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:55.463688 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bda35f-931f-40c0-b1c0-3ca7a8b89369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e853ee55e324805acbbf0aff75277c3, group_id=233427fb69b44494afbf0c690d57c9b0, role_id=112bab30f846403ea40d96a74a04af2c)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:55.466760 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bda35f-931f-40c0-b1c0-3ca7a8b89369 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:55.487082 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 202/400] 10.222.0.31 () {58 vars in 1463 bytes} [Mon Jan 10 17:37:55 2022] PUT /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3/groups/233427fb69b44494afbf0c690d57c9b0/roles/112bab30f846403ea40d96a74a04af2c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:37:55.688550 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0dfea-c324-4315-83bb-882cdbf13098 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:55.689110 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0dfea-c324-4315-83bb-882cdbf13098 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:55.689110 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0dfea-c324-4315-83bb-882cdbf13098 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:55.691309 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 199/401] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:55.696516 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df4707-35a4-4617-b96d-c9b1aaff6453 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:55.697022 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df4707-35a4-4617-b96d-c9b1aaff6453 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:55.697115 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df4707-35a4-4617-b96d-c9b1aaff6453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:55.738928 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-25df4707-35a4-4617-b96d-c9b1aaff6453 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:55.740163 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-25df4707-35a4-4617-b96d-c9b1aaff6453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:55.807912 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 203/402] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:55.832479 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0dfea-c324-4315-83bb-882cdbf13098 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:55.851708 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0dfea-c324-4315-83bb-882cdbf13098 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:55.857748 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d6318-c5f7-435b-b40f-6b666e2251a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:55.858578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d6318-c5f7-435b-b40f-6b666e2251a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:55.858860 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d6318-c5f7-435b-b40f-6b666e2251a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:55.859152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d6318-c5f7-435b-b40f-6b666e2251a2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:55.873382 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d6318-c5f7-435b-b40f-6b666e2251a2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:55.881183 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-073d6318-c5f7-435b-b40f-6b666e2251a2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 17:37:55.882671 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 200/403] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:37:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:55.888623 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df4707-35a4-4617-b96d-c9b1aaff6453 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:55.899033 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df4707-35a4-4617-b96d-c9b1aaff6453 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:55.904225 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb3031-79b2-410b-821d-a0dfbf18f64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:55.904945 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb3031-79b2-410b-821d-a0dfbf18f64d admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:55.905271 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb3031-79b2-410b-821d-a0dfbf18f64d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:55.905603 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb3031-79b2-410b-821d-a0dfbf18f64d admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:55.906332 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb3031-79b2-410b-821d-a0dfbf18f64d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:55.906690 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb3031-79b2-410b-821d-a0dfbf18f64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:55.908369 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb3031-79b2-410b-821d-a0dfbf18f64d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:55.919617 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 204/404] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:37:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:55.924428 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d6318-c5f7-435b-b40f-6b666e2251a2 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:55.942185 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d6318-c5f7-435b-b40f-6b666e2251a2 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:55.947186 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34242c9a-abf5-475c-8e6c-df51d788a6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:55.948086 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34242c9a-abf5-475c-8e6c-df51d788a6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:55.948609 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34242c9a-abf5-475c-8e6c-df51d788a6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:55.949090 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34242c9a-abf5-475c-8e6c-df51d788a6a7 admin admin] PATH_INFO: `/v3/groups/233427fb69b44494afbf0c690d57c9b0` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:55.950937 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34242c9a-abf5-475c-8e6c-df51d788a6a7 admin admin] RBAC: Authorizing `identity:get_group(group_id=233427fb69b44494afbf0c690d57c9b0)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:55.953039 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34242c9a-abf5-475c-8e6c-df51d788a6a7 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:55.959292 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 201/405] 10.222.0.31 () {56 vars in 1201 bytes} [Mon Jan 10 17:37:55 2022] GET /identity/v3/groups/233427fb69b44494afbf0c690d57c9b0 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:55.960675 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb3031-79b2-410b-821d-a0dfbf18f64d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:55.971036 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb3031-79b2-410b-821d-a0dfbf18f64d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:55.976469 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a50f8-114b-4bfc-8957-453bb8fbc812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:55.977415 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a50f8-114b-4bfc-8957-453bb8fbc812 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:55.977699 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a50f8-114b-4bfc-8957-453bb8fbc812 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:55.977975 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a50f8-114b-4bfc-8957-453bb8fbc812 admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:55.979704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a50f8-114b-4bfc-8957-453bb8fbc812 admin admin] RBAC: Authorizing `identity:get_project(project_id=f7f01e6ad70a496b8b8df89a6b770b4c)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:55.983488 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a50f8-114b-4bfc-8957-453bb8fbc812 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:55.988030 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 205/406] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:55 2022] GET /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:55.995128 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34242c9a-abf5-475c-8e6c-df51d788a6a7 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:56.011315 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34242c9a-abf5-475c-8e6c-df51d788a6a7 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:56.016882 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1c127-7c45-4982-a1f5-f51b241678d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:56.018105 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1c127-7c45-4982-a1f5-f51b241678d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:56.018627 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1c127-7c45-4982-a1f5-f51b241678d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:56.019045 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1c127-7c45-4982-a1f5-f51b241678d6 admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c/groups/233427fb69b44494afbf0c690d57c9b0/roles/112bab30f846403ea40d96a74a04af2c` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:56.021916 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1c127-7c45-4982-a1f5-f51b241678d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f01e6ad70a496b8b8df89a6b770b4c, group_id=233427fb69b44494afbf0c690d57c9b0, role_id=112bab30f846403ea40d96a74a04af2c)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:56.026341 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1c127-7c45-4982-a1f5-f51b241678d6 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:56.050544 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 202/407] 10.222.0.31 () {58 vars in 1463 bytes} [Mon Jan 10 17:37:55 2022] PUT /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c/groups/233427fb69b44494afbf0c690d57c9b0/roles/112bab30f846403ea40d96a74a04af2c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:37:56.267541 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69239be7-f835-4609-b757-dc1a945b3e90 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:56.267884 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69239be7-f835-4609-b757-dc1a945b3e90 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:56.268046 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69239be7-f835-4609-b757-dc1a945b3e90 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:56.270232 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 206/408] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:56.275801 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8b745-173b-4dd0-9436-0396cc400b98 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:56.276091 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8b745-173b-4dd0-9436-0396cc400b98 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:56.276366 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8b745-173b-4dd0-9436-0396cc400b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:56.309279 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-56c8b745-173b-4dd0-9436-0396cc400b98 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:56.310992 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-56c8b745-173b-4dd0-9436-0396cc400b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:56.395814 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 203/409] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:56.422030 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69239be7-f835-4609-b757-dc1a945b3e90 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:56.436623 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69239be7-f835-4609-b757-dc1a945b3e90 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:56.444133 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07699b26-a883-4b73-8465-80dd1dd37bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:56.445072 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07699b26-a883-4b73-8465-80dd1dd37bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:56.445359 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07699b26-a883-4b73-8465-80dd1dd37bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:56.445686 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07699b26-a883-4b73-8465-80dd1dd37bf0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:56.460448 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07699b26-a883-4b73-8465-80dd1dd37bf0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:56.467457 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-07699b26-a883-4b73-8465-80dd1dd37bf0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:37:56.469028 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 207/410] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:37:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:56.476305 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8b745-173b-4dd0-9436-0396cc400b98 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:56.485518 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8b745-173b-4dd0-9436-0396cc400b98 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:56.495854 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8e80f-1195-4578-9149-8ed77bd6ab09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:56.496539 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8e80f-1195-4578-9149-8ed77bd6ab09 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:56.496823 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8e80f-1195-4578-9149-8ed77bd6ab09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:56.497149 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8e80f-1195-4578-9149-8ed77bd6ab09 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:56.497931 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8e80f-1195-4578-9149-8ed77bd6ab09 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:56.498236 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8e80f-1195-4578-9149-8ed77bd6ab09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:56.499870 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8e80f-1195-4578-9149-8ed77bd6ab09 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:56.511658 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 204/411] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:56.517081 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07699b26-a883-4b73-8465-80dd1dd37bf0 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:56.528249 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07699b26-a883-4b73-8465-80dd1dd37bf0 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:56.532989 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3ffbb-cd29-4828-a87d-5be389f3ea69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:56.533970 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3ffbb-cd29-4828-a87d-5be389f3ea69 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:56.534296 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3ffbb-cd29-4828-a87d-5be389f3ea69 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:56.534574 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3ffbb-cd29-4828-a87d-5be389f3ea69 admin admin] PATH_INFO: `/v3/groups/9a3cfd4b8afe49aba4e83a67aed62967` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:56.536117 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3ffbb-cd29-4828-a87d-5be389f3ea69 admin admin] RBAC: Authorizing `identity:get_group(group_id=9a3cfd4b8afe49aba4e83a67aed62967)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:56.538121 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3ffbb-cd29-4828-a87d-5be389f3ea69 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:56.540193 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 208/412] 10.222.0.31 () {56 vars in 1201 bytes} [Mon Jan 10 17:37:56 2022] GET /identity/v3/groups/9a3cfd4b8afe49aba4e83a67aed62967 => generated 229 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:56.545266 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8e80f-1195-4578-9149-8ed77bd6ab09 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:56.555595 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8e80f-1195-4578-9149-8ed77bd6ab09 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:56.563370 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22809c-f44f-4094-8785-6ac3895c5058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:56.564303 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22809c-f44f-4094-8785-6ac3895c5058 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:56.564582 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22809c-f44f-4094-8785-6ac3895c5058 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:56.564874 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22809c-f44f-4094-8785-6ac3895c5058 admin admin] PATH_INFO: `/v3/projects/ef5870ae6e4a4492ac99ab89391674b9` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:56.569880 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22809c-f44f-4094-8785-6ac3895c5058 admin admin] RBAC: Authorizing `identity:get_project(project_id=ef5870ae6e4a4492ac99ab89391674b9)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:56.572177 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22809c-f44f-4094-8785-6ac3895c5058 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:56.574767 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 205/413] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:56 2022] GET /identity/v3/projects/ef5870ae6e4a4492ac99ab89391674b9 => generated 344 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:56.580168 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3ffbb-cd29-4828-a87d-5be389f3ea69 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:56.594621 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3ffbb-cd29-4828-a87d-5be389f3ea69 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:56.599666 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d162a2-d487-4e40-a10d-a521a1001a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:56.600830 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d162a2-d487-4e40-a10d-a521a1001a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:56.601306 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d162a2-d487-4e40-a10d-a521a1001a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:56.601815 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d162a2-d487-4e40-a10d-a521a1001a4a admin admin] PATH_INFO: `/v3/projects/ef5870ae6e4a4492ac99ab89391674b9/groups/9a3cfd4b8afe49aba4e83a67aed62967/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:56.604095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d162a2-d487-4e40-a10d-a521a1001a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5870ae6e4a4492ac99ab89391674b9, group_id=9a3cfd4b8afe49aba4e83a67aed62967, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:56.607209 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d162a2-d487-4e40-a10d-a521a1001a4a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:56.635689 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 209/414] 10.222.0.31 () {58 vars in 1463 bytes} [Mon Jan 10 17:37:56 2022] PUT /identity/v3/projects/ef5870ae6e4a4492ac99ab89391674b9/groups/9a3cfd4b8afe49aba4e83a67aed62967/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:37:57.988150 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eb108-678c-48f4-b190-d767c451e8b5 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:57.988816 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eb108-678c-48f4-b190-d767c451e8b5 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:57.988816 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eb108-678c-48f4-b190-d767c451e8b5 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:57.990705 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 206/415] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:57.996172 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ab987-fb8e-473b-a771-fa88c09d3126 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:57.996662 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ab987-fb8e-473b-a771-fa88c09d3126 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:57.996820 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ab987-fb8e-473b-a771-fa88c09d3126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:58.015936 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-612ab987-fb8e-473b-a771-fa88c09d3126 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:58.017143 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-612ab987-fb8e-473b-a771-fa88c09d3126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:58.084749 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 210/416] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:37:58.113499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321eb108-678c-48f4-b190-d767c451e8b5 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:58.126138 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321eb108-678c-48f4-b190-d767c451e8b5 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:58.132992 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421b34c-3575-48d1-a598-714fd9fcb2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:58.133796 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421b34c-3575-48d1-a598-714fd9fcb2de admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:58.134089 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421b34c-3575-48d1-a598-714fd9fcb2de admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:58.134372 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421b34c-3575-48d1-a598-714fd9fcb2de admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:58.146457 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421b34c-3575-48d1-a598-714fd9fcb2de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:58.154172 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-8421b34c-3575-48d1-a598-714fd9fcb2de admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 17:37:58.160300 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 207/417] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:58.163879 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ab987-fb8e-473b-a771-fa88c09d3126 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:58.172897 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ab987-fb8e-473b-a771-fa88c09d3126 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:58.177382 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ef3cb-183b-4e34-bff0-4c53e863a52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:58.178048 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ef3cb-183b-4e34-bff0-4c53e863a52d admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:58.178331 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ef3cb-183b-4e34-bff0-4c53e863a52d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:58.178608 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ef3cb-183b-4e34-bff0-4c53e863a52d admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:58.179377 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ef3cb-183b-4e34-bff0-4c53e863a52d admin admin] RBAC: Adding query filter params (name=member) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:58.179684 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ef3cb-183b-4e34-bff0-4c53e863a52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:58.181359 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ef3cb-183b-4e34-bff0-4c53e863a52d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:58.194408 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 211/418] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:58.195735 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421b34c-3575-48d1-a598-714fd9fcb2de admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:58.206261 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421b34c-3575-48d1-a598-714fd9fcb2de admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:58.217997 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dc119-539f-4fd9-a73d-502a24749111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:58.218908 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dc119-539f-4fd9-a73d-502a24749111 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:58.219419 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dc119-539f-4fd9-a73d-502a24749111 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:58.219882 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dc119-539f-4fd9-a73d-502a24749111 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:58.232887 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dc119-539f-4fd9-a73d-502a24749111 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:58.234933 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dc119-539f-4fd9-a73d-502a24749111 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:58.250742 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 208/419] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:58.256527 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ef3cb-183b-4e34-bff0-4c53e863a52d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:58.274432 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ef3cb-183b-4e34-bff0-4c53e863a52d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:58.284464 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5de78f-4aaa-4717-8a00-8521a6afdb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:58.285370 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5de78f-4aaa-4717-8a00-8521a6afdb89 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:58.285650 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5de78f-4aaa-4717-8a00-8521a6afdb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:58.285920 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5de78f-4aaa-4717-8a00-8521a6afdb89 admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:58.287148 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5de78f-4aaa-4717-8a00-8521a6afdb89 admin admin] RBAC: Authorizing `identity:get_project(project_id=f7f01e6ad70a496b8b8df89a6b770b4c)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:58.289253 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5de78f-4aaa-4717-8a00-8521a6afdb89 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:58.291407 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 212/420] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:58 2022] GET /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:58.296993 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dc119-539f-4fd9-a73d-502a24749111 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:58.309917 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dc119-539f-4fd9-a73d-502a24749111 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:58.320800 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae111fb-8085-4406-9654-6cc7f7685cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:58.321934 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae111fb-8085-4406-9654-6cc7f7685cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:58.322420 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae111fb-8085-4406-9654-6cc7f7685cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:58.322892 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae111fb-8085-4406-9654-6cc7f7685cf3 admin admin] PATH_INFO: `/v3/groups/233427fb69b44494afbf0c690d57c9b0` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:58.329565 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae111fb-8085-4406-9654-6cc7f7685cf3 admin admin] RBAC: Authorizing `identity:get_group(group_id=233427fb69b44494afbf0c690d57c9b0)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:58.331795 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae111fb-8085-4406-9654-6cc7f7685cf3 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:58.333646 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 209/421] 10.222.0.31 () {56 vars in 1201 bytes} [Mon Jan 10 17:37:58 2022] GET /identity/v3/groups/233427fb69b44494afbf0c690d57c9b0 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:58.339518 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5de78f-4aaa-4717-8a00-8521a6afdb89 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:58.354160 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5de78f-4aaa-4717-8a00-8521a6afdb89 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:58.361944 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11493e34-b2bd-47ea-b26b-ebeb0ceef766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:58.362639 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11493e34-b2bd-47ea-b26b-ebeb0ceef766 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:58.362923 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11493e34-b2bd-47ea-b26b-ebeb0ceef766 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:58.363201 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11493e34-b2bd-47ea-b26b-ebeb0ceef766 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:58.364059 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11493e34-b2bd-47ea-b26b-ebeb0ceef766 admin admin] RBAC: Adding query filter params (group.id=233427fb69b44494afbf0c690d57c9b0, role.id=3c8f0c77d36b49608a0e17cfcff15691, scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:58.364426 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11493e34-b2bd-47ea-b26b-ebeb0ceef766 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:58.366359 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11493e34-b2bd-47ea-b26b-ebeb0ceef766 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:58.373341 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 213/422] 10.222.0.31 () {56 vars in 1397 bytes} [Mon Jan 10 17:37:58 2022] GET /identity/v3/role_assignments?group.id=233427fb69b44494afbf0c690d57c9b0&scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c&role.id=3c8f0c77d36b49608a0e17cfcff15691 => generated 611 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:58.722011 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4025542-06ed-428c-b1ef-64d02dff67fa None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:58.722743 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4025542-06ed-428c-b1ef-64d02dff67fa None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:58.723237 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4025542-06ed-428c-b1ef-64d02dff67fa None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:58.725673 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 210/423] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:58.731383 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68499a0-ae55-42f1-89d5-7cd3bbf2fa95 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:58.731383 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68499a0-ae55-42f1-89d5-7cd3bbf2fa95 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:58.731603 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68499a0-ae55-42f1-89d5-7cd3bbf2fa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:58.759111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-a68499a0-ae55-42f1-89d5-7cd3bbf2fa95 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:58.760340 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-a68499a0-ae55-42f1-89d5-7cd3bbf2fa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:58.772456 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 214/424] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:58.808411 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4025542-06ed-428c-b1ef-64d02dff67fa None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:58.824993 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4025542-06ed-428c-b1ef-64d02dff67fa None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:58.829372 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78653e3b-6af8-45f5-87a1-4ab10574b68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:58.830185 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78653e3b-6af8-45f5-87a1-4ab10574b68e admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:58.830468 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78653e3b-6af8-45f5-87a1-4ab10574b68e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:58.830770 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78653e3b-6af8-45f5-87a1-4ab10574b68e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:58.842573 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78653e3b-6af8-45f5-87a1-4ab10574b68e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:58.853170 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-78653e3b-6af8-45f5-87a1-4ab10574b68e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 17:37:58.854731 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 211/425] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:37:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:37:58.860578 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68499a0-ae55-42f1-89d5-7cd3bbf2fa95 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:58.873890 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68499a0-ae55-42f1-89d5-7cd3bbf2fa95 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:58.879191 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0e004-df97-45a4-9949-60bd9dac841a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:58.879875 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0e004-df97-45a4-9949-60bd9dac841a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:58.880157 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0e004-df97-45a4-9949-60bd9dac841a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:58.880440 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0e004-df97-45a4-9949-60bd9dac841a admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:58.881246 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0e004-df97-45a4-9949-60bd9dac841a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:58.881552 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0e004-df97-45a4-9949-60bd9dac841a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:58.884049 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0e004-df97-45a4-9949-60bd9dac841a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:58.895851 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 215/426] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:37:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:58.901857 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78653e3b-6af8-45f5-87a1-4ab10574b68e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:58.912555 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78653e3b-6af8-45f5-87a1-4ab10574b68e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:58.918901 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221c06a-5906-43dc-9cf5-cb0c08d6f84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:58.919602 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221c06a-5906-43dc-9cf5-cb0c08d6f84e admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:58.919885 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221c06a-5906-43dc-9cf5-cb0c08d6f84e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:58.920205 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221c06a-5906-43dc-9cf5-cb0c08d6f84e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:58.930895 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221c06a-5906-43dc-9cf5-cb0c08d6f84e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:58.932726 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221c06a-5906-43dc-9cf5-cb0c08d6f84e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:58.944428 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 212/427] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:58.950128 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0e004-df97-45a4-9949-60bd9dac841a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:58.958196 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6db0f-6205-46e6-96c1-d52dd81fc3c1 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:58.958484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6db0f-6205-46e6-96c1-d52dd81fc3c1 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:58.958742 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6db0f-6205-46e6-96c1-d52dd81fc3c1 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:58.960677 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 213/428] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:58.961116 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0e004-df97-45a4-9949-60bd9dac841a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:58.969500 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc3095-757b-455d-aed3-f67142a9f961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:58.970099 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d4a20-c88b-4140-b669-680948bcdb12 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:58.970384 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d4a20-c88b-4140-b669-680948bcdb12 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:58.970483 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc3095-757b-455d-aed3-f67142a9f961 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:58.970662 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d4a20-c88b-4140-b669-680948bcdb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:58.970755 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc3095-757b-455d-aed3-f67142a9f961 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:58.970960 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc3095-757b-455d-aed3-f67142a9f961 admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:58.977880 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc3095-757b-455d-aed3-f67142a9f961 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e853ee55e324805acbbf0aff75277c3)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:58.980655 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc3095-757b-455d-aed3-f67142a9f961 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:58.984008 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 216/429] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:58 2022] GET /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:58.989036 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc3095-757b-455d-aed3-f67142a9f961 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:58.997865 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-171d4a20-c88b-4140-b669-680948bcdb12 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:58.999067 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-171d4a20-c88b-4140-b669-680948bcdb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:59.000974 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc3095-757b-455d-aed3-f67142a9f961 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:59.008250 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0f502-e408-42b6-b1fb-e3c0467d3fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:59.009429 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0f502-e408-42b6-b1fb-e3c0467d3fda admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:59.010024 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0f502-e408-42b6-b1fb-e3c0467d3fda admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:59.010523 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0f502-e408-42b6-b1fb-e3c0467d3fda admin admin] PATH_INFO: `/v3/groups/233427fb69b44494afbf0c690d57c9b0` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:59.011993 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0f502-e408-42b6-b1fb-e3c0467d3fda admin admin] RBAC: Authorizing `identity:get_group(group_id=233427fb69b44494afbf0c690d57c9b0)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:59.014014 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0f502-e408-42b6-b1fb-e3c0467d3fda admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:59.016184 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 217/430] 10.222.0.31 () {56 vars in 1201 bytes} [Mon Jan 10 17:37:58 2022] GET /identity/v3/groups/233427fb69b44494afbf0c690d57c9b0 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:59.016320 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 214/431] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:37:59.022290 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0f502-e408-42b6-b1fb-e3c0467d3fda admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:59.035545 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0f502-e408-42b6-b1fb-e3c0467d3fda admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:59.040007 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1afbf-93d8-4151-9900-e1acde1d2681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:59.040672 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1afbf-93d8-4151-9900-e1acde1d2681 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:59.040975 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1afbf-93d8-4151-9900-e1acde1d2681 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:59.041255 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1afbf-93d8-4151-9900-e1acde1d2681 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:59.042108 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1afbf-93d8-4151-9900-e1acde1d2681 admin admin] RBAC: Adding query filter params (group.id=233427fb69b44494afbf0c690d57c9b0, role.id=112bab30f846403ea40d96a74a04af2c, scope.project.id=3e853ee55e324805acbbf0aff75277c3) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:59.042426 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1afbf-93d8-4151-9900-e1acde1d2681 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:59.044286 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1afbf-93d8-4151-9900-e1acde1d2681 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:59.056694 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 218/432] 10.222.0.31 () {56 vars in 1397 bytes} [Mon Jan 10 17:37:59 2022] GET /identity/v3/role_assignments?group.id=233427fb69b44494afbf0c690d57c9b0&scope.project.id=3e853ee55e324805acbbf0aff75277c3&role.id=112bab30f846403ea40d96a74a04af2c => generated 611 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:59.057859 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d4a20-c88b-4140-b669-680948bcdb12 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:59.069378 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d4a20-c88b-4140-b669-680948bcdb12 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:59.075192 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba86cd3-6337-4dd9-9330-e6eb1d92434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:59.076459 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba86cd3-6337-4dd9-9330-e6eb1d92434b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:59.076992 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba86cd3-6337-4dd9-9330-e6eb1d92434b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:59.077462 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba86cd3-6337-4dd9-9330-e6eb1d92434b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:59.091628 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba86cd3-6337-4dd9-9330-e6eb1d92434b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:59.092043 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a8e26-8766-4170-83d1-b2a4913aeb40 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:59.092338 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a8e26-8766-4170-83d1-b2a4913aeb40 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:59.092618 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a8e26-8766-4170-83d1-b2a4913aeb40 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:59.095524 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 219/433] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:37:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:37:59.099800 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953bb73-5d33-4625-8e57-ad9f89b68481 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:59.100085 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953bb73-5d33-4625-8e57-ad9f89b68481 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:59.100367 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953bb73-5d33-4625-8e57-ad9f89b68481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:59.101016 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-9ba86cd3-6337-4dd9-9330-e6eb1d92434b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 17:37:59.102835 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 215/434] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:37:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:37:59.110447 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba86cd3-6337-4dd9-9330-e6eb1d92434b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:59.123202 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-9953bb73-5d33-4625-8e57-ad9f89b68481 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:37:59.124434 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-9953bb73-5d33-4625-8e57-ad9f89b68481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:37:59.125727 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba86cd3-6337-4dd9-9330-e6eb1d92434b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:59.132559 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afbb2d-5c45-4f48-8a3e-93cf33e72fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:59.133684 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afbb2d-5c45-4f48-8a3e-93cf33e72fce admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:59.134174 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afbb2d-5c45-4f48-8a3e-93cf33e72fce admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:59.134707 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 220/435] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:37:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:37:59.135026 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afbb2d-5c45-4f48-8a3e-93cf33e72fce admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:59.136213 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afbb2d-5c45-4f48-8a3e-93cf33e72fce admin admin] RBAC: Adding query filter params (name=member) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:59.136706 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afbb2d-5c45-4f48-8a3e-93cf33e72fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:59.138686 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afbb2d-5c45-4f48-8a3e-93cf33e72fce admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:59.154097 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 216/436] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:37:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:37:59.160229 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953bb73-5d33-4625-8e57-ad9f89b68481 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:59.160509 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afbb2d-5c45-4f48-8a3e-93cf33e72fce admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:59.175109 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afbb2d-5c45-4f48-8a3e-93cf33e72fce admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:59.177934 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953bb73-5d33-4625-8e57-ad9f89b68481 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:59.183921 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b86c3-85c3-40bd-9b64-245f31f3187c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:59.184759 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b86c3-85c3-40bd-9b64-245f31f3187c admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:59.185080 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b86c3-85c3-40bd-9b64-245f31f3187c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:59.185353 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b86c3-85c3-40bd-9b64-245f31f3187c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:59.192447 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f53593-bbb2-4f2b-ad5e-acf721abf88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:59.192447 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f53593-bbb2-4f2b-ad5e-acf721abf88d admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:59.192447 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f53593-bbb2-4f2b-ad5e-acf721abf88d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:59.192447 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f53593-bbb2-4f2b-ad5e-acf721abf88d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:59.202599 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f53593-bbb2-4f2b-ad5e-acf721abf88d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:59.204386 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f53593-bbb2-4f2b-ad5e-acf721abf88d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:59.206100 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b86c3-85c3-40bd-9b64-245f31f3187c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:37:59.214826 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-c82b86c3-85c3-40bd-9b64-245f31f3187c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 17:37:59.220891 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 221/438] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:59.221418 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 217/438] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:37:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:37:59.223043 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f53593-bbb2-4f2b-ad5e-acf721abf88d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:59.224421 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b86c3-85c3-40bd-9b64-245f31f3187c admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:59.233629 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f53593-bbb2-4f2b-ad5e-acf721abf88d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:59.236421 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b86c3-85c3-40bd-9b64-245f31f3187c admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:59.239263 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb7bcb-d8ca-4cc5-a4c4-af7381e85d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:59.239964 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb7bcb-d8ca-4cc5-a4c4-af7381e85d13 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:59.240236 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb7bcb-d8ca-4cc5-a4c4-af7381e85d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:59.240552 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb7bcb-d8ca-4cc5-a4c4-af7381e85d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:59.241484 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb7bcb-d8ca-4cc5-a4c4-af7381e85d13 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:59.241785 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb7bcb-d8ca-4cc5-a4c4-af7381e85d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:59.242784 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab87db-1f4f-439b-bf8e-9d7f764c31a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:59.243476 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb7bcb-d8ca-4cc5-a4c4-af7381e85d13 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:59.244110 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab87db-1f4f-439b-bf8e-9d7f764c31a6 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:59.244587 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab87db-1f4f-439b-bf8e-9d7f764c31a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:59.245337 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab87db-1f4f-439b-bf8e-9d7f764c31a6 admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:59.247263 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab87db-1f4f-439b-bf8e-9d7f764c31a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e853ee55e324805acbbf0aff75277c3)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:59.250222 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab87db-1f4f-439b-bf8e-9d7f764c31a6 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:59.252967 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 218/439] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:59 2022] GET /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:59.256916 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 222/440] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:37:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:59.258971 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab87db-1f4f-439b-bf8e-9d7f764c31a6 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:59.260155 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb7bcb-d8ca-4cc5-a4c4-af7381e85d13 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:59.272533 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab87db-1f4f-439b-bf8e-9d7f764c31a6 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:59.274850 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb7bcb-d8ca-4cc5-a4c4-af7381e85d13 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:59.279171 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92310e-9da9-44d1-83ed-ca6ed8e509d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:59.279829 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92310e-9da9-44d1-83ed-ca6ed8e509d4 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:59.280133 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92310e-9da9-44d1-83ed-ca6ed8e509d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:59.280371 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92310e-9da9-44d1-83ed-ca6ed8e509d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:59.281342 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b29a63-8cf2-4608-86f8-dc1391baeea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:59.282509 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b29a63-8cf2-4608-86f8-dc1391baeea7 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:59.282976 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b29a63-8cf2-4608-86f8-dc1391baeea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:59.283459 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b29a63-8cf2-4608-86f8-dc1391baeea7 admin admin] PATH_INFO: `/v3/groups/233427fb69b44494afbf0c690d57c9b0` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:59.285193 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b29a63-8cf2-4608-86f8-dc1391baeea7 admin admin] RBAC: Authorizing `identity:get_group(group_id=233427fb69b44494afbf0c690d57c9b0)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:59.288465 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b29a63-8cf2-4608-86f8-dc1391baeea7 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:59.290403 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92310e-9da9-44d1-83ed-ca6ed8e509d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:59.291274 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 223/441] 10.222.0.31 () {56 vars in 1201 bytes} [Mon Jan 10 17:37:59 2022] GET /identity/v3/groups/233427fb69b44494afbf0c690d57c9b0 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:59.296202 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92310e-9da9-44d1-83ed-ca6ed8e509d4 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:59.297792 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b29a63-8cf2-4608-86f8-dc1391baeea7 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:59.303561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 219/442] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:37:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:37:59.309651 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b29a63-8cf2-4608-86f8-dc1391baeea7 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:59.310129 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92310e-9da9-44d1-83ed-ca6ed8e509d4 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:59.314862 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13622c7-7b02-4d44-8a2d-f893ae1f683c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:59.315887 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13622c7-7b02-4d44-8a2d-f893ae1f683c admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:59.316361 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13622c7-7b02-4d44-8a2d-f893ae1f683c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:59.317445 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13622c7-7b02-4d44-8a2d-f893ae1f683c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:59.318785 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13622c7-7b02-4d44-8a2d-f893ae1f683c admin admin] RBAC: Adding query filter params (group.id=233427fb69b44494afbf0c690d57c9b0, role.id=3c8f0c77d36b49608a0e17cfcff15691, scope.project.id=3e853ee55e324805acbbf0aff75277c3) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:59.319332 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13622c7-7b02-4d44-8a2d-f893ae1f683c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:59.320964 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92310e-9da9-44d1-83ed-ca6ed8e509d4 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:59.321811 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13622c7-7b02-4d44-8a2d-f893ae1f683c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:59.326838 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d28542-d8da-4693-9866-971189b9ca7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:59.327460 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d28542-d8da-4693-9866-971189b9ca7a admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:59.327732 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d28542-d8da-4693-9866-971189b9ca7a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:59.327996 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d28542-d8da-4693-9866-971189b9ca7a admin admin] PATH_INFO: `/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:59.329471 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d28542-d8da-4693-9866-971189b9ca7a admin admin] RBAC: Authorizing `identity:get_project(project_id=f7f01e6ad70a496b8b8df89a6b770b4c)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:59.331386 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 224/443] 10.222.0.31 () {56 vars in 1397 bytes} [Mon Jan 10 17:37:59 2022] GET /identity/v3/role_assignments?group.id=233427fb69b44494afbf0c690d57c9b0&scope.project.id=3e853ee55e324805acbbf0aff75277c3&role.id=3c8f0c77d36b49608a0e17cfcff15691 => generated 611 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:59.336902 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d28542-d8da-4693-9866-971189b9ca7a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:59.336902 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 220/444] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:37:59 2022] GET /identity/v3/projects/f7f01e6ad70a496b8b8df89a6b770b4c => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:59.339266 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13622c7-7b02-4d44-8a2d-f893ae1f683c admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:59.349703 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13622c7-7b02-4d44-8a2d-f893ae1f683c admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:59.354328 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfeb9a1-cd3a-4b60-93cb-dcbaf21092f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:59.355216 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfeb9a1-cd3a-4b60-93cb-dcbaf21092f3 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:59.355491 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfeb9a1-cd3a-4b60-93cb-dcbaf21092f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:59.355757 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfeb9a1-cd3a-4b60-93cb-dcbaf21092f3 admin admin] PATH_INFO: `/v3/groups/233427fb69b44494afbf0c690d57c9b0` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:59.357090 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfeb9a1-cd3a-4b60-93cb-dcbaf21092f3 admin admin] RBAC: Authorizing `identity:get_group(group_id=233427fb69b44494afbf0c690d57c9b0)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:59.359059 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfeb9a1-cd3a-4b60-93cb-dcbaf21092f3 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:59.361016 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 225/445] 10.222.0.31 () {56 vars in 1201 bytes} [Mon Jan 10 17:37:59 2022] GET /identity/v3/groups/233427fb69b44494afbf0c690d57c9b0 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:37:59.367046 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d28542-d8da-4693-9866-971189b9ca7a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:37:59.378731 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d28542-d8da-4693-9866-971189b9ca7a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:37:59.386259 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babca61-987d-4ff8-8166-e3bb8ec8cf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:37:59.387019 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babca61-987d-4ff8-8166-e3bb8ec8cf0d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:37:59.387381 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babca61-987d-4ff8-8166-e3bb8ec8cf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:37:59.387740 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babca61-987d-4ff8-8166-e3bb8ec8cf0d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:37:59.389441 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babca61-987d-4ff8-8166-e3bb8ec8cf0d admin admin] RBAC: Adding query filter params (group.id=233427fb69b44494afbf0c690d57c9b0, role.id=112bab30f846403ea40d96a74a04af2c, scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:37:59.389821 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babca61-987d-4ff8-8166-e3bb8ec8cf0d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:37:59.391754 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babca61-987d-4ff8-8166-e3bb8ec8cf0d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:37:59.400006 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 221/446] 10.222.0.31 () {56 vars in 1397 bytes} [Mon Jan 10 17:37:59 2022] GET /identity/v3/role_assignments?group.id=233427fb69b44494afbf0c690d57c9b0&scope.project.id=f7f01e6ad70a496b8b8df89a6b770b4c&role.id=112bab30f846403ea40d96a74a04af2c => generated 611 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:00.162880 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32041dc2-23c7-4f2c-8b64-553c4bb65f78 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:00.163619 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32041dc2-23c7-4f2c-8b64-553c4bb65f78 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:00.163619 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32041dc2-23c7-4f2c-8b64-553c4bb65f78 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:00.165408 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 226/447] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:00.170836 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4517d7-686e-4abd-b206-0a948e49bf0e None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:00.171289 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4517d7-686e-4abd-b206-0a948e49bf0e None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:00.171361 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4517d7-686e-4abd-b206-0a948e49bf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:00.190710 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-ea4517d7-686e-4abd-b206-0a948e49bf0e None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:00.191880 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-ea4517d7-686e-4abd-b206-0a948e49bf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:00.200811 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 222/448] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:38:00.226803 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32041dc2-23c7-4f2c-8b64-553c4bb65f78 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:00.248610 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32041dc2-23c7-4f2c-8b64-553c4bb65f78 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:00.255794 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1a529-1ee8-4635-b31f-af9f53fa26f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:00.256582 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1a529-1ee8-4635-b31f-af9f53fa26f3 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:00.256872 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1a529-1ee8-4635-b31f-af9f53fa26f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:00.257177 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1a529-1ee8-4635-b31f-af9f53fa26f3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:00.267576 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1a529-1ee8-4635-b31f-af9f53fa26f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:00.274747 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-d7c1a529-1ee8-4635-b31f-af9f53fa26f3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:38:00.275914 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 227/449] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:38:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:00.284275 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4517d7-686e-4abd-b206-0a948e49bf0e None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:00.293435 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4517d7-686e-4abd-b206-0a948e49bf0e None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:00.299765 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bdb94-fdda-4d60-8e50-acd4a9203e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:00.300408 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bdb94-fdda-4d60-8e50-acd4a9203e29 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:00.300684 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bdb94-fdda-4d60-8e50-acd4a9203e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:00.300979 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bdb94-fdda-4d60-8e50-acd4a9203e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:00.301779 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028bdb94-fdda-4d60-8e50-acd4a9203e29 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:00.302072 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028bdb94-fdda-4d60-8e50-acd4a9203e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:00.303655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028bdb94-fdda-4d60-8e50-acd4a9203e29 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:00.311995 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 223/450] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:38:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:00.318091 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1a529-1ee8-4635-b31f-af9f53fa26f3 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:00.334233 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1a529-1ee8-4635-b31f-af9f53fa26f3 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:00.342052 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400756e-882f-48f7-b2a6-2a7c0d7be5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:00.343037 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400756e-882f-48f7-b2a6-2a7c0d7be5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:00.343506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400756e-882f-48f7-b2a6-2a7c0d7be5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:00.343956 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400756e-882f-48f7-b2a6-2a7c0d7be5a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:00.352764 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400756e-882f-48f7-b2a6-2a7c0d7be5a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:00.354531 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400756e-882f-48f7-b2a6-2a7c0d7be5a8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:00.363049 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 228/451] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:38:00.368767 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bdb94-fdda-4d60-8e50-acd4a9203e29 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:00.381701 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bdb94-fdda-4d60-8e50-acd4a9203e29 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:00.387922 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea277e-5f30-4ecd-ba70-b5acb232c3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:00.388748 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea277e-5f30-4ecd-ba70-b5acb232c3ff admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:00.389055 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea277e-5f30-4ecd-ba70-b5acb232c3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:00.389324 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea277e-5f30-4ecd-ba70-b5acb232c3ff admin admin] PATH_INFO: `/v3/projects/ef5870ae6e4a4492ac99ab89391674b9` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:00.390684 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea277e-5f30-4ecd-ba70-b5acb232c3ff admin admin] RBAC: Authorizing `identity:get_project(project_id=ef5870ae6e4a4492ac99ab89391674b9)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:00.392404 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea277e-5f30-4ecd-ba70-b5acb232c3ff admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:00.394044 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 224/452] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:38:00 2022] GET /identity/v3/projects/ef5870ae6e4a4492ac99ab89391674b9 => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:00.399261 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400756e-882f-48f7-b2a6-2a7c0d7be5a8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:00.407818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400756e-882f-48f7-b2a6-2a7c0d7be5a8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:00.413502 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7e85e-13ab-4aa1-ad68-fdafe485c2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:00.414260 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7e85e-13ab-4aa1-ad68-fdafe485c2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:00.414544 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7e85e-13ab-4aa1-ad68-fdafe485c2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:00.414821 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7e85e-13ab-4aa1-ad68-fdafe485c2f2 admin admin] PATH_INFO: `/v3/groups/9a3cfd4b8afe49aba4e83a67aed62967` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:00.416066 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7e85e-13ab-4aa1-ad68-fdafe485c2f2 admin admin] RBAC: Authorizing `identity:get_group(group_id=9a3cfd4b8afe49aba4e83a67aed62967)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:00.417972 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7e85e-13ab-4aa1-ad68-fdafe485c2f2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:00.419505 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 229/453] 10.222.0.31 () {56 vars in 1201 bytes} [Mon Jan 10 17:38:00 2022] GET /identity/v3/groups/9a3cfd4b8afe49aba4e83a67aed62967 => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:00.424775 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea277e-5f30-4ecd-ba70-b5acb232c3ff admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:00.434193 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea277e-5f30-4ecd-ba70-b5acb232c3ff admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:00.439716 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556b17b-971e-46e8-a4a1-081e7bdbae67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:00.440344 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556b17b-971e-46e8-a4a1-081e7bdbae67 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:00.440615 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556b17b-971e-46e8-a4a1-081e7bdbae67 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:00.440884 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556b17b-971e-46e8-a4a1-081e7bdbae67 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:00.441720 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556b17b-971e-46e8-a4a1-081e7bdbae67 admin admin] RBAC: Adding query filter params (group.id=9a3cfd4b8afe49aba4e83a67aed62967, role.id=3c05bedf79e04eb38d2ae66736030bfe, scope.project.id=ef5870ae6e4a4492ac99ab89391674b9) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:00.442023 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556b17b-971e-46e8-a4a1-081e7bdbae67 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:00.443773 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556b17b-971e-46e8-a4a1-081e7bdbae67 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:00.450001 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 225/454] 10.222.0.31 () {56 vars in 1397 bytes} [Mon Jan 10 17:38:00 2022] GET /identity/v3/role_assignments?group.id=9a3cfd4b8afe49aba4e83a67aed62967&scope.project.id=ef5870ae6e4a4492ac99ab89391674b9&role.id=3c05bedf79e04eb38d2ae66736030bfe => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:03.276361 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd331d5-d3c3-40dc-b9b2-808f3968b0f3 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:03.276927 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd331d5-d3c3-40dc-b9b2-808f3968b0f3 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:03.276927 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd331d5-d3c3-40dc-b9b2-808f3968b0f3 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:03.278956 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 230/455] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:03.284315 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd294f2-9414-4773-a81b-2a0e433360a8 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:03.284740 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd294f2-9414-4773-a81b-2a0e433360a8 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:03.284942 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd294f2-9414-4773-a81b-2a0e433360a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:03.310127 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-cdd294f2-9414-4773-a81b-2a0e433360a8 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:03.311344 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-cdd294f2-9414-4773-a81b-2a0e433360a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:03.323304 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 226/456] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:38:03.360939 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd331d5-d3c3-40dc-b9b2-808f3968b0f3 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:03.373704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd331d5-d3c3-40dc-b9b2-808f3968b0f3 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:03.378465 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4796c5-87b5-44a9-bda2-17a09cf866ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:03.379351 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4796c5-87b5-44a9-bda2-17a09cf866ad admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:03.379632 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4796c5-87b5-44a9-bda2-17a09cf866ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:03.379904 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4796c5-87b5-44a9-bda2-17a09cf866ad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:03.391472 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4796c5-87b5-44a9-bda2-17a09cf866ad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:03.393422 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4796c5-87b5-44a9-bda2-17a09cf866ad admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:03.411479 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-9e4796c5-87b5-44a9-bda2-17a09cf866ad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:03.417125 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 231/457] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:03.418847 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd294f2-9414-4773-a81b-2a0e433360a8 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:03.427927 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd294f2-9414-4773-a81b-2a0e433360a8 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:03.432333 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3052600-643f-4f58-876d-839241f6b371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:03.433009 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3052600-643f-4f58-876d-839241f6b371 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:03.433287 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3052600-643f-4f58-876d-839241f6b371 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:03.433561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3052600-643f-4f58-876d-839241f6b371 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:03.434293 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3052600-643f-4f58-876d-839241f6b371 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:03.434591 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3052600-643f-4f58-876d-839241f6b371 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:03.436188 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3052600-643f-4f58-876d-839241f6b371 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:03.451960 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 227/458] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:03.457795 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4796c5-87b5-44a9-bda2-17a09cf866ad admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:03.469937 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4796c5-87b5-44a9-bda2-17a09cf866ad admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:03.478387 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9725917-d390-4a71-bf57-73a3659398dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:03.479077 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9725917-d390-4a71-bf57-73a3659398dd admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:03.479358 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9725917-d390-4a71-bf57-73a3659398dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:03.479629 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9725917-d390-4a71-bf57-73a3659398dd admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:03.480372 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9725917-d390-4a71-bf57-73a3659398dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:03.482423 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9725917-d390-4a71-bf57-73a3659398dd admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:03.505963 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e581d6-af1f-45ec-9ae0-633f8353b801 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:03.506264 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e581d6-af1f-45ec-9ae0-633f8353b801 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:03.506714 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e581d6-af1f-45ec-9ae0-633f8353b801 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:03.508732 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 228/459] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:03.514227 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d1bd2-a71d-48f4-af0d-96641c3d8431 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:03.514539 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d1bd2-a71d-48f4-af0d-96641c3d8431 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:03.514770 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d1bd2-a71d-48f4-af0d-96641c3d8431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:03.516261 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 232/460] 10.222.0.31 () {60 vars in 1153 bytes} [Mon Jan 10 17:38:03 2022] POST /identity/v3/users => generated 246 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:38:03.546188 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-7b9d1bd2-a71d-48f4-af0d-96641c3d8431 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:03.547311 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-7b9d1bd2-a71d-48f4-af0d-96641c3d8431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:03.561625 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 229/461] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:38:03.599605 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9725917-d390-4a71-bf57-73a3659398dd admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:03.611314 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9725917-d390-4a71-bf57-73a3659398dd admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:03.616555 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a04cce-af8b-4648-8ccb-10f4e7644989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:03.617398 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a04cce-af8b-4648-8ccb-10f4e7644989 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:03.617761 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a04cce-af8b-4648-8ccb-10f4e7644989 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:03.618033 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a04cce-af8b-4648-8ccb-10f4e7644989 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:03.630794 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a04cce-af8b-4648-8ccb-10f4e7644989 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:03.632782 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a04cce-af8b-4648-8ccb-10f4e7644989 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:03.651665 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-81a04cce-af8b-4648-8ccb-10f4e7644989 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:03.653289 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 233/462] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:03.658875 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d1bd2-a71d-48f4-af0d-96641c3d8431 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:03.674176 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d1bd2-a71d-48f4-af0d-96641c3d8431 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:03.690321 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436c51d-8196-4fec-a9bb-2c7354584f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:03.691003 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436c51d-8196-4fec-a9bb-2c7354584f0d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:03.691279 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436c51d-8196-4fec-a9bb-2c7354584f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:03.691547 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436c51d-8196-4fec-a9bb-2c7354584f0d admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:03.692297 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436c51d-8196-4fec-a9bb-2c7354584f0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:03.692596 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436c51d-8196-4fec-a9bb-2c7354584f0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:03.694230 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436c51d-8196-4fec-a9bb-2c7354584f0d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:03.714658 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 230/463] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:03.724939 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a04cce-af8b-4648-8ccb-10f4e7644989 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:03.731027 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a04cce-af8b-4648-8ccb-10f4e7644989 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:03.742944 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e0fd1-d752-47a8-9687-40d71c2cc7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:03.743637 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e0fd1-d752-47a8-9687-40d71c2cc7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:03.743916 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e0fd1-d752-47a8-9687-40d71c2cc7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:03.744184 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e0fd1-d752-47a8-9687-40d71c2cc7b0 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:03.744939 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e0fd1-d752-47a8-9687-40d71c2cc7b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:03.746856 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e0fd1-d752-47a8-9687-40d71c2cc7b0 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:03.793425 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 234/464] 10.222.0.31 () {60 vars in 1153 bytes} [Mon Jan 10 17:38:03 2022] POST /identity/v3/users => generated 248 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:38:03.835783 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e0140-5954-4132-b0f8-a5bbb3e4474b None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:03.835970 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e0140-5954-4132-b0f8-a5bbb3e4474b None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:03.836242 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e0140-5954-4132-b0f8-a5bbb3e4474b None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:03.838128 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 231/465] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:03.843941 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef44994-40c8-40cf-a361-b06bde5426d2 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:03.844214 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef44994-40c8-40cf-a361-b06bde5426d2 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:03.844494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef44994-40c8-40cf-a361-b06bde5426d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:03.866749 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-8ef44994-40c8-40cf-a361-b06bde5426d2 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:03.867962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-8ef44994-40c8-40cf-a361-b06bde5426d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:03.879656 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 235/466] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:38:03.907679 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e0140-5954-4132-b0f8-a5bbb3e4474b None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:03.923738 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e0140-5954-4132-b0f8-a5bbb3e4474b None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:03.928199 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede11f74-8b95-4abd-a074-3940eb3c2413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:03.929074 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede11f74-8b95-4abd-a074-3940eb3c2413 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:03.929357 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede11f74-8b95-4abd-a074-3940eb3c2413 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:03.929623 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede11f74-8b95-4abd-a074-3940eb3c2413 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:03.941683 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede11f74-8b95-4abd-a074-3940eb3c2413 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:03.943614 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede11f74-8b95-4abd-a074-3940eb3c2413 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:03.946345 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6af94-cddf-44c4-8f78-6047cd21d475 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:03.946864 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6af94-cddf-44c4-8f78-6047cd21d475 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:03.947358 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6af94-cddf-44c4-8f78-6047cd21d475 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:03.949703 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 236/467] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:38:03.958689 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee8e78-243b-4aac-84e1-01423abe95ad None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:03.959311 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee8e78-243b-4aac-84e1-01423abe95ad None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:03.959781 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee8e78-243b-4aac-84e1-01423abe95ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:03.963456 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-ede11f74-8b95-4abd-a074-3940eb3c2413 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:03.964792 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 232/468] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:03.971920 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede11f74-8b95-4abd-a074-3940eb3c2413 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:03.985734 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-f5ee8e78-243b-4aac-84e1-01423abe95ad None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:03.987278 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede11f74-8b95-4abd-a074-3940eb3c2413 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:03.987551 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-f5ee8e78-243b-4aac-84e1-01423abe95ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:03.997530 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 237/469] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:38:04.005688 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef1bdb-d0b5-4ea2-b8ee-bd6a38159198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:04.006377 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef1bdb-d0b5-4ea2-b8ee-bd6a38159198 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:04.006655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef1bdb-d0b5-4ea2-b8ee-bd6a38159198 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:04.006925 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef1bdb-d0b5-4ea2-b8ee-bd6a38159198 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:04.008157 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef1bdb-d0b5-4ea2-b8ee-bd6a38159198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:04.008157 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef1bdb-d0b5-4ea2-b8ee-bd6a38159198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:04.011171 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef1bdb-d0b5-4ea2-b8ee-bd6a38159198 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:04.028957 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 233/470] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:04.029979 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee8e78-243b-4aac-84e1-01423abe95ad None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:04.030804 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef1bdb-d0b5-4ea2-b8ee-bd6a38159198 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:04.040738 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee8e78-243b-4aac-84e1-01423abe95ad None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:04.041218 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef1bdb-d0b5-4ea2-b8ee-bd6a38159198 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:04.046814 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce856d-129c-4ae0-9dea-138b7fd8c865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:04.047136 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c188cdc-ba1c-4999-9aff-58b83b3e298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:04.047892 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce856d-129c-4ae0-9dea-138b7fd8c865 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:04.048187 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c188cdc-ba1c-4999-9aff-58b83b3e298d admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:04.048336 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce856d-129c-4ae0-9dea-138b7fd8c865 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:04.048702 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce856d-129c-4ae0-9dea-138b7fd8c865 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:04.048958 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c188cdc-ba1c-4999-9aff-58b83b3e298d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:04.049423 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c188cdc-ba1c-4999-9aff-58b83b3e298d admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:04.050340 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c188cdc-ba1c-4999-9aff-58b83b3e298d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:04.052560 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c188cdc-ba1c-4999-9aff-58b83b3e298d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:04.064436 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce856d-129c-4ae0-9dea-138b7fd8c865 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:04.066735 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce856d-129c-4ae0-9dea-138b7fd8c865 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:04.084688 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-f4ce856d-129c-4ae0-9dea-138b7fd8c865 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:04.085006 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 234/471] 10.222.0.31 () {60 vars in 1153 bytes} [Mon Jan 10 17:38:04 2022] POST /identity/v3/users => generated 249 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:38:04.086802 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 238/472] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:04.092771 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c188cdc-ba1c-4999-9aff-58b83b3e298d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:04.103994 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c188cdc-ba1c-4999-9aff-58b83b3e298d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:04.110265 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4dfaef-c92a-4acc-ba74-df03c183b434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:04.111338 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dfaef-c92a-4acc-ba74-df03c183b434 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:04.111846 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dfaef-c92a-4acc-ba74-df03c183b434 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:04.112292 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dfaef-c92a-4acc-ba74-df03c183b434 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:04.113254 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4dfaef-c92a-4acc-ba74-df03c183b434 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:04.113764 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4dfaef-c92a-4acc-ba74-df03c183b434 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:04.115719 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4dfaef-c92a-4acc-ba74-df03c183b434 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:04.130114 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 235/473] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:04.135751 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce856d-129c-4ae0-9dea-138b7fd8c865 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:04.147036 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce856d-129c-4ae0-9dea-138b7fd8c865 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:04.152823 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68783dc-16d5-46dd-8ee8-75282d3d5041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:04.153897 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68783dc-16d5-46dd-8ee8-75282d3d5041 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:04.154351 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68783dc-16d5-46dd-8ee8-75282d3d5041 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:04.154813 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68783dc-16d5-46dd-8ee8-75282d3d5041 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:04.155883 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68783dc-16d5-46dd-8ee8-75282d3d5041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:04.158131 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68783dc-16d5-46dd-8ee8-75282d3d5041 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:04.189088 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 239/474] 10.222.0.31 () {60 vars in 1153 bytes} [Mon Jan 10 17:38:04 2022] POST /identity/v3/users => generated 248 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:38:05.009785 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c9660-742e-449f-b114-872ef3f69d83 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:05.010279 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c9660-742e-449f-b114-872ef3f69d83 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:05.010279 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c9660-742e-449f-b114-872ef3f69d83 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:05.012302 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 236/475] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:05.022270 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c06b09-e65d-4488-bb01-7a5d900b807e None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:05.022694 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c06b09-e65d-4488-bb01-7a5d900b807e None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:05.022864 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c06b09-e65d-4488-bb01-7a5d900b807e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:05.049833 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-c4c06b09-e65d-4488-bb01-7a5d900b807e None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:05.051007 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-c4c06b09-e65d-4488-bb01-7a5d900b807e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:05.058587 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 240/476] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:38:05.102932 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c9660-742e-449f-b114-872ef3f69d83 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:05.118412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c9660-742e-449f-b114-872ef3f69d83 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:05.123067 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc940d50-e293-4118-b805-caf6728e6b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:05.123720 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc940d50-e293-4118-b805-caf6728e6b7d admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:05.123996 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc940d50-e293-4118-b805-caf6728e6b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:05.124266 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc940d50-e293-4118-b805-caf6728e6b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:05.125061 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc940d50-e293-4118-b805-caf6728e6b7d admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:05.126659 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc940d50-e293-4118-b805-caf6728e6b7d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:05.138890 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.sql.core [None req-bc940d50-e293-4118-b805-caf6728e6b7d admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jan 10 17:38:05.138890 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jan 10 17:38:05.138890 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [parameters: {'id': '12ac9031829f4e48b40ba7249d6cadee', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jan 10 17:38:05.138890 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=90763) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 10 17:38:05.153922 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-bc940d50-e293-4118-b805-caf6728e6b7d admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jan 10 17:38:05.155272 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 237/477] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:38:05 2022] POST /identity/v3/roles => generated 144 bytes in 53 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:05.161251 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c06b09-e65d-4488-bb01-7a5d900b807e None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:05.170279 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c06b09-e65d-4488-bb01-7a5d900b807e None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:05.180098 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7fc03-ed56-4fd9-b935-209df8d7fdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:05.180932 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7fc03-ed56-4fd9-b935-209df8d7fdcb admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:05.181214 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7fc03-ed56-4fd9-b935-209df8d7fdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:05.181485 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7fc03-ed56-4fd9-b935-209df8d7fdcb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:05.194716 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7fc03-ed56-4fd9-b935-209df8d7fdcb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:05.203868 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-e8a7fc03-ed56-4fd9-b935-209df8d7fdcb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 17:38:05.205344 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 241/478] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:38:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:05.211052 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc940d50-e293-4118-b805-caf6728e6b7d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:05.221985 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc940d50-e293-4118-b805-caf6728e6b7d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:05.232054 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342528ed-4658-4d65-8c53-381491ef0c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:05.232717 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342528ed-4658-4d65-8c53-381491ef0c31 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:05.233030 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342528ed-4658-4d65-8c53-381491ef0c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:05.233301 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342528ed-4658-4d65-8c53-381491ef0c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:05.234061 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342528ed-4658-4d65-8c53-381491ef0c31 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:05.234366 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342528ed-4658-4d65-8c53-381491ef0c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:05.235982 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342528ed-4658-4d65-8c53-381491ef0c31 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:05.248453 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 238/479] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:06.456473 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1996699-09cd-4b8f-8a17-ee4a166586ba None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:06.457215 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1996699-09cd-4b8f-8a17-ee4a166586ba None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:06.457215 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1996699-09cd-4b8f-8a17-ee4a166586ba None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:06.459063 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 242/480] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:06.464470 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cb98b-a04a-4632-b8a9-16d60f83c6e2 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:06.464977 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cb98b-a04a-4632-b8a9-16d60f83c6e2 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:06.465137 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cb98b-a04a-4632-b8a9-16d60f83c6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:06.489842 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-b17cb98b-a04a-4632-b8a9-16d60f83c6e2 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:06.491031 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b17cb98b-a04a-4632-b8a9-16d60f83c6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:06.504731 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 239/481] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:38:06.529844 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1996699-09cd-4b8f-8a17-ee4a166586ba None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:06.542344 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1996699-09cd-4b8f-8a17-ee4a166586ba None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:06.546584 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662bb03-3c7c-46dc-9d8b-7a1780c714f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:06.547370 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662bb03-3c7c-46dc-9d8b-7a1780c714f8 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:06.547647 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662bb03-3c7c-46dc-9d8b-7a1780c714f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:06.547920 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662bb03-3c7c-46dc-9d8b-7a1780c714f8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:06.558758 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662bb03-3c7c-46dc-9d8b-7a1780c714f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:06.565598 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-f662bb03-3c7c-46dc-9d8b-7a1780c714f8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 17:38:06.571558 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 243/482] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:38:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:06.572971 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cb98b-a04a-4632-b8a9-16d60f83c6e2 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:06.581952 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cb98b-a04a-4632-b8a9-16d60f83c6e2 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:06.586499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1639c96-5c2d-4d8f-9f44-c572e84bdc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:06.587186 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1639c96-5c2d-4d8f-9f44-c572e84bdc02 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:06.587462 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1639c96-5c2d-4d8f-9f44-c572e84bdc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:06.587734 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1639c96-5c2d-4d8f-9f44-c572e84bdc02 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:06.588525 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1639c96-5c2d-4d8f-9f44-c572e84bdc02 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:06.588829 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1639c96-5c2d-4d8f-9f44-c572e84bdc02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:06.590545 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1639c96-5c2d-4d8f-9f44-c572e84bdc02 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:06.604485 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 240/483] 10.222.0.31 () {56 vars in 1124 bytes} [Mon Jan 10 17:38:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:06.605994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662bb03-3c7c-46dc-9d8b-7a1780c714f8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:06.615801 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662bb03-3c7c-46dc-9d8b-7a1780c714f8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:06.620232 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b56e2-9f3c-4127-9f8c-d6598ce13070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:06.621066 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b56e2-9f3c-4127-9f8c-d6598ce13070 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:06.621345 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b56e2-9f3c-4127-9f8c-d6598ce13070 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:06.621617 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b56e2-9f3c-4127-9f8c-d6598ce13070 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:06.633411 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b56e2-9f3c-4127-9f8c-d6598ce13070 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:06.635277 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b56e2-9f3c-4127-9f8c-d6598ce13070 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:06.652828 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-eb3b56e2-9f3c-4127-9f8c-d6598ce13070 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:06.654347 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 244/484] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:06.660086 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1639c96-5c2d-4d8f-9f44-c572e84bdc02 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:06.669764 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1639c96-5c2d-4d8f-9f44-c572e84bdc02 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:06.674123 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e733c-c95f-421b-86c6-56421bf24fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:06.674951 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e733c-c95f-421b-86c6-56421bf24fbf admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:06.675230 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e733c-c95f-421b-86c6-56421bf24fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:06.675503 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e733c-c95f-421b-86c6-56421bf24fbf admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:06.676247 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e733c-c95f-421b-86c6-56421bf24fbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:06.676547 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e733c-c95f-421b-86c6-56421bf24fbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:06.678178 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e733c-c95f-421b-86c6-56421bf24fbf admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:06.694521 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 241/485] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:06.699924 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b56e2-9f3c-4127-9f8c-d6598ce13070 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:06.713936 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b56e2-9f3c-4127-9f8c-d6598ce13070 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:06.720545 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095b97d-530f-4a29-9cc4-12c7c26bb459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:06.721416 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095b97d-530f-4a29-9cc4-12c7c26bb459 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:06.721696 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095b97d-530f-4a29-9cc4-12c7c26bb459 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:06.721969 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095b97d-530f-4a29-9cc4-12c7c26bb459 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:06.737983 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095b97d-530f-4a29-9cc4-12c7c26bb459 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:06.740030 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095b97d-530f-4a29-9cc4-12c7c26bb459 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:06.749455 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394190b-8c9a-49ee-819c-6c8d18a16139 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:06.749739 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394190b-8c9a-49ee-819c-6c8d18a16139 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:06.750016 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394190b-8c9a-49ee-819c-6c8d18a16139 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:06.751919 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 242/486] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:38:06.756598 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af680dc-994d-45cb-b4a5-a94f0be1f3ad None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:06.756999 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af680dc-994d-45cb-b4a5-a94f0be1f3ad None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:06.757186 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af680dc-994d-45cb-b4a5-a94f0be1f3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:06.763964 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-9095b97d-530f-4a29-9cc4-12c7c26bb459 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 17:38:06.765536 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 245/487] 10.222.0.31 () {56 vars in 1114 bytes} [Mon Jan 10 17:38:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:06.771041 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095b97d-530f-4a29-9cc4-12c7c26bb459 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:06.781323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095b97d-530f-4a29-9cc4-12c7c26bb459 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:06.785987 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f652628-616b-44b6-bcde-4e091aa52a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:06.786748 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f652628-616b-44b6-bcde-4e091aa52a77 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:06.787014 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f652628-616b-44b6-bcde-4e091aa52a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:06.787280 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f652628-616b-44b6-bcde-4e091aa52a77 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:06.788202 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f652628-616b-44b6-bcde-4e091aa52a77 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:06.788504 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f652628-616b-44b6-bcde-4e091aa52a77 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:06.789719 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING py.warnings [None req-7f652628-616b-44b6-bcde-4e091aa52a77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:38:06.789719 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: warnings.warn(msg) Jan 10 17:38:06.789719 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: Jan 10 17:38:06.790944 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f652628-616b-44b6-bcde-4e091aa52a77 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:06.794024 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-9af680dc-994d-45cb-b4a5-a94f0be1f3ad None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:06.795255 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-9af680dc-994d-45cb-b4a5-a94f0be1f3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:06.819574 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 243/488] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:38:06.846198 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 246/489] 10.222.0.31 () {56 vars in 1154 bytes} [Mon Jan 10 17:38:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:06.846398 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af680dc-994d-45cb-b4a5-a94f0be1f3ad None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:06.858044 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f652628-616b-44b6-bcde-4e091aa52a77 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:06.859032 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af680dc-994d-45cb-b4a5-a94f0be1f3ad None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:06.863534 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507bed6-02e0-4b56-aa05-f708227e1e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:06.864330 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507bed6-02e0-4b56-aa05-f708227e1e17 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:06.864608 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507bed6-02e0-4b56-aa05-f708227e1e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:06.865998 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507bed6-02e0-4b56-aa05-f708227e1e17 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:06.869743 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f652628-616b-44b6-bcde-4e091aa52a77 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:06.877632 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58adcf-d261-48da-bb84-0b128afde05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:06.878294 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58adcf-d261-48da-bb84-0b128afde05b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:06.878572 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58adcf-d261-48da-bb84-0b128afde05b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:06.878845 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58adcf-d261-48da-bb84-0b128afde05b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:06.883640 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507bed6-02e0-4b56-aa05-f708227e1e17 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:06.890790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-a507bed6-02e0-4b56-aa05-f708227e1e17 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 17:38:06.892581 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 244/490] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:38:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:06.896930 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58adcf-d261-48da-bb84-0b128afde05b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:06.898550 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507bed6-02e0-4b56-aa05-f708227e1e17 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:06.898775 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58adcf-d261-48da-bb84-0b128afde05b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:06.908487 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507bed6-02e0-4b56-aa05-f708227e1e17 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:06.913233 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feceeffe-e6f0-4995-b23f-20fa39925f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:06.913890 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feceeffe-e6f0-4995-b23f-20fa39925f78 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:06.914216 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feceeffe-e6f0-4995-b23f-20fa39925f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:06.914493 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feceeffe-e6f0-4995-b23f-20fa39925f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:06.915257 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feceeffe-e6f0-4995-b23f-20fa39925f78 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:06.915589 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feceeffe-e6f0-4995-b23f-20fa39925f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:06.917291 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feceeffe-e6f0-4995-b23f-20fa39925f78 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:06.919786 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 247/491] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 17:38:06.926905 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 245/492] 10.222.0.31 () {56 vars in 1124 bytes} [Mon Jan 10 17:38:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:06.929823 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58adcf-d261-48da-bb84-0b128afde05b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:06.932127 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feceeffe-e6f0-4995-b23f-20fa39925f78 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:06.941744 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feceeffe-e6f0-4995-b23f-20fa39925f78 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:06.944478 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58adcf-d261-48da-bb84-0b128afde05b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:06.950684 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef5c12-07b5-4086-a2ee-a44818640de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:06.951473 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef5c12-07b5-4086-a2ee-a44818640de6 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:06.953251 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef5c12-07b5-4086-a2ee-a44818640de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:06.954066 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef5c12-07b5-4086-a2ee-a44818640de6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:06.955329 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cc9df-0ad8-46e8-b353-e39711f692e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:06.957615 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cc9df-0ad8-46e8-b353-e39711f692e8 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:06.957795 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cc9df-0ad8-46e8-b353-e39711f692e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:06.958067 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cc9df-0ad8-46e8-b353-e39711f692e8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:06.974347 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef5c12-07b5-4086-a2ee-a44818640de6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:06.977132 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef5c12-07b5-4086-a2ee-a44818640de6 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:06.978714 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cc9df-0ad8-46e8-b353-e39711f692e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:06.980561 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cc9df-0ad8-46e8-b353-e39711f692e8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.013740 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-1a2cc9df-0ad8-46e8-b353-e39711f692e8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:07.014946 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-a8ef5c12-07b5-4086-a2ee-a44818640de6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:07.016320 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 246/493] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:07.020939 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 248/494] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:07.022284 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef5c12-07b5-4086-a2ee-a44818640de6 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.022609 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cc9df-0ad8-46e8-b353-e39711f692e8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.037042 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cc9df-0ad8-46e8-b353-e39711f692e8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.040464 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef5c12-07b5-4086-a2ee-a44818640de6 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.045606 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ac797-9df2-45e1-b6a7-f2c6c57681aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.048146 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ac797-9df2-45e1-b6a7-f2c6c57681aa admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.048628 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ac797-9df2-45e1-b6a7-f2c6c57681aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.049580 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ac797-9df2-45e1-b6a7-f2c6c57681aa admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.050526 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ac797-9df2-45e1-b6a7-f2c6c57681aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:07.051428 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ac797-9df2-45e1-b6a7-f2c6c57681aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.052677 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a5ffd-c9da-427d-9106-531ceae10256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.054042 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a5ffd-c9da-427d-9106-531ceae10256 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.054937 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING py.warnings [None req-854ac797-9df2-45e1-b6a7-f2c6c57681aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:38:07.054937 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: warnings.warn(msg) Jan 10 17:38:07.054937 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: Jan 10 17:38:07.056172 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a5ffd-c9da-427d-9106-531ceae10256 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.056648 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a5ffd-c9da-427d-9106-531ceae10256 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.057568 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ac797-9df2-45e1-b6a7-f2c6c57681aa admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.058743 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a5ffd-c9da-427d-9106-531ceae10256 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:07.059612 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a5ffd-c9da-427d-9106-531ceae10256 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.061453 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a5ffd-c9da-427d-9106-531ceae10256 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.084029 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 247/495] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:07.092820 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 249/496] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:07.094021 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a5ffd-c9da-427d-9106-531ceae10256 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.097668 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ac797-9df2-45e1-b6a7-f2c6c57681aa admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.106541 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a5ffd-c9da-427d-9106-531ceae10256 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.107742 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ac797-9df2-45e1-b6a7-f2c6c57681aa admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.118735 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4c367-54f1-4f43-ac63-e00582dc8534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.119820 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e79821-d237-418d-925c-063956df9a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.121231 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4c367-54f1-4f43-ac63-e00582dc8534 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.121824 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e79821-d237-418d-925c-063956df9a27 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.122161 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4c367-54f1-4f43-ac63-e00582dc8534 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.122762 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e79821-d237-418d-925c-063956df9a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.123102 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4c367-54f1-4f43-ac63-e00582dc8534 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.124110 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e79821-d237-418d-925c-063956df9a27 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.138542 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4c367-54f1-4f43-ac63-e00582dc8534 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.139572 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e79821-d237-418d-925c-063956df9a27 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.142965 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4c367-54f1-4f43-ac63-e00582dc8534 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.144809 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e79821-d237-418d-925c-063956df9a27 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.166534 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-b9e79821-d237-418d-925c-063956df9a27 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:07.167284 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-53b4c367-54f1-4f43-ac63-e00582dc8534 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 10 17:38:07.172948 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 248/497] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:07.173082 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 250/498] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:07.174496 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4c367-54f1-4f43-ac63-e00582dc8534 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.182401 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e79821-d237-418d-925c-063956df9a27 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.187439 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4c367-54f1-4f43-ac63-e00582dc8534 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.197001 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e79821-d237-418d-925c-063956df9a27 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.203958 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1e4b1-822a-4735-82d9-97074280a162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.204650 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1e4b1-822a-4735-82d9-97074280a162 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.205612 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c620a-baad-4748-9a45-da085942472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.206284 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c620a-baad-4748-9a45-da085942472a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.206560 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c620a-baad-4748-9a45-da085942472a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.206827 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c620a-baad-4748-9a45-da085942472a admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.207647 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c620a-baad-4748-9a45-da085942472a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:07.207949 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c620a-baad-4748-9a45-da085942472a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.209051 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING py.warnings [None req-ae3c620a-baad-4748-9a45-da085942472a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:38:07.209051 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: warnings.warn(msg) Jan 10 17:38:07.209051 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: Jan 10 17:38:07.210213 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c620a-baad-4748-9a45-da085942472a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.212233 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1e4b1-822a-4735-82d9-97074280a162 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.212569 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1e4b1-822a-4735-82d9-97074280a162 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.213516 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1e4b1-822a-4735-82d9-97074280a162 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:07.213829 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1e4b1-822a-4735-82d9-97074280a162 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.214858 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING py.warnings [None req-ffe1e4b1-822a-4735-82d9-97074280a162 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:38:07.214858 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: warnings.warn(msg) Jan 10 17:38:07.214858 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: Jan 10 17:38:07.215994 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1e4b1-822a-4735-82d9-97074280a162 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.256059 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 251/499] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:07.257368 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09cd94-d009-4ec3-aef8-be33f7947e92 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.257651 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09cd94-d009-4ec3-aef8-be33f7947e92 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.257925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09cd94-d009-4ec3-aef8-be33f7947e92 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.259765 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 252/500] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:07.265805 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09cd94-d009-4ec3-aef8-be33f7947e92 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.272216 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 249/501] 10.222.0.31 () {56 vars in 1158 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:07.273887 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde1016-4c34-4689-b521-4c36cf9fa688 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.274170 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde1016-4c34-4689-b521-4c36cf9fa688 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.274440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde1016-4c34-4689-b521-4c36cf9fa688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.282268 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09cd94-d009-4ec3-aef8-be33f7947e92 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.286979 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f4ca7-403d-467f-bda0-ca85bc58aa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.287854 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f4ca7-403d-467f-bda0-ca85bc58aa80 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.288319 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f4ca7-403d-467f-bda0-ca85bc58aa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.288806 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f4ca7-403d-467f-bda0-ca85bc58aa80 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.289861 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f4ca7-403d-467f-bda0-ca85bc58aa80 admin admin] RBAC: Adding query filter params (role.id=67bb9b9aab104609b23a2ab5e7d31142, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=877acd6448214ef893d119e3b1043402) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:07.290358 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f4ca7-403d-467f-bda0-ca85bc58aa80 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.292401 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f4ca7-403d-467f-bda0-ca85bc58aa80 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.294496 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-4cde1016-4c34-4689-b521-4c36cf9fa688 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:07.296030 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-4cde1016-4c34-4689-b521-4c36cf9fa688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:07.299301 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 253/502] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/role_assignments?user.id=877acd6448214ef893d119e3b1043402&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=67bb9b9aab104609b23a2ab5e7d31142 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:07.300521 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f4ca7-403d-467f-bda0-ca85bc58aa80 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.304091 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 250/503] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:38:07.305568 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae806fe-44d6-4467-b69c-d4d377996743 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.305941 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae806fe-44d6-4467-b69c-d4d377996743 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.306217 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae806fe-44d6-4467-b69c-d4d377996743 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.308168 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 251/504] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:07.312354 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f4ca7-403d-467f-bda0-ca85bc58aa80 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.313232 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb16091-c139-4786-a1f8-5743e522f7f6 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.313619 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb16091-c139-4786-a1f8-5743e522f7f6 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.313903 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb16091-c139-4786-a1f8-5743e522f7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.317917 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb42bd3-2827-4557-a48b-6745e7f5388b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.318897 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb42bd3-2827-4557-a48b-6745e7f5388b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.319368 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb42bd3-2827-4557-a48b-6745e7f5388b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.319940 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb42bd3-2827-4557-a48b-6745e7f5388b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.328613 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb42bd3-2827-4557-a48b-6745e7f5388b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.330779 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb42bd3-2827-4557-a48b-6745e7f5388b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.333669 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-aeb16091-c139-4786-a1f8-5743e522f7f6 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:07.334982 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-aeb16091-c139-4786-a1f8-5743e522f7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:07.342261 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 254/505] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:38:07.344115 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 252/506] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:38:07.350315 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb42bd3-2827-4557-a48b-6745e7f5388b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.355215 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb16091-c139-4786-a1f8-5743e522f7f6 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.366524 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb42bd3-2827-4557-a48b-6745e7f5388b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.371364 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb16091-c139-4786-a1f8-5743e522f7f6 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.376761 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dfa78-03d1-4498-b62f-4c18f543078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.377648 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dfa78-03d1-4498-b62f-4c18f543078b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.377925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dfa78-03d1-4498-b62f-4c18f543078b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.378184 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dfa78-03d1-4498-b62f-4c18f543078b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.382742 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3572f88-f75d-4abd-936a-8313e65b5904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.383553 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3572f88-f75d-4abd-936a-8313e65b5904 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.383827 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3572f88-f75d-4abd-936a-8313e65b5904 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.384094 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3572f88-f75d-4abd-936a-8313e65b5904 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.397424 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4dfa78-03d1-4498-b62f-4c18f543078b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.400797 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4dfa78-03d1-4498-b62f-4c18f543078b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.403650 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3572f88-f75d-4abd-936a-8313e65b5904 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:07.411538 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-a3572f88-f75d-4abd-936a-8313e65b5904 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 17:38:07.412402 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 253/507] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:07.418291 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3572f88-f75d-4abd-936a-8313e65b5904 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.423166 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-cc4dfa78-03d1-4498-b62f-4c18f543078b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:07.426025 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 255/508] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:07.427063 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dfa78-03d1-4498-b62f-4c18f543078b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.433612 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3572f88-f75d-4abd-936a-8313e65b5904 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.438531 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8d931-78b2-40c7-987c-d3644108880f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.439213 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dfa78-03d1-4498-b62f-4c18f543078b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.439322 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8d931-78b2-40c7-987c-d3644108880f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.439597 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8d931-78b2-40c7-987c-d3644108880f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.439907 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8d931-78b2-40c7-987c-d3644108880f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.445138 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36e765-b42d-4947-a426-6259c7c96b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.446376 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36e765-b42d-4947-a426-6259c7c96b16 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.446918 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36e765-b42d-4947-a426-6259c7c96b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.447416 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36e765-b42d-4947-a426-6259c7c96b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.448550 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36e765-b42d-4947-a426-6259c7c96b16 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:07.449381 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36e765-b42d-4947-a426-6259c7c96b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.451413 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36e765-b42d-4947-a426-6259c7c96b16 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.452255 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8d931-78b2-40c7-987c-d3644108880f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:07.460009 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-00c8d931-78b2-40c7-987c-d3644108880f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 17:38:07.461551 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 256/509] 10.222.0.31 () {56 vars in 1124 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:07.466591 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 254/510] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:07.467412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8d931-78b2-40c7-987c-d3644108880f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.468594 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36e765-b42d-4947-a426-6259c7c96b16 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.478494 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8d931-78b2-40c7-987c-d3644108880f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.480396 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36e765-b42d-4947-a426-6259c7c96b16 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.483467 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29c982-7853-4a6d-bdac-e0df40ebd2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.484257 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29c982-7853-4a6d-bdac-e0df40ebd2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.484600 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29c982-7853-4a6d-bdac-e0df40ebd2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.485008 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29c982-7853-4a6d-bdac-e0df40ebd2d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.485826 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29c982-7853-4a6d-bdac-e0df40ebd2d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:07.486234 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29c982-7853-4a6d-bdac-e0df40ebd2d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.486801 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72723d3-8dd3-4e81-a12a-2706d51a5aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.487805 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72723d3-8dd3-4e81-a12a-2706d51a5aea admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.488258 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72723d3-8dd3-4e81-a12a-2706d51a5aea admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.488359 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29c982-7853-4a6d-bdac-e0df40ebd2d1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.488817 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72723d3-8dd3-4e81-a12a-2706d51a5aea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.503226 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72723d3-8dd3-4e81-a12a-2706d51a5aea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.505482 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72723d3-8dd3-4e81-a12a-2706d51a5aea admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.507469 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 255/511] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:07.508520 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29c982-7853-4a6d-bdac-e0df40ebd2d1 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.519028 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29c982-7853-4a6d-bdac-e0df40ebd2d1 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.524119 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a8633-74d1-4da7-b336-785d35dc4cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.525065 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a8633-74d1-4da7-b336-785d35dc4cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.525410 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a8633-74d1-4da7-b336-785d35dc4cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.525795 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a8633-74d1-4da7-b336-785d35dc4cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.526639 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a8633-74d1-4da7-b336-785d35dc4cc0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:07.527011 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a8633-74d1-4da7-b336-785d35dc4cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.527973 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-b72723d3-8dd3-4e81-a12a-2706d51a5aea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:07.528963 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a8633-74d1-4da7-b336-785d35dc4cc0 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.529640 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 257/512] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:07.530593 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72723d3-8dd3-4e81-a12a-2706d51a5aea admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.542306 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72723d3-8dd3-4e81-a12a-2706d51a5aea admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.543592 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 256/513] 10.222.0.31 () {56 vars in 1124 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:07.544540 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a8633-74d1-4da7-b336-785d35dc4cc0 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.547524 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452a353-54ce-4385-a775-22599c11089f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.548569 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452a353-54ce-4385-a775-22599c11089f admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.549091 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452a353-54ce-4385-a775-22599c11089f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.549613 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452a353-54ce-4385-a775-22599c11089f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.555522 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a8633-74d1-4da7-b336-785d35dc4cc0 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.559595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452a353-54ce-4385-a775-22599c11089f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.560355 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca183d-76ba-4ffe-9a08-c5ec61022883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.561139 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca183d-76ba-4ffe-9a08-c5ec61022883 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.561486 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca183d-76ba-4ffe-9a08-c5ec61022883 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.561824 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca183d-76ba-4ffe-9a08-c5ec61022883 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.562682 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452a353-54ce-4385-a775-22599c11089f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.562784 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca183d-76ba-4ffe-9a08-c5ec61022883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:07.563089 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca183d-76ba-4ffe-9a08-c5ec61022883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.564954 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca183d-76ba-4ffe-9a08-c5ec61022883 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.578689 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-0452a353-54ce-4385-a775-22599c11089f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:07.580193 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 258/514] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:07.580973 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452a353-54ce-4385-a775-22599c11089f admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.589397 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 257/515] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:07.590604 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca183d-76ba-4ffe-9a08-c5ec61022883 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.594860 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452a353-54ce-4385-a775-22599c11089f admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.600332 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dad8d-61a6-4b37-b5e4-b48265a2c9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.601264 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dad8d-61a6-4b37-b5e4-b48265a2c9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.601561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca183d-76ba-4ffe-9a08-c5ec61022883 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.601661 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dad8d-61a6-4b37-b5e4-b48265a2c9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.601909 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dad8d-61a6-4b37-b5e4-b48265a2c9e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.606489 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8be18-b6fb-42b5-9b80-40ad282d090c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.607345 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8be18-b6fb-42b5-9b80-40ad282d090c admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.607788 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8be18-b6fb-42b5-9b80-40ad282d090c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.608233 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8be18-b6fb-42b5-9b80-40ad282d090c admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.609253 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8be18-b6fb-42b5-9b80-40ad282d090c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:07.609558 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8be18-b6fb-42b5-9b80-40ad282d090c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.610580 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING py.warnings [None req-e3e8be18-b6fb-42b5-9b80-40ad282d090c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:38:07.610580 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: warnings.warn(msg) Jan 10 17:38:07.610580 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: Jan 10 17:38:07.611877 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8be18-b6fb-42b5-9b80-40ad282d090c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.614130 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149dad8d-61a6-4b37-b5e4-b48265a2c9e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.616705 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149dad8d-61a6-4b37-b5e4-b48265a2c9e6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.629553 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 258/516] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:07.634835 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8be18-b6fb-42b5-9b80-40ad282d090c admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.636393 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-149dad8d-61a6-4b37-b5e4-b48265a2c9e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:07.637817 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 259/517] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:07.638895 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dad8d-61a6-4b37-b5e4-b48265a2c9e6 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.645049 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8be18-b6fb-42b5-9b80-40ad282d090c admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.650067 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bfb1b-1b4a-4433-8feb-f5dd51a9e210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.650862 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bfb1b-1b4a-4433-8feb-f5dd51a9e210 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.651131 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bfb1b-1b4a-4433-8feb-f5dd51a9e210 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.651404 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bfb1b-1b4a-4433-8feb-f5dd51a9e210 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.652160 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dad8d-61a6-4b37-b5e4-b48265a2c9e6 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.657566 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09797538-103e-43bb-a05e-856018178418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.658732 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09797538-103e-43bb-a05e-856018178418 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.659209 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bfb1b-1b4a-4433-8feb-f5dd51a9e210 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.659492 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09797538-103e-43bb-a05e-856018178418 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.659968 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09797538-103e-43bb-a05e-856018178418 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.661034 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09797538-103e-43bb-a05e-856018178418 admin admin] RBAC: Adding query filter params (role.id=67bb9b9aab104609b23a2ab5e7d31142, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=955fd3e0d82f416c99001bdc7f129017) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:07.661413 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bfb1b-1b4a-4433-8feb-f5dd51a9e210 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.661798 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09797538-103e-43bb-a05e-856018178418 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.664560 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09797538-103e-43bb-a05e-856018178418 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.670942 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 260/518] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/role_assignments?user.id=955fd3e0d82f416c99001bdc7f129017&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=67bb9b9aab104609b23a2ab5e7d31142 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:07.671982 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09797538-103e-43bb-a05e-856018178418 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.684243 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-b81bfb1b-1b4a-4433-8feb-f5dd51a9e210 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 10 17:38:07.686079 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 259/519] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:07.688448 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09797538-103e-43bb-a05e-856018178418 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.697841 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bd81d-dfa3-44c3-a8a7-8ad19c9b9692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.698893 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bd81d-dfa3-44c3-a8a7-8ad19c9b9692 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.699390 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bd81d-dfa3-44c3-a8a7-8ad19c9b9692 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.699851 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bd81d-dfa3-44c3-a8a7-8ad19c9b9692 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.700821 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bd81d-dfa3-44c3-a8a7-8ad19c9b9692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:07.701366 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bd81d-dfa3-44c3-a8a7-8ad19c9b9692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.703209 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bd81d-dfa3-44c3-a8a7-8ad19c9b9692 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.706862 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bfb1b-1b4a-4433-8feb-f5dd51a9e210 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.716905 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bfb1b-1b4a-4433-8feb-f5dd51a9e210 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.721897 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ac7e1-4e5e-4857-b8d7-5accec96a976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.722906 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ac7e1-4e5e-4857-b8d7-5accec96a976 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.723379 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ac7e1-4e5e-4857-b8d7-5accec96a976 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.723871 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ac7e1-4e5e-4857-b8d7-5accec96a976 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.724945 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ac7e1-4e5e-4857-b8d7-5accec96a976 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:07.725459 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ac7e1-4e5e-4857-b8d7-5accec96a976 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.727680 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ac7e1-4e5e-4857-b8d7-5accec96a976 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.731786 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 261/520] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:07.737120 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bd81d-dfa3-44c3-a8a7-8ad19c9b9692 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.748602 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 260/521] 10.222.0.31 () {56 vars in 1158 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:07.753308 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bd81d-dfa3-44c3-a8a7-8ad19c9b9692 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.754921 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ac7e1-4e5e-4857-b8d7-5accec96a976 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.762706 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78130406-5fab-4a9f-a158-6949bce18721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.763243 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78130406-5fab-4a9f-a158-6949bce18721 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.763570 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78130406-5fab-4a9f-a158-6949bce18721 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.763892 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78130406-5fab-4a9f-a158-6949bce18721 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.767187 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ac7e1-4e5e-4857-b8d7-5accec96a976 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.772054 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ab286-b202-410c-964c-65f0469dac35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.773353 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ab286-b202-410c-964c-65f0469dac35 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.773862 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ab286-b202-410c-964c-65f0469dac35 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.774346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ab286-b202-410c-964c-65f0469dac35 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.778177 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78130406-5fab-4a9f-a158-6949bce18721 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.780337 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78130406-5fab-4a9f-a158-6949bce18721 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.784141 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ab286-b202-410c-964c-65f0469dac35 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.786259 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ab286-b202-410c-964c-65f0469dac35 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.794902 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-78130406-5fab-4a9f-a158-6949bce18721 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 10 17:38:07.796623 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 261/522] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:38:07.796794 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 262/523] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:07.809149 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78130406-5fab-4a9f-a158-6949bce18721 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.811154 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ab286-b202-410c-964c-65f0469dac35 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.826960 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78130406-5fab-4a9f-a158-6949bce18721 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.830121 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ab286-b202-410c-964c-65f0469dac35 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.837435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c748c-c1f9-4dc7-a755-eccaa1a169fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.839124 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5f949-1bc4-4355-aded-5db359899fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.840105 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c748c-c1f9-4dc7-a755-eccaa1a169fd admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.840708 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c748c-c1f9-4dc7-a755-eccaa1a169fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.841566 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5f949-1bc4-4355-aded-5db359899fcf admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.841977 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c748c-c1f9-4dc7-a755-eccaa1a169fd admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.843018 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c748c-c1f9-4dc7-a755-eccaa1a169fd admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:07.843487 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5f949-1bc4-4355-aded-5db359899fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.844240 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c748c-c1f9-4dc7-a755-eccaa1a169fd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.844368 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5f949-1bc4-4355-aded-5db359899fcf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.847513 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c748c-c1f9-4dc7-a755-eccaa1a169fd admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.867800 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5f949-1bc4-4355-aded-5db359899fcf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.870044 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5f949-1bc4-4355-aded-5db359899fcf admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.885836 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 263/524] 10.222.0.31 () {56 vars in 1160 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:07.896982 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c748c-c1f9-4dc7-a755-eccaa1a169fd admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.914534 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c748c-c1f9-4dc7-a755-eccaa1a169fd admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.917333 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-55a5f949-1bc4-4355-aded-5db359899fcf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:07.919284 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 262/525] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:07.925392 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5f949-1bc4-4355-aded-5db359899fcf admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.933589 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990e2cc-c2a3-4804-ba44-3ec87dca774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.934501 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990e2cc-c2a3-4804-ba44-3ec87dca774b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.934916 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990e2cc-c2a3-4804-ba44-3ec87dca774b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.935347 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990e2cc-c2a3-4804-ba44-3ec87dca774b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.946230 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5f949-1bc4-4355-aded-5db359899fcf admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.949598 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990e2cc-c2a3-4804-ba44-3ec87dca774b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.951998 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990e2cc-c2a3-4804-ba44-3ec87dca774b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.961192 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4d53a-69d9-44fc-988a-08b84ae686d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.962109 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4d53a-69d9-44fc-988a-08b84ae686d0 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.962514 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4d53a-69d9-44fc-988a-08b84ae686d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.962918 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4d53a-69d9-44fc-988a-08b84ae686d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:07.963879 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4d53a-69d9-44fc-988a-08b84ae686d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:07.965358 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4d53a-69d9-44fc-988a-08b84ae686d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:07.967114 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4d53a-69d9-44fc-988a-08b84ae686d0 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:07.971669 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 264/526] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:38:07.977234 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990e2cc-c2a3-4804-ba44-3ec87dca774b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.987732 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 263/527] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:07.989465 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4d53a-69d9-44fc-988a-08b84ae686d0 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:07.990683 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990e2cc-c2a3-4804-ba44-3ec87dca774b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:07.995403 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ec012-6a13-4d36-aef0-4ef943069883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:07.996347 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ec012-6a13-4d36-aef0-4ef943069883 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:07.996762 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ec012-6a13-4d36-aef0-4ef943069883 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:07.997208 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ec012-6a13-4d36-aef0-4ef943069883 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:08.007779 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ec012-6a13-4d36-aef0-4ef943069883 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:08.009893 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ec012-6a13-4d36-aef0-4ef943069883 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:08.010095 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4d53a-69d9-44fc-988a-08b84ae686d0 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:08.025633 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df1b11-f8a1-45e3-a730-022e41409d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:08.026376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df1b11-f8a1-45e3-a730-022e41409d36 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:08.026660 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df1b11-f8a1-45e3-a730-022e41409d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:08.026935 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df1b11-f8a1-45e3-a730-022e41409d36 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:08.029033 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-b70ec012-6a13-4d36-aef0-4ef943069883 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:08.030827 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 265/528] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:08.036241 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ec012-6a13-4d36-aef0-4ef943069883 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:08.046648 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df1b11-f8a1-45e3-a730-022e41409d36 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:08.050275 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df1b11-f8a1-45e3-a730-022e41409d36 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:08.052840 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ec012-6a13-4d36-aef0-4ef943069883 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:08.063716 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e352bc4-6072-492c-9c43-baea674fe7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:08.064573 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e352bc4-6072-492c-9c43-baea674fe7ad admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:08.065114 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e352bc4-6072-492c-9c43-baea674fe7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:08.065898 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e352bc4-6072-492c-9c43-baea674fe7ad admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:08.067803 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e352bc4-6072-492c-9c43-baea674fe7ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:08.068248 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e352bc4-6072-492c-9c43-baea674fe7ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:08.074651 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-c6df1b11-f8a1-45e3-a730-022e41409d36 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:08.074895 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e352bc4-6072-492c-9c43-baea674fe7ad admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:08.081022 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 264/529] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:08.082850 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df1b11-f8a1-45e3-a730-022e41409d36 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:08.095933 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 266/530] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:08.100040 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df1b11-f8a1-45e3-a730-022e41409d36 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:08.101356 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e352bc4-6072-492c-9c43-baea674fe7ad admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:08.113504 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02746ce7-a895-4f8e-a841-b56fd3cf93d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:08.114731 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02746ce7-a895-4f8e-a841-b56fd3cf93d7 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:08.116081 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02746ce7-a895-4f8e-a841-b56fd3cf93d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:08.117424 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02746ce7-a895-4f8e-a841-b56fd3cf93d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:08.118388 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02746ce7-a895-4f8e-a841-b56fd3cf93d7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:08.118969 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e352bc4-6072-492c-9c43-baea674fe7ad admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:08.119414 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02746ce7-a895-4f8e-a841-b56fd3cf93d7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:08.123978 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02746ce7-a895-4f8e-a841-b56fd3cf93d7 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:08.128206 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dd013-a3bd-4752-8f8b-f35246f7c8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:08.130129 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dd013-a3bd-4752-8f8b-f35246f7c8ab admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:08.130869 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dd013-a3bd-4752-8f8b-f35246f7c8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:08.132214 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dd013-a3bd-4752-8f8b-f35246f7c8ab admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:08.145120 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3dd013-a3bd-4752-8f8b-f35246f7c8ab admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:08.147269 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 265/531] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:08.149898 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3dd013-a3bd-4752-8f8b-f35246f7c8ab admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:08.156774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02746ce7-a895-4f8e-a841-b56fd3cf93d7 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:08.176483 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02746ce7-a895-4f8e-a841-b56fd3cf93d7 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:08.180311 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-0b3dd013-a3bd-4752-8f8b-f35246f7c8ab admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:08.184080 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 267/532] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:08.185771 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585f5d7-85c3-40ab-a12d-ad598c4466c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:08.186571 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585f5d7-85c3-40ab-a12d-ad598c4466c2 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:08.186984 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585f5d7-85c3-40ab-a12d-ad598c4466c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:08.187387 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585f5d7-85c3-40ab-a12d-ad598c4466c2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:08.188372 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585f5d7-85c3-40ab-a12d-ad598c4466c2 admin admin] RBAC: Adding query filter params (role.id=67bb9b9aab104609b23a2ab5e7d31142, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=15232a1930bc43e8bb5aa7310a709056) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:08.188937 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585f5d7-85c3-40ab-a12d-ad598c4466c2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:08.190936 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585f5d7-85c3-40ab-a12d-ad598c4466c2 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:08.191925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dd013-a3bd-4752-8f8b-f35246f7c8ab admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:08.203324 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dd013-a3bd-4752-8f8b-f35246f7c8ab admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:08.208908 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 266/533] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:38:08 2022] GET /identity/v3/role_assignments?user.id=15232a1930bc43e8bb5aa7310a709056&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=67bb9b9aab104609b23a2ab5e7d31142 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:08.214685 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641b029-08fe-482b-9585-17b6e60d4524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:08.215664 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641b029-08fe-482b-9585-17b6e60d4524 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:08.216079 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641b029-08fe-482b-9585-17b6e60d4524 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:08.216486 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641b029-08fe-482b-9585-17b6e60d4524 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:08.217529 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641b029-08fe-482b-9585-17b6e60d4524 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:08.217971 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641b029-08fe-482b-9585-17b6e60d4524 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:08.220081 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641b029-08fe-482b-9585-17b6e60d4524 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:08.242736 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 268/534] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:08.248866 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585f5d7-85c3-40ab-a12d-ad598c4466c2 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:08.266490 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585f5d7-85c3-40ab-a12d-ad598c4466c2 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:08.282328 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0960bbc-dafe-43a4-b689-11a5bcdd4a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:08.282925 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0960bbc-dafe-43a4-b689-11a5bcdd4a61 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:08.283201 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0960bbc-dafe-43a4-b689-11a5bcdd4a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:08.283479 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0960bbc-dafe-43a4-b689-11a5bcdd4a61 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:08.284429 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0960bbc-dafe-43a4-b689-11a5bcdd4a61 admin admin] RBAC: Adding query filter params (role.id=67bb9b9aab104609b23a2ab5e7d31142, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=2174a30e22c746589b3faaf4ccc8de3d) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:08.284743 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0960bbc-dafe-43a4-b689-11a5bcdd4a61 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:08.286636 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0960bbc-dafe-43a4-b689-11a5bcdd4a61 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:08.296866 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 267/535] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:38:08 2022] GET /identity/v3/role_assignments?user.id=2174a30e22c746589b3faaf4ccc8de3d&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=67bb9b9aab104609b23a2ab5e7d31142 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:08.545179 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66029356-cbd8-436c-bfc4-66836144524e None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:08.546029 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66029356-cbd8-436c-bfc4-66836144524e None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:08.546444 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66029356-cbd8-436c-bfc4-66836144524e None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:08.548440 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 269/536] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:08.554431 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb380a-225f-4de3-a9c7-c7a345bd1664 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:08.554933 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb380a-225f-4de3-a9c7-c7a345bd1664 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:08.555006 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb380a-225f-4de3-a9c7-c7a345bd1664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:08.582095 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-a7bb380a-225f-4de3-a9c7-c7a345bd1664 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:08.583321 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a7bb380a-225f-4de3-a9c7-c7a345bd1664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:08.591566 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 268/537] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:38:08.628664 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66029356-cbd8-436c-bfc4-66836144524e None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:08.643515 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66029356-cbd8-436c-bfc4-66836144524e None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:08.648828 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21666c4-0615-4ed6-a473-31f2c0a5b7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:08.649951 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21666c4-0615-4ed6-a473-31f2c0a5b7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:08.650459 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21666c4-0615-4ed6-a473-31f2c0a5b7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:08.650970 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21666c4-0615-4ed6-a473-31f2c0a5b7e0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:08.669340 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21666c4-0615-4ed6-a473-31f2c0a5b7e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:08.671662 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21666c4-0615-4ed6-a473-31f2c0a5b7e0 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:08.691222 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-f21666c4-0615-4ed6-a473-31f2c0a5b7e0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:08.692802 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 270/538] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:08.698738 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb380a-225f-4de3-a9c7-c7a345bd1664 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:08.721416 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb380a-225f-4de3-a9c7-c7a345bd1664 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:08.729296 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8269765-430c-45de-872b-f70f10c339a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:08.730396 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8269765-430c-45de-872b-f70f10c339a9 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:08.730883 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8269765-430c-45de-872b-f70f10c339a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:08.731382 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8269765-430c-45de-872b-f70f10c339a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:08.732347 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8269765-430c-45de-872b-f70f10c339a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:08.732841 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8269765-430c-45de-872b-f70f10c339a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:08.734827 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8269765-430c-45de-872b-f70f10c339a9 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:08.753508 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 269/539] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:08.758737 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21666c4-0615-4ed6-a473-31f2c0a5b7e0 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:08.769959 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21666c4-0615-4ed6-a473-31f2c0a5b7e0 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:08.781468 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76289a2-0a87-4f38-becc-9060d3a4e20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:08.782440 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76289a2-0a87-4f38-becc-9060d3a4e20a admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:08.782918 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76289a2-0a87-4f38-becc-9060d3a4e20a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:08.783444 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76289a2-0a87-4f38-becc-9060d3a4e20a admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:08.784432 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76289a2-0a87-4f38-becc-9060d3a4e20a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:08.786678 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76289a2-0a87-4f38-becc-9060d3a4e20a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:08.820570 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 271/540] 10.222.0.31 () {60 vars in 1153 bytes} [Mon Jan 10 17:38:08 2022] POST /identity/v3/users => generated 247 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:38:10.196350 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da07316-3b35-4366-b52a-8f2b13c819b4 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:10.197440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da07316-3b35-4366-b52a-8f2b13c819b4 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:10.197921 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da07316-3b35-4366-b52a-8f2b13c819b4 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:10.200181 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 270/541] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:10.205223 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006245f-e620-4ba7-8491-78142ec8f400 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:10.205661 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006245f-e620-4ba7-8491-78142ec8f400 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:10.205889 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006245f-e620-4ba7-8491-78142ec8f400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:10.232973 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-6006245f-e620-4ba7-8491-78142ec8f400 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:10.234193 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-6006245f-e620-4ba7-8491-78142ec8f400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:10.248163 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 272/542] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:38:10.284403 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da07316-3b35-4366-b52a-8f2b13c819b4 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:10.301443 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da07316-3b35-4366-b52a-8f2b13c819b4 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:10.306003 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15280fe-caf4-4922-a682-1b8815d37c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:10.306798 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15280fe-caf4-4922-a682-1b8815d37c2b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:10.307080 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15280fe-caf4-4922-a682-1b8815d37c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:10.307357 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15280fe-caf4-4922-a682-1b8815d37c2b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:10.325742 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15280fe-caf4-4922-a682-1b8815d37c2b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:10.332611 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-d15280fe-caf4-4922-a682-1b8815d37c2b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 17:38:10.334133 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 271/543] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:38:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:10.339554 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006245f-e620-4ba7-8491-78142ec8f400 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:10.353816 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006245f-e620-4ba7-8491-78142ec8f400 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:10.360027 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f8a59-acf8-4860-95e7-2c11cfe08964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:10.360699 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f8a59-acf8-4860-95e7-2c11cfe08964 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:10.361017 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f8a59-acf8-4860-95e7-2c11cfe08964 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:10.361293 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f8a59-acf8-4860-95e7-2c11cfe08964 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:10.362131 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f8a59-acf8-4860-95e7-2c11cfe08964 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:10.362437 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f8a59-acf8-4860-95e7-2c11cfe08964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:10.364065 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f8a59-acf8-4860-95e7-2c11cfe08964 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:10.380350 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 273/544] 10.222.0.31 () {56 vars in 1124 bytes} [Mon Jan 10 17:38:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:10.385814 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15280fe-caf4-4922-a682-1b8815d37c2b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:10.397381 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15280fe-caf4-4922-a682-1b8815d37c2b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:10.413601 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c62a0-bb52-4258-98a9-eb9841a05a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:10.414433 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c62a0-bb52-4258-98a9-eb9841a05a08 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:10.414718 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c62a0-bb52-4258-98a9-eb9841a05a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:10.414993 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c62a0-bb52-4258-98a9-eb9841a05a08 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:10.427461 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c62a0-bb52-4258-98a9-eb9841a05a08 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:10.433439 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c62a0-bb52-4258-98a9-eb9841a05a08 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:10.457570 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b525d5-4c95-4ce2-a5dc-9c75363d9d9d None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:10.458146 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b525d5-4c95-4ce2-a5dc-9c75363d9d9d None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:10.458616 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b525d5-4c95-4ce2-a5dc-9c75363d9d9d None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:10.461752 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 274/545] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:38:10.463263 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-c08c62a0-bb52-4258-98a9-eb9841a05a08 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:10.465451 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 272/546] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:10.466541 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f75e0-fd36-4736-8ba4-a18e6e13cb90 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:10.467025 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f75e0-fd36-4736-8ba4-a18e6e13cb90 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:10.467490 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f75e0-fd36-4736-8ba4-a18e6e13cb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:10.470859 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c62a0-bb52-4258-98a9-eb9841a05a08 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:10.486370 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-305f75e0-fd36-4736-8ba4-a18e6e13cb90 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:10.487914 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-305f75e0-fd36-4736-8ba4-a18e6e13cb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:10.489381 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c62a0-bb52-4258-98a9-eb9841a05a08 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:10.504337 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d9e0f-cd7d-4830-8fef-3db5c0c72a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:10.507126 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d9e0f-cd7d-4830-8fef-3db5c0c72a0b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:10.508357 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d9e0f-cd7d-4830-8fef-3db5c0c72a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:10.509988 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d9e0f-cd7d-4830-8fef-3db5c0c72a0b admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:10.510946 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d9e0f-cd7d-4830-8fef-3db5c0c72a0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:10.516967 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 275/547] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:38:10.517580 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d9e0f-cd7d-4830-8fef-3db5c0c72a0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:10.519570 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d9e0f-cd7d-4830-8fef-3db5c0c72a0b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:10.532421 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 273/548] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:10.537531 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f75e0-fd36-4736-8ba4-a18e6e13cb90 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:10.547422 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f75e0-fd36-4736-8ba4-a18e6e13cb90 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:10.556301 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad71777-c20e-4a6d-99cd-cb3bf274d524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:10.557406 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad71777-c20e-4a6d-99cd-cb3bf274d524 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:10.557886 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad71777-c20e-4a6d-99cd-cb3bf274d524 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:10.558373 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad71777-c20e-4a6d-99cd-cb3bf274d524 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:10.566496 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad71777-c20e-4a6d-99cd-cb3bf274d524 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:10.568776 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad71777-c20e-4a6d-99cd-cb3bf274d524 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:10.586873 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-4ad71777-c20e-4a6d-99cd-cb3bf274d524 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 17:38:10.588704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 276/549] 10.222.0.31 () {56 vars in 1114 bytes} [Mon Jan 10 17:38:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:10.593979 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d9e0f-cd7d-4830-8fef-3db5c0c72a0b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:10.601366 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad71777-c20e-4a6d-99cd-cb3bf274d524 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:10.605098 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d9e0f-cd7d-4830-8fef-3db5c0c72a0b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:10.614114 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efd737-37c6-4bb8-9a36-eb2e76c5480d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:10.615753 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efd737-37c6-4bb8-9a36-eb2e76c5480d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:10.616790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efd737-37c6-4bb8-9a36-eb2e76c5480d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:10.617831 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efd737-37c6-4bb8-9a36-eb2e76c5480d admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:10.618900 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efd737-37c6-4bb8-9a36-eb2e76c5480d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:10.621272 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efd737-37c6-4bb8-9a36-eb2e76c5480d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:10.623650 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efd737-37c6-4bb8-9a36-eb2e76c5480d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:10.625965 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad71777-c20e-4a6d-99cd-cb3bf274d524 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:10.635818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d4e87-19fb-4a7e-bfe6-8c3a7a6544a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:10.637036 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d4e87-19fb-4a7e-bfe6-8c3a7a6544a3 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:10.638976 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d4e87-19fb-4a7e-bfe6-8c3a7a6544a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:10.639464 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d4e87-19fb-4a7e-bfe6-8c3a7a6544a3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:10.661693 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d4e87-19fb-4a7e-bfe6-8c3a7a6544a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:10.663855 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 274/550] 10.222.0.31 () {56 vars in 1154 bytes} [Mon Jan 10 17:38:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:10.668828 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efd737-37c6-4bb8-9a36-eb2e76c5480d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:10.676545 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-705d4e87-19fb-4a7e-bfe6-8c3a7a6544a3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 17:38:10.680323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 277/551] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:38:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:10.686430 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d4e87-19fb-4a7e-bfe6-8c3a7a6544a3 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:10.690241 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efd737-37c6-4bb8-9a36-eb2e76c5480d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:10.703300 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d4e87-19fb-4a7e-bfe6-8c3a7a6544a3 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:10.708536 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06934810-14bd-4563-86de-29f99f5b697a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:10.711414 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06934810-14bd-4563-86de-29f99f5b697a admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:10.712108 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06934810-14bd-4563-86de-29f99f5b697a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:10.713075 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06934810-14bd-4563-86de-29f99f5b697a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:10.713594 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f80327-5460-4cd7-826c-f7812707c2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:10.716672 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f80327-5460-4cd7-826c-f7812707c2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:10.717261 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f80327-5460-4cd7-826c-f7812707c2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:10.717733 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f80327-5460-4cd7-826c-f7812707c2b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:10.719034 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f80327-5460-4cd7-826c-f7812707c2b8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:10.719586 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f80327-5460-4cd7-826c-f7812707c2b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:10.722407 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f80327-5460-4cd7-826c-f7812707c2b8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:10.739670 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 278/552] 10.222.0.31 () {56 vars in 1124 bytes} [Mon Jan 10 17:38:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:10.740887 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06934810-14bd-4563-86de-29f99f5b697a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:10.743036 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06934810-14bd-4563-86de-29f99f5b697a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:10.745193 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f80327-5460-4cd7-826c-f7812707c2b8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:10.763866 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f80327-5460-4cd7-826c-f7812707c2b8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:10.768979 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630100f-9147-49eb-a38b-854998bd1e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:10.770146 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630100f-9147-49eb-a38b-854998bd1e54 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:10.770901 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630100f-9147-49eb-a38b-854998bd1e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:10.771371 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630100f-9147-49eb-a38b-854998bd1e54 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:10.782192 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-06934810-14bd-4563-86de-29f99f5b697a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:10.783767 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630100f-9147-49eb-a38b-854998bd1e54 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:10.785847 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630100f-9147-49eb-a38b-854998bd1e54 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:10.793493 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 275/553] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:10.798712 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06934810-14bd-4563-86de-29f99f5b697a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:10.805153 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-4630100f-9147-49eb-a38b-854998bd1e54 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:10.806606 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 279/554] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:10.812968 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630100f-9147-49eb-a38b-854998bd1e54 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:10.822761 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630100f-9147-49eb-a38b-854998bd1e54 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:10.823014 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06934810-14bd-4563-86de-29f99f5b697a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:10.827427 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347351ac-7bbc-4c74-86c5-a35057b644e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:10.828085 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347351ac-7bbc-4c74-86c5-a35057b644e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:10.828408 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347351ac-7bbc-4c74-86c5-a35057b644e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:10.828685 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347351ac-7bbc-4c74-86c5-a35057b644e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:10.829513 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347351ac-7bbc-4c74-86c5-a35057b644e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:10.829818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347351ac-7bbc-4c74-86c5-a35057b644e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:10.831553 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347351ac-7bbc-4c74-86c5-a35057b644e7 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:10.842348 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34db54-3000-4283-bc7a-c40d40757afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:10.843024 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34db54-3000-4283-bc7a-c40d40757afb admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:10.844768 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34db54-3000-4283-bc7a-c40d40757afb admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:10.845710 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34db54-3000-4283-bc7a-c40d40757afb admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:10.846615 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 280/555] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:10.846880 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34db54-3000-4283-bc7a-c40d40757afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:10.847193 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34db54-3000-4283-bc7a-c40d40757afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:10.853161 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347351ac-7bbc-4c74-86c5-a35057b644e7 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:10.856052 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34db54-3000-4283-bc7a-c40d40757afb admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:10.872665 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347351ac-7bbc-4c74-86c5-a35057b644e7 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:10.878870 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 276/556] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:10.880806 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fac6e-2bba-4eba-9ceb-557c3cfe0a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:10.881773 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fac6e-2bba-4eba-9ceb-557c3cfe0a93 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:10.882059 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fac6e-2bba-4eba-9ceb-557c3cfe0a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:10.882334 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fac6e-2bba-4eba-9ceb-557c3cfe0a93 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:10.884029 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34db54-3000-4283-bc7a-c40d40757afb admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:10.895386 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34db54-3000-4283-bc7a-c40d40757afb admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:10.900355 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d6be4-889d-401d-93b2-ba9dda3979e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:10.901219 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d6be4-889d-401d-93b2-ba9dda3979e8 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:10.901526 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d6be4-889d-401d-93b2-ba9dda3979e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:10.901770 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d6be4-889d-401d-93b2-ba9dda3979e8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:10.906000 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fac6e-2bba-4eba-9ceb-557c3cfe0a93 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:10.908051 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fac6e-2bba-4eba-9ceb-557c3cfe0a93 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:10.909366 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d6be4-889d-401d-93b2-ba9dda3979e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:10.911394 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d6be4-889d-401d-93b2-ba9dda3979e8 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:10.925887 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-bf4d6be4-889d-401d-93b2-ba9dda3979e8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:10.927431 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 277/557] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:10.932283 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-483fac6e-2bba-4eba-9ceb-557c3cfe0a93 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 10 17:38:10.938219 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 281/558] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:38:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:10.938412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d6be4-889d-401d-93b2-ba9dda3979e8 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:10.950484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d6be4-889d-401d-93b2-ba9dda3979e8 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:10.952342 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fac6e-2bba-4eba-9ceb-557c3cfe0a93 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:10.955514 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e4bd7-0fa4-4d06-b1e0-e5b81327a93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:10.956170 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e4bd7-0fa4-4d06-b1e0-e5b81327a93d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:10.956509 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e4bd7-0fa4-4d06-b1e0-e5b81327a93d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:10.956794 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e4bd7-0fa4-4d06-b1e0-e5b81327a93d admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:10.957803 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e4bd7-0fa4-4d06-b1e0-e5b81327a93d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:10.958113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e4bd7-0fa4-4d06-b1e0-e5b81327a93d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:10.960124 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e4bd7-0fa4-4d06-b1e0-e5b81327a93d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:10.972713 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 278/559] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:10.975327 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fac6e-2bba-4eba-9ceb-557c3cfe0a93 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:10.980244 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e4bd7-0fa4-4d06-b1e0-e5b81327a93d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:10.990055 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497ee05-7e4b-4ac4-9229-3586a8275e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:10.990539 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e4bd7-0fa4-4d06-b1e0-e5b81327a93d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:10.990740 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497ee05-7e4b-4ac4-9229-3586a8275e2e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:10.991027 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497ee05-7e4b-4ac4-9229-3586a8275e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:10.991305 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497ee05-7e4b-4ac4-9229-3586a8275e2e admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:10.992168 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497ee05-7e4b-4ac4-9229-3586a8275e2e admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:10.992477 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497ee05-7e4b-4ac4-9229-3586a8275e2e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:10.994425 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497ee05-7e4b-4ac4-9229-3586a8275e2e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:10.996174 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f7123-a3e0-48e1-90ff-9827b112d6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:10.997222 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f7123-a3e0-48e1-90ff-9827b112d6e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:10.997573 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f7123-a3e0-48e1-90ff-9827b112d6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:10.997951 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f7123-a3e0-48e1-90ff-9827b112d6e8 admin admin] PATH_INFO: `/v3/projects/1415eea0335a49bf800e8215498af679/users/877acd6448214ef893d119e3b1043402/roles/67bb9b9aab104609b23a2ab5e7d31142` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.014839 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f7123-a3e0-48e1-90ff-9827b112d6e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1415eea0335a49bf800e8215498af679, user_id=877acd6448214ef893d119e3b1043402, role_id=67bb9b9aab104609b23a2ab5e7d31142)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.017738 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f7123-a3e0-48e1-90ff-9827b112d6e8 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.032832 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 282/560] 10.222.0.31 () {56 vars in 1158 bytes} [Mon Jan 10 17:38:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:11.042219 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 279/561] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:38:10 2022] PUT /identity/v3/projects/1415eea0335a49bf800e8215498af679/users/877acd6448214ef893d119e3b1043402/roles/67bb9b9aab104609b23a2ab5e7d31142 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:38:11.043343 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497ee05-7e4b-4ac4-9229-3586a8275e2e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.060117 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497ee05-7e4b-4ac4-9229-3586a8275e2e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.122272 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2a7f8-6800-4802-9740-6d178be1e169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.123295 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2a7f8-6800-4802-9740-6d178be1e169 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.123725 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2a7f8-6800-4802-9740-6d178be1e169 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.124054 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2a7f8-6800-4802-9740-6d178be1e169 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.136024 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2a7f8-6800-4802-9740-6d178be1e169 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.138108 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2a7f8-6800-4802-9740-6d178be1e169 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.162267 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-61e2a7f8-6800-4802-9740-6d178be1e169 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:11.163782 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 283/562] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:11.169731 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f7123-a3e0-48e1-90ff-9827b112d6e8 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.181332 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f7123-a3e0-48e1-90ff-9827b112d6e8 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.192436 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820178a-85a7-40ce-8811-b17b72f62ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.193307 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820178a-85a7-40ce-8811-b17b72f62ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.193599 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820178a-85a7-40ce-8811-b17b72f62ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.193912 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820178a-85a7-40ce-8811-b17b72f62ac8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.194689 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820178a-85a7-40ce-8811-b17b72f62ac8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:11.195066 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820178a-85a7-40ce-8811-b17b72f62ac8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.196781 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820178a-85a7-40ce-8811-b17b72f62ac8 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.210734 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 280/563] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:11.218171 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2a7f8-6800-4802-9740-6d178be1e169 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.227661 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47a5d5-7291-42bf-8e47-1b60108b1b2e None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.227977 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47a5d5-7291-42bf-8e47-1b60108b1b2e None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.228223 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47a5d5-7291-42bf-8e47-1b60108b1b2e None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.232333 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2a7f8-6800-4802-9740-6d178be1e169 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.233645 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 281/564] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:11.235744 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64d62a-353b-43a8-98e1-6728cdd7deb0 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.236028 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64d62a-353b-43a8-98e1-6728cdd7deb0 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.236302 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64d62a-353b-43a8-98e1-6728cdd7deb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.242302 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fca3cb-8b57-4a21-9d89-976285eb650b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.243144 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fca3cb-8b57-4a21-9d89-976285eb650b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.243429 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fca3cb-8b57-4a21-9d89-976285eb650b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.243705 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fca3cb-8b57-4a21-9d89-976285eb650b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.252200 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fca3cb-8b57-4a21-9d89-976285eb650b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.254774 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fca3cb-8b57-4a21-9d89-976285eb650b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.262322 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-9e64d62a-353b-43a8-98e1-6728cdd7deb0 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:11.263584 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-9e64d62a-353b-43a8-98e1-6728cdd7deb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:11.271047 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-c5fca3cb-8b57-4a21-9d89-976285eb650b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:11.271995 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 282/565] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:38:11.273716 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c5953-d04b-4c11-b839-b6bbef0798cd None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.273897 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 284/566] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:11.273990 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c5953-d04b-4c11-b839-b6bbef0798cd None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.274288 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c5953-d04b-4c11-b839-b6bbef0798cd None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.276922 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 283/567] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:11.278799 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fca3cb-8b57-4a21-9d89-976285eb650b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.281491 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf527b07-f14b-41dc-9ec5-26825defea27 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.281872 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf527b07-f14b-41dc-9ec5-26825defea27 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.282244 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf527b07-f14b-41dc-9ec5-26825defea27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.292130 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fca3cb-8b57-4a21-9d89-976285eb650b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.297750 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f3a26-4c8d-41bc-933f-ea4e2b5b3934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.298622 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f3a26-4c8d-41bc-933f-ea4e2b5b3934 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.299132 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f3a26-4c8d-41bc-933f-ea4e2b5b3934 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.299688 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f3a26-4c8d-41bc-933f-ea4e2b5b3934 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.300641 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f3a26-4c8d-41bc-933f-ea4e2b5b3934 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:11.301129 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f3a26-4c8d-41bc-933f-ea4e2b5b3934 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.302246 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-cf527b07-f14b-41dc-9ec5-26825defea27 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:11.303343 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f3a26-4c8d-41bc-933f-ea4e2b5b3934 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.303721 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-cf527b07-f14b-41dc-9ec5-26825defea27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:11.317059 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 284/569] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:38:11.317305 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 285/569] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:11.318519 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf527b07-f14b-41dc-9ec5-26825defea27 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.323568 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f3a26-4c8d-41bc-933f-ea4e2b5b3934 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.333124 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f3a26-4c8d-41bc-933f-ea4e2b5b3934 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.340887 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf527b07-f14b-41dc-9ec5-26825defea27 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.341289 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb3717-3dc1-4478-a5f7-612f619ed44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.344977 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a7847-715b-4abd-8fb9-04e1402f9fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.346832 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb3717-3dc1-4478-a5f7-612f619ed44d admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.347106 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb3717-3dc1-4478-a5f7-612f619ed44d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.347402 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a7847-715b-4abd-8fb9-04e1402f9fdb admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.347720 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a7847-715b-4abd-8fb9-04e1402f9fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.348030 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a7847-715b-4abd-8fb9-04e1402f9fdb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.348557 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb3717-3dc1-4478-a5f7-612f619ed44d admin admin] PATH_INFO: `/v3/projects/1415eea0335a49bf800e8215498af679/users/955fd3e0d82f416c99001bdc7f129017/roles/67bb9b9aab104609b23a2ab5e7d31142` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.360839 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a7847-715b-4abd-8fb9-04e1402f9fdb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:11.367862 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-912a7847-715b-4abd-8fb9-04e1402f9fdb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 17:38:11.369561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 285/570] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:11.370122 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb3717-3dc1-4478-a5f7-612f619ed44d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1415eea0335a49bf800e8215498af679, user_id=955fd3e0d82f416c99001bdc7f129017, role_id=67bb9b9aab104609b23a2ab5e7d31142)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.370300 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a7847-715b-4abd-8fb9-04e1402f9fdb admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.373346 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb3717-3dc1-4478-a5f7-612f619ed44d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.381147 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a7847-715b-4abd-8fb9-04e1402f9fdb admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.388817 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961725d3-d0fb-46bf-82fa-810e73c5a17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.389757 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961725d3-d0fb-46bf-82fa-810e73c5a17c admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.390038 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961725d3-d0fb-46bf-82fa-810e73c5a17c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.390309 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961725d3-d0fb-46bf-82fa-810e73c5a17c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.395528 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 286/571] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:38:11 2022] PUT /identity/v3/projects/1415eea0335a49bf800e8215498af679/users/955fd3e0d82f416c99001bdc7f129017/roles/67bb9b9aab104609b23a2ab5e7d31142 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:38:11.396734 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb3717-3dc1-4478-a5f7-612f619ed44d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.409101 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961725d3-d0fb-46bf-82fa-810e73c5a17c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:11.416273 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-961725d3-d0fb-46bf-82fa-810e73c5a17c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 17:38:11.417760 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 286/572] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:11.423738 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961725d3-d0fb-46bf-82fa-810e73c5a17c admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.435969 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961725d3-d0fb-46bf-82fa-810e73c5a17c admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.467909 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb3717-3dc1-4478-a5f7-612f619ed44d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.473055 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b9786-bd6d-4b1b-8e58-488ed4e24419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.474117 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b9786-bd6d-4b1b-8e58-488ed4e24419 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.474638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b9786-bd6d-4b1b-8e58-488ed4e24419 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.475117 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b9786-bd6d-4b1b-8e58-488ed4e24419 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.476175 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b9786-bd6d-4b1b-8e58-488ed4e24419 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:11.476747 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b9786-bd6d-4b1b-8e58-488ed4e24419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.478720 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b9786-bd6d-4b1b-8e58-488ed4e24419 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.491994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 287/573] 10.222.0.31 () {56 vars in 1124 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:11.497550 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b9786-bd6d-4b1b-8e58-488ed4e24419 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.507439 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f26d7e-7e27-4417-91ea-6eb425de4271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.507675 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b9786-bd6d-4b1b-8e58-488ed4e24419 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.508691 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f26d7e-7e27-4417-91ea-6eb425de4271 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.509387 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f26d7e-7e27-4417-91ea-6eb425de4271 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.509934 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f26d7e-7e27-4417-91ea-6eb425de4271 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.511224 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f26d7e-7e27-4417-91ea-6eb425de4271 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:11.511862 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f26d7e-7e27-4417-91ea-6eb425de4271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.512031 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c2e95-e990-4f3b-8bca-76a895af0bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.512931 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c2e95-e990-4f3b-8bca-76a895af0bae admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.513287 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c2e95-e990-4f3b-8bca-76a895af0bae admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.513626 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c2e95-e990-4f3b-8bca-76a895af0bae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.514848 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f26d7e-7e27-4417-91ea-6eb425de4271 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.525068 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 287/574] 10.222.0.31 () {56 vars in 1124 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:11.525694 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c2e95-e990-4f3b-8bca-76a895af0bae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.527536 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c2e95-e990-4f3b-8bca-76a895af0bae admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.533285 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f26d7e-7e27-4417-91ea-6eb425de4271 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.544088 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f26d7e-7e27-4417-91ea-6eb425de4271 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.549140 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39216b22-4d40-4df3-92a1-84ff86cbb69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.549603 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-2e9c2e95-e990-4f3b-8bca-76a895af0bae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:11.550401 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39216b22-4d40-4df3-92a1-84ff86cbb69f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.550890 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39216b22-4d40-4df3-92a1-84ff86cbb69f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.551323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 288/575] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:11.551578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39216b22-4d40-4df3-92a1-84ff86cbb69f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.556597 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c2e95-e990-4f3b-8bca-76a895af0bae admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.565363 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39216b22-4d40-4df3-92a1-84ff86cbb69f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.566732 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c2e95-e990-4f3b-8bca-76a895af0bae admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.567944 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39216b22-4d40-4df3-92a1-84ff86cbb69f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.571517 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbaf2e4-ca43-4abc-85f0-00aa5c198852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.572249 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaf2e4-ca43-4abc-85f0-00aa5c198852 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.572638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaf2e4-ca43-4abc-85f0-00aa5c198852 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.573036 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaf2e4-ca43-4abc-85f0-00aa5c198852 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.573905 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbaf2e4-ca43-4abc-85f0-00aa5c198852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:11.574275 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbaf2e4-ca43-4abc-85f0-00aa5c198852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.576031 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbaf2e4-ca43-4abc-85f0-00aa5c198852 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.587073 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-39216b22-4d40-4df3-92a1-84ff86cbb69f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:11.589222 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 288/577] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:11.593118 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 289/577] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:11.598431 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39216b22-4d40-4df3-92a1-84ff86cbb69f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.598579 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbaf2e4-ca43-4abc-85f0-00aa5c198852 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.608581 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39216b22-4d40-4df3-92a1-84ff86cbb69f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.608838 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbaf2e4-ca43-4abc-85f0-00aa5c198852 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.622680 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e4b1e-63c1-4064-bb43-5b9f1fb5d17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.623464 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99d090-2669-4723-9563-20add6ecde74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.624496 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e4b1e-63c1-4064-bb43-5b9f1fb5d17a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.624781 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e4b1e-63c1-4064-bb43-5b9f1fb5d17a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.625616 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e4b1e-63c1-4064-bb43-5b9f1fb5d17a admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.625857 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99d090-2669-4723-9563-20add6ecde74 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.626137 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99d090-2669-4723-9563-20add6ecde74 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.626402 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99d090-2669-4723-9563-20add6ecde74 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.627834 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e4b1e-63c1-4064-bb43-5b9f1fb5d17a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:11.628158 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e4b1e-63c1-4064-bb43-5b9f1fb5d17a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.630121 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e4b1e-63c1-4064-bb43-5b9f1fb5d17a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.645601 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99d090-2669-4723-9563-20add6ecde74 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.647727 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99d090-2669-4723-9563-20add6ecde74 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.660678 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 290/578] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:11.667599 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e4b1e-63c1-4064-bb43-5b9f1fb5d17a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.684320 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e4b1e-63c1-4064-bb43-5b9f1fb5d17a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.687253 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-ee99d090-2669-4723-9563-20add6ecde74 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 10 17:38:11.688902 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 289/579] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:11.693294 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a8764-0f0f-425c-9525-1e48b3989dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.694162 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a8764-0f0f-425c-9525-1e48b3989dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.694441 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a8764-0f0f-425c-9525-1e48b3989dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.694712 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a8764-0f0f-425c-9525-1e48b3989dc6 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.696471 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99d090-2669-4723-9563-20add6ecde74 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.714153 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99d090-2669-4723-9563-20add6ecde74 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.716209 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a8764-0f0f-425c-9525-1e48b3989dc6 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.719476 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a8764-0f0f-425c-9525-1e48b3989dc6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.725202 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877bb04-4ad1-4420-b95b-27f22747c513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.725943 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877bb04-4ad1-4420-b95b-27f22747c513 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.726227 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877bb04-4ad1-4420-b95b-27f22747c513 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.726492 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877bb04-4ad1-4420-b95b-27f22747c513 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.729782 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877bb04-4ad1-4420-b95b-27f22747c513 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:11.730104 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877bb04-4ad1-4420-b95b-27f22747c513 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.734375 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877bb04-4ad1-4420-b95b-27f22747c513 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.747853 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-b40a8764-0f0f-425c-9525-1e48b3989dc6 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 10 17:38:11.750965 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 291/580] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:11.758199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a8764-0f0f-425c-9525-1e48b3989dc6 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.758569 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 290/581] 10.222.0.31 () {56 vars in 1160 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:11.770542 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877bb04-4ad1-4420-b95b-27f22747c513 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.773304 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a8764-0f0f-425c-9525-1e48b3989dc6 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.780194 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edd6bd-0aff-4be2-a59e-67fcd0ffee6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.781174 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edd6bd-0aff-4be2-a59e-67fcd0ffee6c admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.781584 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877bb04-4ad1-4420-b95b-27f22747c513 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.781867 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edd6bd-0aff-4be2-a59e-67fcd0ffee6c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.782414 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edd6bd-0aff-4be2-a59e-67fcd0ffee6c admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.783724 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edd6bd-0aff-4be2-a59e-67fcd0ffee6c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:11.784275 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edd6bd-0aff-4be2-a59e-67fcd0ffee6c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.786347 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23161fa-12cd-466e-9a44-1a880d683eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.786977 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edd6bd-0aff-4be2-a59e-67fcd0ffee6c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.787357 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23161fa-12cd-466e-9a44-1a880d683eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.787707 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23161fa-12cd-466e-9a44-1a880d683eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.788107 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23161fa-12cd-466e-9a44-1a880d683eb1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.801936 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23161fa-12cd-466e-9a44-1a880d683eb1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.803891 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23161fa-12cd-466e-9a44-1a880d683eb1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.810393 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 292/582] 10.222.0.31 () {56 vars in 1158 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:11.818439 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edd6bd-0aff-4be2-a59e-67fcd0ffee6c admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.827156 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-a23161fa-12cd-466e-9a44-1a880d683eb1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:11.828578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 291/583] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:11.829675 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edd6bd-0aff-4be2-a59e-67fcd0ffee6c admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.834557 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5167e-f2b6-4b78-8db1-a9d8d405840b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.834775 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23161fa-12cd-466e-9a44-1a880d683eb1 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.835865 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5167e-f2b6-4b78-8db1-a9d8d405840b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.836309 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5167e-f2b6-4b78-8db1-a9d8d405840b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.836771 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5167e-f2b6-4b78-8db1-a9d8d405840b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.846520 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23161fa-12cd-466e-9a44-1a880d683eb1 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.849589 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5167e-f2b6-4b78-8db1-a9d8d405840b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.851655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b595e4-0090-4e10-88b8-cad3e4102daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.852271 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5167e-f2b6-4b78-8db1-a9d8d405840b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.852390 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b595e4-0090-4e10-88b8-cad3e4102daf admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.852564 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b595e4-0090-4e10-88b8-cad3e4102daf admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.852838 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b595e4-0090-4e10-88b8-cad3e4102daf admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.853602 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b595e4-0090-4e10-88b8-cad3e4102daf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:11.853908 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b595e4-0090-4e10-88b8-cad3e4102daf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.855982 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b595e4-0090-4e10-88b8-cad3e4102daf admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.870101 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 292/584] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:11.873126 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-cfa5167e-f2b6-4b78-8db1-a9d8d405840b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:11.877705 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b595e4-0090-4e10-88b8-cad3e4102daf admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.877822 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 293/585] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:11.883169 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5167e-f2b6-4b78-8db1-a9d8d405840b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.891174 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b595e4-0090-4e10-88b8-cad3e4102daf admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.893626 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5167e-f2b6-4b78-8db1-a9d8d405840b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.896653 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53516909-73fb-4d21-a479-1926dc43affa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.897893 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53516909-73fb-4d21-a479-1926dc43affa admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.898906 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53516909-73fb-4d21-a479-1926dc43affa admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.899393 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53516909-73fb-4d21-a479-1926dc43affa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.901141 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62318eff-5a63-4b75-8394-cfe585e2304e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.901141 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62318eff-5a63-4b75-8394-cfe585e2304e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.901446 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62318eff-5a63-4b75-8394-cfe585e2304e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.901663 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62318eff-5a63-4b75-8394-cfe585e2304e admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.902507 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62318eff-5a63-4b75-8394-cfe585e2304e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:11.902815 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62318eff-5a63-4b75-8394-cfe585e2304e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.904431 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62318eff-5a63-4b75-8394-cfe585e2304e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.909650 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53516909-73fb-4d21-a479-1926dc43affa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.911876 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53516909-73fb-4d21-a479-1926dc43affa admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.916917 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 294/586] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:11.928618 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62318eff-5a63-4b75-8394-cfe585e2304e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.942051 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-53516909-73fb-4d21-a479-1926dc43affa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:11.943431 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 293/587] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:11.952892 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53516909-73fb-4d21-a479-1926dc43affa admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:11.953022 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62318eff-5a63-4b75-8394-cfe585e2304e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.961963 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102d675-83ac-4829-955e-952eb722142f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.962768 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102d675-83ac-4829-955e-952eb722142f admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.963049 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102d675-83ac-4829-955e-952eb722142f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.964412 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102d675-83ac-4829-955e-952eb722142f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.967061 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53516909-73fb-4d21-a479-1926dc43affa admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:11.975666 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102d675-83ac-4829-955e-952eb722142f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.977704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102d675-83ac-4829-955e-952eb722142f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.985995 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902c0d6-0d25-463a-b5c5-0ae55937025f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:11.986742 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902c0d6-0d25-463a-b5c5-0ae55937025f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:11.987023 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902c0d6-0d25-463a-b5c5-0ae55937025f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:11.987299 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902c0d6-0d25-463a-b5c5-0ae55937025f admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:11.988129 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902c0d6-0d25-463a-b5c5-0ae55937025f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:11.988465 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902c0d6-0d25-463a-b5c5-0ae55937025f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:11.990417 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902c0d6-0d25-463a-b5c5-0ae55937025f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:11.991437 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-d102d675-83ac-4829-955e-952eb722142f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:11.992931 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 295/588] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:12.001893 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102d675-83ac-4829-955e-952eb722142f admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:12.014013 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102d675-83ac-4829-955e-952eb722142f admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:12.016829 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 294/589] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:12.025323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332826b-c33e-4fe0-a949-d7731eb8d060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:12.025996 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332826b-c33e-4fe0-a949-d7731eb8d060 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:12.026277 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332826b-c33e-4fe0-a949-d7731eb8d060 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:12.026549 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332826b-c33e-4fe0-a949-d7731eb8d060 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:12.027360 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332826b-c33e-4fe0-a949-d7731eb8d060 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:12.027666 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332826b-c33e-4fe0-a949-d7731eb8d060 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:12.029567 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332826b-c33e-4fe0-a949-d7731eb8d060 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:12.040481 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902c0d6-0d25-463a-b5c5-0ae55937025f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:12.051836 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902c0d6-0d25-463a-b5c5-0ae55937025f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:12.053656 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 296/590] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:12.061805 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332826b-c33e-4fe0-a949-d7731eb8d060 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:12.062515 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bad75-7cf9-459a-9789-0859be4bc6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:12.063765 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bad75-7cf9-459a-9789-0859be4bc6fb admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:12.064259 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bad75-7cf9-459a-9789-0859be4bc6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:12.064755 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bad75-7cf9-459a-9789-0859be4bc6fb admin admin] PATH_INFO: `/v3/projects/1415eea0335a49bf800e8215498af679/users/2174a30e22c746589b3faaf4ccc8de3d/roles/67bb9b9aab104609b23a2ab5e7d31142` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:12.072554 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332826b-c33e-4fe0-a949-d7731eb8d060 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:12.081642 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bad75-7cf9-459a-9789-0859be4bc6fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1415eea0335a49bf800e8215498af679, user_id=2174a30e22c746589b3faaf4ccc8de3d, role_id=67bb9b9aab104609b23a2ab5e7d31142)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:12.084769 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bad75-7cf9-459a-9789-0859be4bc6fb admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:12.090506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034cc86-4967-453a-9f3b-2c14020b52a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:12.091442 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034cc86-4967-453a-9f3b-2c14020b52a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:12.091841 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034cc86-4967-453a-9f3b-2c14020b52a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:12.092087 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034cc86-4967-453a-9f3b-2c14020b52a0 admin admin] PATH_INFO: `/v3/projects/1415eea0335a49bf800e8215498af679/users/15232a1930bc43e8bb5aa7310a709056/roles/67bb9b9aab104609b23a2ab5e7d31142` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:12.101400 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 295/591] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:38:12 2022] PUT /identity/v3/projects/1415eea0335a49bf800e8215498af679/users/2174a30e22c746589b3faaf4ccc8de3d/roles/67bb9b9aab104609b23a2ab5e7d31142 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:38:12.125272 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034cc86-4967-453a-9f3b-2c14020b52a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1415eea0335a49bf800e8215498af679, user_id=15232a1930bc43e8bb5aa7310a709056, role_id=67bb9b9aab104609b23a2ab5e7d31142)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:12.128003 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034cc86-4967-453a-9f3b-2c14020b52a0 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:12.161422 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 297/592] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:38:12 2022] PUT /identity/v3/projects/1415eea0335a49bf800e8215498af679/users/15232a1930bc43e8bb5aa7310a709056/roles/67bb9b9aab104609b23a2ab5e7d31142 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:38:12.188970 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36cbcc-1f3d-4fce-8b2a-bb3f51a49b4d None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:12.189283 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36cbcc-1f3d-4fce-8b2a-bb3f51a49b4d None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:12.189524 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36cbcc-1f3d-4fce-8b2a-bb3f51a49b4d None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:12.191741 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 296/593] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:12.197553 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c6b0c-89a6-4b7c-b489-26a32ebbc471 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:12.197853 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c6b0c-89a6-4b7c-b489-26a32ebbc471 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:12.198119 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c6b0c-89a6-4b7c-b489-26a32ebbc471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:12.218248 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-7d8c6b0c-89a6-4b7c-b489-26a32ebbc471 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:12.219617 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-7d8c6b0c-89a6-4b7c-b489-26a32ebbc471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:12.304345 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 298/594] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:38:12.330849 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36cbcc-1f3d-4fce-8b2a-bb3f51a49b4d None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:12.350624 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36cbcc-1f3d-4fce-8b2a-bb3f51a49b4d None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:12.358525 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c36931-6f56-4430-8176-41c674192faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:12.359397 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c36931-6f56-4430-8176-41c674192faf admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:12.359729 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c36931-6f56-4430-8176-41c674192faf admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:12.360004 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c36931-6f56-4430-8176-41c674192faf admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:12.372988 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c36931-6f56-4430-8176-41c674192faf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:12.380654 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-d0c36931-6f56-4430-8176-41c674192faf admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 17:38:12.382429 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 297/595] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:38:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:12.388523 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c6b0c-89a6-4b7c-b489-26a32ebbc471 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:12.398837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c6b0c-89a6-4b7c-b489-26a32ebbc471 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:12.403688 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92c613-128f-4863-8795-a0b269d6a51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:12.404432 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92c613-128f-4863-8795-a0b269d6a51a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:12.404716 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92c613-128f-4863-8795-a0b269d6a51a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:12.405095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92c613-128f-4863-8795-a0b269d6a51a admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:12.405889 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92c613-128f-4863-8795-a0b269d6a51a admin admin] RBAC: Adding query filter params (name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:12.406200 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92c613-128f-4863-8795-a0b269d6a51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:12.407981 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92c613-128f-4863-8795-a0b269d6a51a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:12.417870 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 299/596] 10.222.0.31 () {56 vars in 1124 bytes} [Mon Jan 10 17:38:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:12.423630 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c36931-6f56-4430-8176-41c674192faf admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:12.434448 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c36931-6f56-4430-8176-41c674192faf admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:12.439287 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce51c7-b79b-4e7b-9432-56274232a04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:12.440222 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce51c7-b79b-4e7b-9432-56274232a04a admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:12.440505 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce51c7-b79b-4e7b-9432-56274232a04a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:12.440826 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce51c7-b79b-4e7b-9432-56274232a04a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:12.454350 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce51c7-b79b-4e7b-9432-56274232a04a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:12.456279 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce51c7-b79b-4e7b-9432-56274232a04a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:12.475096 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-17ce51c7-b79b-4e7b-9432-56274232a04a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:12.476688 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 298/597] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:12.482585 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92c613-128f-4863-8795-a0b269d6a51a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:12.493427 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92c613-128f-4863-8795-a0b269d6a51a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:12.498923 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38561e-36c1-4071-b545-c69652f02757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:12.499595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38561e-36c1-4071-b545-c69652f02757 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:12.499872 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38561e-36c1-4071-b545-c69652f02757 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:12.500142 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38561e-36c1-4071-b545-c69652f02757 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:12.500915 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38561e-36c1-4071-b545-c69652f02757 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:12.501220 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38561e-36c1-4071-b545-c69652f02757 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:12.502925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38561e-36c1-4071-b545-c69652f02757 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:12.516587 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 300/598] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:12.522130 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce51c7-b79b-4e7b-9432-56274232a04a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:12.536253 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce51c7-b79b-4e7b-9432-56274232a04a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:12.543010 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475b665-48c2-4e3f-870b-1562edf51d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:12.543825 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475b665-48c2-4e3f-870b-1562edf51d4b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:12.544110 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475b665-48c2-4e3f-870b-1562edf51d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:12.544385 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475b665-48c2-4e3f-870b-1562edf51d4b admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:12.555653 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475b665-48c2-4e3f-870b-1562edf51d4b admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:12.557724 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475b665-48c2-4e3f-870b-1562edf51d4b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:12.584567 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-2475b665-48c2-4e3f-870b-1562edf51d4b admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 10 17:38:12.586148 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 299/599] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:38:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:12.591997 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38561e-36c1-4071-b545-c69652f02757 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:12.606904 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38561e-36c1-4071-b545-c69652f02757 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:12.613335 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84205a1-f85e-408d-a803-95a893ea14e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:12.614064 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84205a1-f85e-408d-a803-95a893ea14e2 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:12.614342 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84205a1-f85e-408d-a803-95a893ea14e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:12.614610 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84205a1-f85e-408d-a803-95a893ea14e2 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:12.615466 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84205a1-f85e-408d-a803-95a893ea14e2 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:12.615765 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84205a1-f85e-408d-a803-95a893ea14e2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:12.619920 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84205a1-f85e-408d-a803-95a893ea14e2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:12.643165 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 301/600] 10.222.0.31 () {56 vars in 1156 bytes} [Mon Jan 10 17:38:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:12.649113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475b665-48c2-4e3f-870b-1562edf51d4b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:12.661943 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475b665-48c2-4e3f-870b-1562edf51d4b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:12.671386 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb4597-7501-4978-adab-8e863bfb04d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:12.672045 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb4597-7501-4978-adab-8e863bfb04d7 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:12.672328 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb4597-7501-4978-adab-8e863bfb04d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:12.672605 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb4597-7501-4978-adab-8e863bfb04d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:12.684802 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb4597-7501-4978-adab-8e863bfb04d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:12.686678 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb4597-7501-4978-adab-8e863bfb04d7 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:12.703446 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 300/601] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:38:12.709055 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84205a1-f85e-408d-a803-95a893ea14e2 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:12.733597 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84205a1-f85e-408d-a803-95a893ea14e2 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:12.742860 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbcf4b-e769-4937-a865-17ac0d751b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:12.743682 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbcf4b-e769-4937-a865-17ac0d751b53 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:12.743969 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbcf4b-e769-4937-a865-17ac0d751b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:12.744247 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbcf4b-e769-4937-a865-17ac0d751b53 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:12.760598 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbcf4b-e769-4937-a865-17ac0d751b53 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:12.762497 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbcf4b-e769-4937-a865-17ac0d751b53 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:12.787256 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-08bbcf4b-e769-4937-a865-17ac0d751b53 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:12.788703 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 302/602] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:12.793968 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb4597-7501-4978-adab-8e863bfb04d7 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:12.805819 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb4597-7501-4978-adab-8e863bfb04d7 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:12.813999 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc610231-f0f0-4bb9-9131-8a217e622bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:12.814670 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc610231-f0f0-4bb9-9131-8a217e622bbe admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:12.814989 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc610231-f0f0-4bb9-9131-8a217e622bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:12.815267 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc610231-f0f0-4bb9-9131-8a217e622bbe admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:12.816011 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc610231-f0f0-4bb9-9131-8a217e622bbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:12.816317 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc610231-f0f0-4bb9-9131-8a217e622bbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:12.817953 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc610231-f0f0-4bb9-9131-8a217e622bbe admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:12.836190 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 301/603] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:12.841678 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbcf4b-e769-4937-a865-17ac0d751b53 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:12.853809 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbcf4b-e769-4937-a865-17ac0d751b53 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:12.862422 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee56d4-017f-4c2e-ad48-15ea996803a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:12.863235 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee56d4-017f-4c2e-ad48-15ea996803a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:12.863524 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee56d4-017f-4c2e-ad48-15ea996803a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:12.863798 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee56d4-017f-4c2e-ad48-15ea996803a2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:12.873974 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee56d4-017f-4c2e-ad48-15ea996803a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:12.875984 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee56d4-017f-4c2e-ad48-15ea996803a2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:12.892647 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-90ee56d4-017f-4c2e-ad48-15ea996803a2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:12.894003 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 303/604] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:12.900147 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc610231-f0f0-4bb9-9131-8a217e622bbe admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:12.913787 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc610231-f0f0-4bb9-9131-8a217e622bbe admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:12.922011 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29a54a-d0e3-4379-bc7b-c2d0c232b870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:12.922669 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29a54a-d0e3-4379-bc7b-c2d0c232b870 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:12.922952 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29a54a-d0e3-4379-bc7b-c2d0c232b870 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:12.923228 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29a54a-d0e3-4379-bc7b-c2d0c232b870 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:12.924032 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29a54a-d0e3-4379-bc7b-c2d0c232b870 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:12.924408 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29a54a-d0e3-4379-bc7b-c2d0c232b870 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:12.926357 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29a54a-d0e3-4379-bc7b-c2d0c232b870 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:12.943843 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 302/605] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:12.949775 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee56d4-017f-4c2e-ad48-15ea996803a2 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:12.965781 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee56d4-017f-4c2e-ad48-15ea996803a2 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:12.974347 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b7d25-ed03-4ee8-bacd-535f64371997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:12.975011 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b7d25-ed03-4ee8-bacd-535f64371997 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:12.975297 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b7d25-ed03-4ee8-bacd-535f64371997 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:12.975570 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b7d25-ed03-4ee8-bacd-535f64371997 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:12.976424 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b7d25-ed03-4ee8-bacd-535f64371997 admin admin] RBAC: Adding query filter params (role.id=67bb9b9aab104609b23a2ab5e7d31142, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=0257a86ce85b4b4386cde32c8ed4b39a) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:12.976734 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b7d25-ed03-4ee8-bacd-535f64371997 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:12.978623 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b7d25-ed03-4ee8-bacd-535f64371997 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:12.989352 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 304/606] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:38:12 2022] GET /identity/v3/role_assignments?user.id=0257a86ce85b4b4386cde32c8ed4b39a&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=67bb9b9aab104609b23a2ab5e7d31142 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:14.250875 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be74e3-3fe9-47cb-b51e-ad7c74a50d12 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:14.251433 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be74e3-3fe9-47cb-b51e-ad7c74a50d12 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:14.251433 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be74e3-3fe9-47cb-b51e-ad7c74a50d12 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:14.253534 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 303/607] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:14.258331 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e577d3-2d30-4fe0-9b9c-e98ab6bcb685 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:14.258710 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e577d3-2d30-4fe0-9b9c-e98ab6bcb685 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:14.258883 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e577d3-2d30-4fe0-9b9c-e98ab6bcb685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:14.285814 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-d2e577d3-2d30-4fe0-9b9c-e98ab6bcb685 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:14.287008 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-d2e577d3-2d30-4fe0-9b9c-e98ab6bcb685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:14.295001 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 305/608] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:38:14.329805 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be74e3-3fe9-47cb-b51e-ad7c74a50d12 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:14.346419 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be74e3-3fe9-47cb-b51e-ad7c74a50d12 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:14.351140 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f249c4-cbdf-4994-b7ac-c3219f567cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:14.352129 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f249c4-cbdf-4994-b7ac-c3219f567cee admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:14.352574 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f249c4-cbdf-4994-b7ac-c3219f567cee admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:14.353037 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f249c4-cbdf-4994-b7ac-c3219f567cee admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:14.373872 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f249c4-cbdf-4994-b7ac-c3219f567cee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:14.381056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-66f249c4-cbdf-4994-b7ac-c3219f567cee admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 17:38:14.382746 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 304/609] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:38:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:14.388568 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e577d3-2d30-4fe0-9b9c-e98ab6bcb685 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:14.398332 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e577d3-2d30-4fe0-9b9c-e98ab6bcb685 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:14.409116 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10c8a9-4df4-40bd-bda2-74efa8507763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:14.410095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10c8a9-4df4-40bd-bda2-74efa8507763 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:14.410541 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10c8a9-4df4-40bd-bda2-74efa8507763 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:14.410973 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10c8a9-4df4-40bd-bda2-74efa8507763 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:14.411911 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10c8a9-4df4-40bd-bda2-74efa8507763 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:14.412398 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10c8a9-4df4-40bd-bda2-74efa8507763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:14.414359 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10c8a9-4df4-40bd-bda2-74efa8507763 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:14.424300 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 306/610] 10.222.0.31 () {56 vars in 1124 bytes} [Mon Jan 10 17:38:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:14.430130 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f249c4-cbdf-4994-b7ac-c3219f567cee admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:14.445871 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f249c4-cbdf-4994-b7ac-c3219f567cee admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:14.453442 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea231934-7c10-4325-a5e1-87e4b5618502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:14.454468 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea231934-7c10-4325-a5e1-87e4b5618502 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:14.454917 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea231934-7c10-4325-a5e1-87e4b5618502 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:14.455432 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea231934-7c10-4325-a5e1-87e4b5618502 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:14.466474 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea231934-7c10-4325-a5e1-87e4b5618502 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:14.468555 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea231934-7c10-4325-a5e1-87e4b5618502 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:14.489734 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-ea231934-7c10-4325-a5e1-87e4b5618502 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:14.491499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 305/611] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:14.497260 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10c8a9-4df4-40bd-bda2-74efa8507763 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:14.507465 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10c8a9-4df4-40bd-bda2-74efa8507763 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:14.515287 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f20f00-cc85-45c4-bf06-7e1412e62052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:14.516172 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f20f00-cc85-45c4-bf06-7e1412e62052 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:14.516619 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f20f00-cc85-45c4-bf06-7e1412e62052 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:14.517094 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f20f00-cc85-45c4-bf06-7e1412e62052 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:14.518059 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f20f00-cc85-45c4-bf06-7e1412e62052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:14.518579 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f20f00-cc85-45c4-bf06-7e1412e62052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:14.520463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f20f00-cc85-45c4-bf06-7e1412e62052 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:14.538383 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 307/612] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:14.543639 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea231934-7c10-4325-a5e1-87e4b5618502 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:14.557864 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea231934-7c10-4325-a5e1-87e4b5618502 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:14.565005 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f35637-ed85-48ed-926f-3f32bec48a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:14.566123 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f35637-ed85-48ed-926f-3f32bec48a91 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:14.566640 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f35637-ed85-48ed-926f-3f32bec48a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:14.567099 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f35637-ed85-48ed-926f-3f32bec48a91 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:14.570830 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470a915-5483-4866-8ada-dbc312599145 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:14.571348 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470a915-5483-4866-8ada-dbc312599145 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:14.571808 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470a915-5483-4866-8ada-dbc312599145 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:14.573932 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 308/613] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:38:14.578825 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4da002-9170-426d-be60-9b00b97e6bbd None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:14.579324 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4da002-9170-426d-be60-9b00b97e6bbd None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:14.579837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4da002-9170-426d-be60-9b00b97e6bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:14.586056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f35637-ed85-48ed-926f-3f32bec48a91 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:14.588162 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f35637-ed85-48ed-926f-3f32bec48a91 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:14.599634 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-3d4da002-9170-426d-be60-9b00b97e6bbd None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:14.601182 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-3d4da002-9170-426d-be60-9b00b97e6bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:14.609629 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 309/614] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:38:14.612159 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-33f35637-ed85-48ed-926f-3f32bec48a91 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 17:38:14.613443 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 306/615] 10.222.0.31 () {56 vars in 1114 bytes} [Mon Jan 10 17:38:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:14.619057 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4da002-9170-426d-be60-9b00b97e6bbd None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:14.630332 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4da002-9170-426d-be60-9b00b97e6bbd None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:14.634482 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f35637-ed85-48ed-926f-3f32bec48a91 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:14.642673 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3224a6-67f2-441a-b58a-b297a5003960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:14.643599 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3224a6-67f2-441a-b58a-b297a5003960 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:14.643885 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3224a6-67f2-441a-b58a-b297a5003960 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:14.644157 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3224a6-67f2-441a-b58a-b297a5003960 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:14.645100 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3224a6-67f2-441a-b58a-b297a5003960 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:14.645398 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3224a6-67f2-441a-b58a-b297a5003960 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:14.646767 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f35637-ed85-48ed-926f-3f32bec48a91 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:14.647315 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3224a6-67f2-441a-b58a-b297a5003960 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:14.652510 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19dbe1d-211b-4b21-9221-a1b6957ce6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:14.653814 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dbe1d-211b-4b21-9221-a1b6957ce6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:14.654358 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dbe1d-211b-4b21-9221-a1b6957ce6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:14.654833 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dbe1d-211b-4b21-9221-a1b6957ce6e5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:14.678433 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 310/616] 10.222.0.31 () {56 vars in 1154 bytes} [Mon Jan 10 17:38:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:14.683619 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19dbe1d-211b-4b21-9221-a1b6957ce6e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:14.683931 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3224a6-67f2-441a-b58a-b297a5003960 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:14.693962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3224a6-67f2-441a-b58a-b297a5003960 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:14.696936 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-e19dbe1d-211b-4b21-9221-a1b6957ce6e5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 17:38:14.698188 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 307/617] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:38:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:14.698871 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b4894-b480-47d1-ab27-d111a1827558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:14.699504 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b4894-b480-47d1-ab27-d111a1827558 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:14.699842 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b4894-b480-47d1-ab27-d111a1827558 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:14.700111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b4894-b480-47d1-ab27-d111a1827558 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:14.703771 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19dbe1d-211b-4b21-9221-a1b6957ce6e5 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:14.709215 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b4894-b480-47d1-ab27-d111a1827558 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:14.711083 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b4894-b480-47d1-ab27-d111a1827558 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:14.721009 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 311/618] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:38:14.726699 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b4894-b480-47d1-ab27-d111a1827558 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:14.734403 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19dbe1d-211b-4b21-9221-a1b6957ce6e5 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:14.736469 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b4894-b480-47d1-ab27-d111a1827558 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:14.747448 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924b015-5b2d-43b4-a262-a62483b3e17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:14.748822 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924b015-5b2d-43b4-a262-a62483b3e17e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:14.749581 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c162ee-0b4d-429f-a877-87d9a7dce9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:14.750247 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c162ee-0b4d-429f-a877-87d9a7dce9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:14.750604 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924b015-5b2d-43b4-a262-a62483b3e17e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:14.751028 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924b015-5b2d-43b4-a262-a62483b3e17e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:14.751577 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c162ee-0b4d-429f-a877-87d9a7dce9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:14.751846 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c162ee-0b4d-429f-a877-87d9a7dce9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:14.753327 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c162ee-0b4d-429f-a877-87d9a7dce9a0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:14.753632 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c162ee-0b4d-429f-a877-87d9a7dce9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:14.755536 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c162ee-0b4d-429f-a877-87d9a7dce9a0 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:14.773508 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924b015-5b2d-43b4-a262-a62483b3e17e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:14.776012 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 308/619] 10.222.0.31 () {56 vars in 1124 bytes} [Mon Jan 10 17:38:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:14.777352 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924b015-5b2d-43b4-a262-a62483b3e17e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:14.785856 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c162ee-0b4d-429f-a877-87d9a7dce9a0 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:14.806414 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-8924b015-5b2d-43b4-a262-a62483b3e17e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:14.807869 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 312/620] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:14.809474 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c162ee-0b4d-429f-a877-87d9a7dce9a0 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:14.814261 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e13c3-4f16-46c4-bc6a-77d4a91b8a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:14.815391 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e13c3-4f16-46c4-bc6a-77d4a91b8a19 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:14.815865 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e13c3-4f16-46c4-bc6a-77d4a91b8a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:14.816358 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e13c3-4f16-46c4-bc6a-77d4a91b8a19 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:14.817767 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924b015-5b2d-43b4-a262-a62483b3e17e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:14.828455 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e13c3-4f16-46c4-bc6a-77d4a91b8a19 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:14.831195 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e13c3-4f16-46c4-bc6a-77d4a91b8a19 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:14.839222 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924b015-5b2d-43b4-a262-a62483b3e17e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:14.850172 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-aa5e13c3-4f16-46c4-bc6a-77d4a91b8a19 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:14.852048 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 309/621] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:14.857242 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e13c3-4f16-46c4-bc6a-77d4a91b8a19 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:14.857755 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b1f96-5517-4f19-a1a7-166eaa3313ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:14.859092 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b1f96-5517-4f19-a1a7-166eaa3313ac admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:14.859944 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b1f96-5517-4f19-a1a7-166eaa3313ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:14.861175 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b1f96-5517-4f19-a1a7-166eaa3313ac admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:14.862218 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b1f96-5517-4f19-a1a7-166eaa3313ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:14.863720 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b1f96-5517-4f19-a1a7-166eaa3313ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:14.867182 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b1f96-5517-4f19-a1a7-166eaa3313ac admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:14.881891 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 313/622] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:14.888749 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e13c3-4f16-46c4-bc6a-77d4a91b8a19 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:14.889886 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b1f96-5517-4f19-a1a7-166eaa3313ac admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:14.899192 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67adbca0-6410-433e-8fb4-223f7651041d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:14.899848 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adbca0-6410-433e-8fb4-223f7651041d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:14.900129 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adbca0-6410-433e-8fb4-223f7651041d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:14.900402 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adbca0-6410-433e-8fb4-223f7651041d admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:14.901174 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67adbca0-6410-433e-8fb4-223f7651041d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:14.901475 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67adbca0-6410-433e-8fb4-223f7651041d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:14.903056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67adbca0-6410-433e-8fb4-223f7651041d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:14.908460 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b1f96-5517-4f19-a1a7-166eaa3313ac admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:14.919295 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b9e5f-f662-4f8f-9741-9dc19d8ee516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:14.920200 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b9e5f-f662-4f8f-9741-9dc19d8ee516 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:14.920478 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b9e5f-f662-4f8f-9741-9dc19d8ee516 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:14.920748 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b9e5f-f662-4f8f-9741-9dc19d8ee516 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:14.925186 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 310/623] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:14.930449 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67adbca0-6410-433e-8fb4-223f7651041d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:14.935781 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b9e5f-f662-4f8f-9741-9dc19d8ee516 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:14.940689 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b9e5f-f662-4f8f-9741-9dc19d8ee516 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:14.948217 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67adbca0-6410-433e-8fb4-223f7651041d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:14.955020 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c712cd-4e09-4a42-837a-d87041d820c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:14.957144 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c712cd-4e09-4a42-837a-d87041d820c5 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:14.957422 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c712cd-4e09-4a42-837a-d87041d820c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:14.957693 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c712cd-4e09-4a42-837a-d87041d820c5 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:14.968487 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-259b9e5f-f662-4f8f-9741-9dc19d8ee516 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:14.971745 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 314/624] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:14.977481 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b9e5f-f662-4f8f-9741-9dc19d8ee516 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:14.978443 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c712cd-4e09-4a42-837a-d87041d820c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:14.982667 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c712cd-4e09-4a42-837a-d87041d820c5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:14.995929 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b9e5f-f662-4f8f-9741-9dc19d8ee516 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.007367 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f4ec3-60bb-4254-939a-83c3ab124dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.008011 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f4ec3-60bb-4254-939a-83c3ab124dce admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.008287 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f4ec3-60bb-4254-939a-83c3ab124dce admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.008556 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f4ec3-60bb-4254-939a-83c3ab124dce admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.009908 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f4ec3-60bb-4254-939a-83c3ab124dce admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:15.009908 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f4ec3-60bb-4254-939a-83c3ab124dce admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.010979 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-83c712cd-4e09-4a42-837a-d87041d820c5 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 10 17:38:15.013792 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 311/625] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:38:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:15.014131 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f4ec3-60bb-4254-939a-83c3ab124dce admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.019441 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c712cd-4e09-4a42-837a-d87041d820c5 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.034563 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c712cd-4e09-4a42-837a-d87041d820c5 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.038479 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 315/626] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:15.045747 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f4ec3-60bb-4254-939a-83c3ab124dce admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.052964 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8a43b-7a6d-4137-9950-88d78e2d4de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.053707 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8a43b-7a6d-4137-9950-88d78e2d4de3 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.054002 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8a43b-7a6d-4137-9950-88d78e2d4de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.054293 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8a43b-7a6d-4137-9950-88d78e2d4de3 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.055175 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8a43b-7a6d-4137-9950-88d78e2d4de3 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:15.055486 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8a43b-7a6d-4137-9950-88d78e2d4de3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.057382 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8a43b-7a6d-4137-9950-88d78e2d4de3 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.057559 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f4ec3-60bb-4254-939a-83c3ab124dce admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.075938 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 312/627] 10.222.0.31 () {56 vars in 1158 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:15.079746 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7409e22-6db1-43b1-855c-91604bf1ca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.081487 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8a43b-7a6d-4137-9950-88d78e2d4de3 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.082317 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7409e22-6db1-43b1-855c-91604bf1ca75 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.083792 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7409e22-6db1-43b1-855c-91604bf1ca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.084277 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7409e22-6db1-43b1-855c-91604bf1ca75 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.087187 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7409e22-6db1-43b1-855c-91604bf1ca75 admin admin] RBAC: Adding query filter params (role.id=67bb9b9aab104609b23a2ab5e7d31142, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=877acd6448214ef893d119e3b1043402) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:15.087726 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7409e22-6db1-43b1-855c-91604bf1ca75 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.092062 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7409e22-6db1-43b1-855c-91604bf1ca75 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.101620 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8a43b-7a6d-4137-9950-88d78e2d4de3 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.103790 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 316/628] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/role_assignments?user.id=877acd6448214ef893d119e3b1043402&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=67bb9b9aab104609b23a2ab5e7d31142 => generated 608 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:15.108626 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f553e1-d6aa-4972-a632-09290063e77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.109652 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f553e1-d6aa-4972-a632-09290063e77d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.110132 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f553e1-d6aa-4972-a632-09290063e77d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.110629 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f553e1-d6aa-4972-a632-09290063e77d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.125867 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f553e1-d6aa-4972-a632-09290063e77d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.128212 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f553e1-d6aa-4972-a632-09290063e77d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.138786 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 313/629] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 17:38:15.144253 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7409e22-6db1-43b1-855c-91604bf1ca75 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.158845 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7409e22-6db1-43b1-855c-91604bf1ca75 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.165825 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0948b-5a20-436f-8bf6-d37f82d00860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.167014 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0948b-5a20-436f-8bf6-d37f82d00860 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.167543 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0948b-5a20-436f-8bf6-d37f82d00860 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.168006 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0948b-5a20-436f-8bf6-d37f82d00860 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.183357 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0948b-5a20-436f-8bf6-d37f82d00860 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.185777 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0948b-5a20-436f-8bf6-d37f82d00860 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.188066 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac4b13-2e57-4e32-b444-7fe9327bfdea None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.188739 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac4b13-2e57-4e32-b444-7fe9327bfdea None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.189069 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac4b13-2e57-4e32-b444-7fe9327bfdea None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.191334 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 314/630] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:38:15.198225 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc90b1-b9e8-49bb-91b9-e1d0ef12ed9f None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.198781 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc90b1-b9e8-49bb-91b9-e1d0ef12ed9f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.199225 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc90b1-b9e8-49bb-91b9-e1d0ef12ed9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.226278 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-7ae0948b-5a20-436f-8bf6-d37f82d00860 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:15.227904 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 317/631] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:15.232515 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-7ffc90b1-b9e8-49bb-91b9-e1d0ef12ed9f None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:15.233662 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0948b-5a20-436f-8bf6-d37f82d00860 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.240213 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-7ffc90b1-b9e8-49bb-91b9-e1d0ef12ed9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:15.250982 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0948b-5a20-436f-8bf6-d37f82d00860 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.255228 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 315/632] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:38:15.262555 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1926cf2-cfb0-45a5-a7af-273708054874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.263258 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1926cf2-cfb0-45a5-a7af-273708054874 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.263520 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1926cf2-cfb0-45a5-a7af-273708054874 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.263789 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1926cf2-cfb0-45a5-a7af-273708054874 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.264538 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1926cf2-cfb0-45a5-a7af-273708054874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:15.264837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1926cf2-cfb0-45a5-a7af-273708054874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.266468 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1926cf2-cfb0-45a5-a7af-273708054874 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.282264 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 318/633] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:15.289777 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc90b1-b9e8-49bb-91b9-e1d0ef12ed9f None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.300359 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc90b1-b9e8-49bb-91b9-e1d0ef12ed9f None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.308023 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1926cf2-cfb0-45a5-a7af-273708054874 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.310903 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d28ffc-a1c1-42b3-8d96-8cb82aece241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.311749 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d28ffc-a1c1-42b3-8d96-8cb82aece241 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.312045 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d28ffc-a1c1-42b3-8d96-8cb82aece241 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.312331 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d28ffc-a1c1-42b3-8d96-8cb82aece241 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.320277 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d28ffc-a1c1-42b3-8d96-8cb82aece241 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.320933 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1926cf2-cfb0-45a5-a7af-273708054874 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.322320 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d28ffc-a1c1-42b3-8d96-8cb82aece241 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.326781 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a250a2-5c19-45ab-9213-a568eac5bde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.327882 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a250a2-5c19-45ab-9213-a568eac5bde4 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.328335 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a250a2-5c19-45ab-9213-a568eac5bde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.328772 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a250a2-5c19-45ab-9213-a568eac5bde4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.337438 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-51d28ffc-a1c1-42b3-8d96-8cb82aece241 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:15.339247 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 316/634] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:15.340757 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88d80a-5e20-4074-838a-4497e50123f8 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.341071 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88d80a-5e20-4074-838a-4497e50123f8 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.341351 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88d80a-5e20-4074-838a-4497e50123f8 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.342209 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a250a2-5c19-45ab-9213-a568eac5bde4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:15.347444 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 317/635] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:15.348422 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88d80a-5e20-4074-838a-4497e50123f8 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.350466 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-29a250a2-5c19-45ab-9213-a568eac5bde4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 17:38:15.352101 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 319/636] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:15.358066 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8eab9-22e2-4e39-bda8-5bb8894b15f7 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.358066 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8eab9-22e2-4e39-bda8-5bb8894b15f7 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.358066 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8eab9-22e2-4e39-bda8-5bb8894b15f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.366922 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88d80a-5e20-4074-838a-4497e50123f8 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.373294 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bd625-df3d-44c8-9dcb-2236f6de8564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.373951 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bd625-df3d-44c8-9dcb-2236f6de8564 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.374226 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bd625-df3d-44c8-9dcb-2236f6de8564 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.374485 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bd625-df3d-44c8-9dcb-2236f6de8564 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.375287 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905bd625-df3d-44c8-9dcb-2236f6de8564 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:15.375589 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905bd625-df3d-44c8-9dcb-2236f6de8564 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.378271 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905bd625-df3d-44c8-9dcb-2236f6de8564 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.378914 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-dab8eab9-22e2-4e39-bda8-5bb8894b15f7 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:15.380103 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-dab8eab9-22e2-4e39-bda8-5bb8894b15f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:15.389206 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 320/637] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:38:15.391947 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 318/638] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:15.393699 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8eab9-22e2-4e39-bda8-5bb8894b15f7 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.397607 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bd625-df3d-44c8-9dcb-2236f6de8564 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.409590 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bd625-df3d-44c8-9dcb-2236f6de8564 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.412707 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8eab9-22e2-4e39-bda8-5bb8894b15f7 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.414091 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53fb66-e6b0-4485-9f00-010ce63bc8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.414756 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53fb66-e6b0-4485-9f00-010ce63bc8ad admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.415033 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53fb66-e6b0-4485-9f00-010ce63bc8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.415302 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53fb66-e6b0-4485-9f00-010ce63bc8ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.416152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53fb66-e6b0-4485-9f00-010ce63bc8ad admin admin] RBAC: Adding query filter params (role.id=67bb9b9aab104609b23a2ab5e7d31142, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=955fd3e0d82f416c99001bdc7f129017) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:15.416458 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53fb66-e6b0-4485-9f00-010ce63bc8ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.418542 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53fb66-e6b0-4485-9f00-010ce63bc8ad admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.426049 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 319/639] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/role_assignments?user.id=955fd3e0d82f416c99001bdc7f129017&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=67bb9b9aab104609b23a2ab5e7d31142 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:15.428247 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b5e4a-bf8c-443d-8374-634286d9fd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.429286 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b5e4a-bf8c-443d-8374-634286d9fd82 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.429651 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b5e4a-bf8c-443d-8374-634286d9fd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.429955 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53fb66-e6b0-4485-9f00-010ce63bc8ad admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.430053 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b5e4a-bf8c-443d-8374-634286d9fd82 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.430792 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b5e4a-bf8c-443d-8374-634286d9fd82 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:15.431104 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b5e4a-bf8c-443d-8374-634286d9fd82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.432793 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b5e4a-bf8c-443d-8374-634286d9fd82 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.442472 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53fb66-e6b0-4485-9f00-010ce63bc8ad admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.443767 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 321/640] 10.222.0.31 () {56 vars in 1124 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:15.449103 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd62468-ad56-4062-9413-279b7ffd882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.449422 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b5e4a-bf8c-443d-8374-634286d9fd82 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.449927 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd62468-ad56-4062-9413-279b7ffd882e admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.450209 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd62468-ad56-4062-9413-279b7ffd882e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.450473 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd62468-ad56-4062-9413-279b7ffd882e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.462578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd62468-ad56-4062-9413-279b7ffd882e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:15.463015 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b5e4a-bf8c-443d-8374-634286d9fd82 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.468764 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b0061-f50b-4268-8782-aa4a45772567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.469717 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b0061-f50b-4268-8782-aa4a45772567 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.469996 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b0061-f50b-4268-8782-aa4a45772567 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.470266 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b0061-f50b-4268-8782-aa4a45772567 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.470424 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-fcd62468-ad56-4062-9413-279b7ffd882e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 17:38:15.472056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 320/641] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:15.477769 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd62468-ad56-4062-9413-279b7ffd882e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.485779 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b0061-f50b-4268-8782-aa4a45772567 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.488069 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b0061-f50b-4268-8782-aa4a45772567 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.488315 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd62468-ad56-4062-9413-279b7ffd882e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.494144 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004df95b-eefe-44ee-bbef-f59eb7f329b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.494813 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004df95b-eefe-44ee-bbef-f59eb7f329b5 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.495088 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004df95b-eefe-44ee-bbef-f59eb7f329b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.495363 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004df95b-eefe-44ee-bbef-f59eb7f329b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.496130 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004df95b-eefe-44ee-bbef-f59eb7f329b5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:15.496431 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004df95b-eefe-44ee-bbef-f59eb7f329b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.498137 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004df95b-eefe-44ee-bbef-f59eb7f329b5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.507391 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 321/642] 10.222.0.31 () {56 vars in 1124 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:15.509438 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-557b0061-f50b-4268-8782-aa4a45772567 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:15.514550 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 322/643] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:15.515744 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004df95b-eefe-44ee-bbef-f59eb7f329b5 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.516986 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b0061-f50b-4268-8782-aa4a45772567 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.530074 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004df95b-eefe-44ee-bbef-f59eb7f329b5 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.533566 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b0061-f50b-4268-8782-aa4a45772567 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.538137 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380991e-d5bd-4b88-8e49-912e9ea013fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.538332 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca13864-745c-439f-ae57-0156e708a8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.540673 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca13864-745c-439f-ae57-0156e708a8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.540673 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca13864-745c-439f-ae57-0156e708a8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.540673 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca13864-745c-439f-ae57-0156e708a8c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.540673 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca13864-745c-439f-ae57-0156e708a8c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:15.540673 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca13864-745c-439f-ae57-0156e708a8c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.541869 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380991e-d5bd-4b88-8e49-912e9ea013fd admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.542346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380991e-d5bd-4b88-8e49-912e9ea013fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.542451 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca13864-745c-439f-ae57-0156e708a8c7 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.542904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380991e-d5bd-4b88-8e49-912e9ea013fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.557129 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 323/644] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:15.557508 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380991e-d5bd-4b88-8e49-912e9ea013fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.559869 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380991e-d5bd-4b88-8e49-912e9ea013fd admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.562829 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca13864-745c-439f-ae57-0156e708a8c7 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.575100 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca13864-745c-439f-ae57-0156e708a8c7 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.579858 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb439646-428a-49ed-89e6-18f186832e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.580876 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb439646-428a-49ed-89e6-18f186832e94 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.581168 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb439646-428a-49ed-89e6-18f186832e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.581476 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb439646-428a-49ed-89e6-18f186832e94 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.582790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-d380991e-d5bd-4b88-8e49-912e9ea013fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:15.585147 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 322/645] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:15.590497 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb439646-428a-49ed-89e6-18f186832e94 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.592806 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb439646-428a-49ed-89e6-18f186832e94 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.594206 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380991e-d5bd-4b88-8e49-912e9ea013fd admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.608590 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380991e-d5bd-4b88-8e49-912e9ea013fd admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.613789 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc423134-450c-4c77-a8af-4de40343a37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.614454 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc423134-450c-4c77-a8af-4de40343a37f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.614881 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc423134-450c-4c77-a8af-4de40343a37f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.615161 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc423134-450c-4c77-a8af-4de40343a37f admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.615910 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc423134-450c-4c77-a8af-4de40343a37f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:15.616251 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc423134-450c-4c77-a8af-4de40343a37f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.618171 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc423134-450c-4c77-a8af-4de40343a37f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.618567 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-fb439646-428a-49ed-89e6-18f186832e94 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 10 17:38:15.620032 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 324/646] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:15.627424 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb439646-428a-49ed-89e6-18f186832e94 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.638706 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 323/647] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:15.644935 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc423134-450c-4c77-a8af-4de40343a37f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.645283 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb439646-428a-49ed-89e6-18f186832e94 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.650755 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ade73c-ad8b-4ce8-bfce-96a696368179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.651728 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ade73c-ad8b-4ce8-bfce-96a696368179 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.652052 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ade73c-ad8b-4ce8-bfce-96a696368179 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.652325 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ade73c-ad8b-4ce8-bfce-96a696368179 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.653928 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ade73c-ad8b-4ce8-bfce-96a696368179 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:15.654242 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ade73c-ad8b-4ce8-bfce-96a696368179 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.656563 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ade73c-ad8b-4ce8-bfce-96a696368179 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.657536 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc423134-450c-4c77-a8af-4de40343a37f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.670342 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32962269-4d70-4b93-b14f-5cd8ff89c22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.671157 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32962269-4d70-4b93-b14f-5cd8ff89c22f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.671438 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32962269-4d70-4b93-b14f-5cd8ff89c22f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.671714 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32962269-4d70-4b93-b14f-5cd8ff89c22f admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.678713 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 325/648] 10.222.0.31 () {56 vars in 1158 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:15.687166 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ade73c-ad8b-4ce8-bfce-96a696368179 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.689133 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32962269-4d70-4b93-b14f-5cd8ff89c22f admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.691221 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32962269-4d70-4b93-b14f-5cd8ff89c22f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.698093 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ade73c-ad8b-4ce8-bfce-96a696368179 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.703161 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd99454-3a84-4c0b-8962-f4ef21bc6a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.704016 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd99454-3a84-4c0b-8962-f4ef21bc6a0a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.704303 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd99454-3a84-4c0b-8962-f4ef21bc6a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.704573 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd99454-3a84-4c0b-8962-f4ef21bc6a0a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.716783 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-32962269-4d70-4b93-b14f-5cd8ff89c22f admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 10 17:38:15.717494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd99454-3a84-4c0b-8962-f4ef21bc6a0a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.719399 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd99454-3a84-4c0b-8962-f4ef21bc6a0a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.725469 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 324/649] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:15.730120 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 326/650] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:38:15.732337 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32962269-4d70-4b93-b14f-5cd8ff89c22f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.738944 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd99454-3a84-4c0b-8962-f4ef21bc6a0a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.754441 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32962269-4d70-4b93-b14f-5cd8ff89c22f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.757936 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd99454-3a84-4c0b-8962-f4ef21bc6a0a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.764548 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4d376-2f32-4f12-950c-06c529935ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.765135 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1eaf9-486e-44e7-a6d7-51be133b5c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.765447 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4d376-2f32-4f12-950c-06c529935ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.765727 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4d376-2f32-4f12-950c-06c529935ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.765828 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1eaf9-486e-44e7-a6d7-51be133b5c43 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.765997 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4d376-2f32-4f12-950c-06c529935ba1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.766153 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1eaf9-486e-44e7-a6d7-51be133b5c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.766332 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1eaf9-486e-44e7-a6d7-51be133b5c43 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.767205 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1eaf9-486e-44e7-a6d7-51be133b5c43 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:15.767511 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1eaf9-486e-44e7-a6d7-51be133b5c43 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.770327 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1eaf9-486e-44e7-a6d7-51be133b5c43 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.777747 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4d376-2f32-4f12-950c-06c529935ba1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.779614 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4d376-2f32-4f12-950c-06c529935ba1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.791916 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 325/651] 10.222.0.31 () {56 vars in 1160 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:15.797946 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1eaf9-486e-44e7-a6d7-51be133b5c43 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.800556 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-8ce4d376-2f32-4f12-950c-06c529935ba1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:15.801805 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 327/652] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:15.807207 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4d376-2f32-4f12-950c-06c529935ba1 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.813240 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1eaf9-486e-44e7-a6d7-51be133b5c43 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.822756 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cb91e-1c4e-43d1-bb11-a505ada23863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.823567 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cb91e-1c4e-43d1-bb11-a505ada23863 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.825433 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cb91e-1c4e-43d1-bb11-a505ada23863 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.825694 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cb91e-1c4e-43d1-bb11-a505ada23863 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.826592 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4d376-2f32-4f12-950c-06c529935ba1 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.838781 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc73c4-86ee-44bb-8a30-f7b000926dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.839459 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc73c4-86ee-44bb-8a30-f7b000926dcc admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.839740 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc73c4-86ee-44bb-8a30-f7b000926dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.840012 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc73c4-86ee-44bb-8a30-f7b000926dcc admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.840756 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc73c4-86ee-44bb-8a30-f7b000926dcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:15.841086 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc73c4-86ee-44bb-8a30-f7b000926dcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.842715 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc73c4-86ee-44bb-8a30-f7b000926dcc admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.845055 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cb91e-1c4e-43d1-bb11-a505ada23863 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.846831 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cb91e-1c4e-43d1-bb11-a505ada23863 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.857577 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 328/653] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:15.857862 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 326/654] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:38:15.863224 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc73c4-86ee-44bb-8a30-f7b000926dcc admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.863348 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cb91e-1c4e-43d1-bb11-a505ada23863 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.872499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cb91e-1c4e-43d1-bb11-a505ada23863 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.873796 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc73c4-86ee-44bb-8a30-f7b000926dcc admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.877325 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d5d30-0487-429f-ba1b-0bfbb825394f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.878183 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d5d30-0487-429f-ba1b-0bfbb825394f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.878464 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d5d30-0487-429f-ba1b-0bfbb825394f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.878747 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d5d30-0487-429f-ba1b-0bfbb825394f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.880199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a0515-1b55-4f9e-8e16-6c28da41df05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.881307 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a0515-1b55-4f9e-8e16-6c28da41df05 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.881778 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a0515-1b55-4f9e-8e16-6c28da41df05 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.882284 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a0515-1b55-4f9e-8e16-6c28da41df05 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.889346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d5d30-0487-429f-ba1b-0bfbb825394f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.890200 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a0515-1b55-4f9e-8e16-6c28da41df05 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.891196 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d5d30-0487-429f-ba1b-0bfbb825394f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.893063 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a0515-1b55-4f9e-8e16-6c28da41df05 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.908729 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-b47a0515-1b55-4f9e-8e16-6c28da41df05 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:15.909948 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 329/655] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:15.910405 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-312d5d30-0487-429f-ba1b-0bfbb825394f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:15.911145 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb835e-6bad-430f-9d8c-6c665b733f31 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.911510 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb835e-6bad-430f-9d8c-6c665b733f31 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.911610 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 327/656] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:15.911946 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb835e-6bad-430f-9d8c-6c665b733f31 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.913605 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 330/657] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:15.916958 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d5d30-0487-429f-ba1b-0bfbb825394f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.917700 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb835e-6bad-430f-9d8c-6c665b733f31 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.929696 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d5d30-0487-429f-ba1b-0bfbb825394f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.931794 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb835e-6bad-430f-9d8c-6c665b733f31 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.934177 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad08ad-5950-412a-8219-fe372e1754db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.934826 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad08ad-5950-412a-8219-fe372e1754db admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.935091 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad08ad-5950-412a-8219-fe372e1754db admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.935363 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad08ad-5950-412a-8219-fe372e1754db admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.936157 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad08ad-5950-412a-8219-fe372e1754db admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:15.936266 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe7e50-ba34-441d-90d7-2595d8152053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.936459 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad08ad-5950-412a-8219-fe372e1754db admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.938558 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe7e50-ba34-441d-90d7-2595d8152053 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.938558 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe7e50-ba34-441d-90d7-2595d8152053 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.938558 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe7e50-ba34-441d-90d7-2595d8152053 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.938558 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe7e50-ba34-441d-90d7-2595d8152053 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:15.938895 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad08ad-5950-412a-8219-fe372e1754db admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.938963 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe7e50-ba34-441d-90d7-2595d8152053 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.940091 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe7e50-ba34-441d-90d7-2595d8152053 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:15.953467 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 331/658] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:15.954737 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4ee9a-16a4-4bcb-9f9f-fc2f0f03a8b3 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.955025 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4ee9a-16a4-4bcb-9f9f-fc2f0f03a8b3 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.955324 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4ee9a-16a4-4bcb-9f9f-fc2f0f03a8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.955460 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 328/659] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:15.961743 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad08ad-5950-412a-8219-fe372e1754db admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.973444 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad08ad-5950-412a-8219-fe372e1754db admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:15.977710 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-3bb4ee9a-16a4-4bcb-9f9f-fc2f0f03a8b3 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:15.978221 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3779ef-7a3f-4dce-b044-778c2633a3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:15.979008 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3779ef-7a3f-4dce-b044-778c2633a3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:15.979160 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-3bb4ee9a-16a4-4bcb-9f9f-fc2f0f03a8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:15.979328 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3779ef-7a3f-4dce-b044-778c2633a3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:15.979644 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3779ef-7a3f-4dce-b044-778c2633a3b7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:15.987390 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 332/660] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:38:15.987526 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3779ef-7a3f-4dce-b044-778c2633a3b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:15.988360 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4ee9a-16a4-4bcb-9f9f-fc2f0f03a8b3 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:15.993641 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3779ef-7a3f-4dce-b044-778c2633a3b7 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:16.000012 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4ee9a-16a4-4bcb-9f9f-fc2f0f03a8b3 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:16.016284 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6321e3-85b5-487e-bddc-2c8b7f9f887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:16.016972 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6321e3-85b5-487e-bddc-2c8b7f9f887c admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:16.017265 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6321e3-85b5-487e-bddc-2c8b7f9f887c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:16.017522 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6321e3-85b5-487e-bddc-2c8b7f9f887c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:16.017957 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-1c3779ef-7a3f-4dce-b044-778c2633a3b7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:16.018415 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6321e3-85b5-487e-bddc-2c8b7f9f887c admin admin] RBAC: Adding query filter params (role.id=67bb9b9aab104609b23a2ab5e7d31142, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=15232a1930bc43e8bb5aa7310a709056) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:16.018720 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6321e3-85b5-487e-bddc-2c8b7f9f887c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:16.020186 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 329/661] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:16.020597 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6321e3-85b5-487e-bddc-2c8b7f9f887c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:16.021436 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3779ef-7a3f-4dce-b044-778c2633a3b7 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:16.031964 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 333/662] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:38:15 2022] GET /identity/v3/role_assignments?user.id=15232a1930bc43e8bb5aa7310a709056&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=67bb9b9aab104609b23a2ab5e7d31142 => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:16.032719 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3779ef-7a3f-4dce-b044-778c2633a3b7 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:16.032917 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6321e3-85b5-487e-bddc-2c8b7f9f887c admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:16.038362 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c76e5-2263-4db0-858e-729154ca4bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:16.040146 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c76e5-2263-4db0-858e-729154ca4bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:16.040915 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c76e5-2263-4db0-858e-729154ca4bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:16.041366 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c76e5-2263-4db0-858e-729154ca4bd4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:16.042968 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6321e3-85b5-487e-bddc-2c8b7f9f887c admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:16.047474 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8ed12-b099-40ec-b295-242baecc1602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:16.048220 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8ed12-b099-40ec-b295-242baecc1602 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:16.048572 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8ed12-b099-40ec-b295-242baecc1602 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:16.048994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8ed12-b099-40ec-b295-242baecc1602 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:16.049945 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8ed12-b099-40ec-b295-242baecc1602 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:16.050287 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8ed12-b099-40ec-b295-242baecc1602 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:16.052247 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8ed12-b099-40ec-b295-242baecc1602 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:16.061378 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c76e5-2263-4db0-858e-729154ca4bd4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:16.068643 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-e40c76e5-2263-4db0-858e-729154ca4bd4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 17:38:16.070530 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 330/663] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:38:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:16.076825 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c76e5-2263-4db0-858e-729154ca4bd4 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:16.083212 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 334/664] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:16.092680 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8ed12-b099-40ec-b295-242baecc1602 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:16.101329 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c76e5-2263-4db0-858e-729154ca4bd4 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:16.108309 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8ed12-b099-40ec-b295-242baecc1602 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:16.111107 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2d2dd-1b3c-4618-ad7d-332c9d1e6d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:16.111890 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2d2dd-1b3c-4618-ad7d-332c9d1e6d23 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:16.112169 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2d2dd-1b3c-4618-ad7d-332c9d1e6d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:16.112491 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2d2dd-1b3c-4618-ad7d-332c9d1e6d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:16.113776 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2d2dd-1b3c-4618-ad7d-332c9d1e6d23 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:16.114085 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2d2dd-1b3c-4618-ad7d-332c9d1e6d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:16.116864 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2d2dd-1b3c-4618-ad7d-332c9d1e6d23 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:16.121303 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95554793-ec6f-4084-a36d-a3b3816286d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:16.122112 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95554793-ec6f-4084-a36d-a3b3816286d4 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:16.122391 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95554793-ec6f-4084-a36d-a3b3816286d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:16.122663 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95554793-ec6f-4084-a36d-a3b3816286d4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:16.123974 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95554793-ec6f-4084-a36d-a3b3816286d4 admin admin] RBAC: Adding query filter params (role.id=67bb9b9aab104609b23a2ab5e7d31142, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=2174a30e22c746589b3faaf4ccc8de3d) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:16.124294 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95554793-ec6f-4084-a36d-a3b3816286d4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:16.129552 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95554793-ec6f-4084-a36d-a3b3816286d4 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:16.136695 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 331/665] 10.222.0.31 () {56 vars in 1124 bytes} [Mon Jan 10 17:38:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:16.140250 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 335/666] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:38:16 2022] GET /identity/v3/role_assignments?user.id=2174a30e22c746589b3faaf4ccc8de3d&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=67bb9b9aab104609b23a2ab5e7d31142 => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:16.146155 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2d2dd-1b3c-4618-ad7d-332c9d1e6d23 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:16.159677 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2d2dd-1b3c-4618-ad7d-332c9d1e6d23 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:16.166362 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04594156-f479-495f-8c64-8b944852262a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:16.167204 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04594156-f479-495f-8c64-8b944852262a admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:16.167491 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04594156-f479-495f-8c64-8b944852262a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:16.167766 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04594156-f479-495f-8c64-8b944852262a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:16.185305 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04594156-f479-495f-8c64-8b944852262a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:16.187535 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04594156-f479-495f-8c64-8b944852262a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:16.211295 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-04594156-f479-495f-8c64-8b944852262a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:16.213275 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 332/667] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:16.219095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95554793-ec6f-4084-a36d-a3b3816286d4 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:16.229706 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95554793-ec6f-4084-a36d-a3b3816286d4 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:16.234634 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ae08c-21fb-4c56-b018-93696b42c6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:16.235661 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ae08c-21fb-4c56-b018-93696b42c6ea admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:16.236139 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ae08c-21fb-4c56-b018-93696b42c6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:16.236644 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ae08c-21fb-4c56-b018-93696b42c6ea admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:16.237629 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ae08c-21fb-4c56-b018-93696b42c6ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:16.238150 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ae08c-21fb-4c56-b018-93696b42c6ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:16.239994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ae08c-21fb-4c56-b018-93696b42c6ea admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:16.254163 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 336/668] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:16.260118 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04594156-f479-495f-8c64-8b944852262a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:16.271011 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04594156-f479-495f-8c64-8b944852262a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:16.276286 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d4c7a-7bc3-47a3-b0ea-c7752046e179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:16.277426 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d4c7a-7bc3-47a3-b0ea-c7752046e179 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:16.277903 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d4c7a-7bc3-47a3-b0ea-c7752046e179 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:16.278383 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d4c7a-7bc3-47a3-b0ea-c7752046e179 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:16.286924 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d4c7a-7bc3-47a3-b0ea-c7752046e179 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:16.289356 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d4c7a-7bc3-47a3-b0ea-c7752046e179 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:16.312931 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-088d4c7a-7bc3-47a3-b0ea-c7752046e179 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 10 17:38:16.314543 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 333/669] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:38:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:16.320420 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ae08c-21fb-4c56-b018-93696b42c6ea admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:16.331698 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ae08c-21fb-4c56-b018-93696b42c6ea admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:16.336697 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d29ef9-cb43-4d29-a702-43f11dafb94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:16.337746 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d29ef9-cb43-4d29-a702-43f11dafb94b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:16.338239 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d29ef9-cb43-4d29-a702-43f11dafb94b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:16.338712 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d29ef9-cb43-4d29-a702-43f11dafb94b admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:16.339764 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d29ef9-cb43-4d29-a702-43f11dafb94b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:16.340262 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d29ef9-cb43-4d29-a702-43f11dafb94b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:16.342392 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d29ef9-cb43-4d29-a702-43f11dafb94b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:16.362158 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 337/670] 10.222.0.31 () {56 vars in 1156 bytes} [Mon Jan 10 17:38:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:16.367915 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d4c7a-7bc3-47a3-b0ea-c7752046e179 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:16.378258 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d4c7a-7bc3-47a3-b0ea-c7752046e179 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:16.383160 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb994ab-d88a-4220-8eab-ffb95550fd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:16.384300 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb994ab-d88a-4220-8eab-ffb95550fd6d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:16.384815 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb994ab-d88a-4220-8eab-ffb95550fd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:16.385324 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb994ab-d88a-4220-8eab-ffb95550fd6d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:16.396930 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb994ab-d88a-4220-8eab-ffb95550fd6d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:16.399538 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb994ab-d88a-4220-8eab-ffb95550fd6d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:16.418160 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-3fb994ab-d88a-4220-8eab-ffb95550fd6d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:16.420205 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 334/671] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:16.426229 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d29ef9-cb43-4d29-a702-43f11dafb94b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:16.436940 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d29ef9-cb43-4d29-a702-43f11dafb94b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:16.442947 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358b4a2-ec7b-45e5-b93b-9d5091bc9ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:16.444031 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358b4a2-ec7b-45e5-b93b-9d5091bc9ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:16.444552 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358b4a2-ec7b-45e5-b93b-9d5091bc9ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:16.445043 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358b4a2-ec7b-45e5-b93b-9d5091bc9ac8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:16.446043 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358b4a2-ec7b-45e5-b93b-9d5091bc9ac8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:16.446564 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358b4a2-ec7b-45e5-b93b-9d5091bc9ac8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:16.448477 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358b4a2-ec7b-45e5-b93b-9d5091bc9ac8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:16.464884 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 338/672] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:16.467841 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb994ab-d88a-4220-8eab-ffb95550fd6d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:16.478694 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb994ab-d88a-4220-8eab-ffb95550fd6d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:16.483649 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995008a-95ca-42eb-ab80-ad8cd264d838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:16.484805 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995008a-95ca-42eb-ab80-ad8cd264d838 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:16.485371 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995008a-95ca-42eb-ab80-ad8cd264d838 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:16.485831 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995008a-95ca-42eb-ab80-ad8cd264d838 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:16.494338 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995008a-95ca-42eb-ab80-ad8cd264d838 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:16.496793 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995008a-95ca-42eb-ab80-ad8cd264d838 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:16.511322 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-d995008a-95ca-42eb-ab80-ad8cd264d838 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:16.513262 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 335/673] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:16.519251 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358b4a2-ec7b-45e5-b93b-9d5091bc9ac8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:16.532075 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358b4a2-ec7b-45e5-b93b-9d5091bc9ac8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:16.537380 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61b069-10fc-4d03-a35a-af14617ec50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:16.538153 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61b069-10fc-4d03-a35a-af14617ec50c admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:16.538526 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61b069-10fc-4d03-a35a-af14617ec50c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:16.538890 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61b069-10fc-4d03-a35a-af14617ec50c admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:16.539791 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61b069-10fc-4d03-a35a-af14617ec50c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:16.540192 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61b069-10fc-4d03-a35a-af14617ec50c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:16.542184 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61b069-10fc-4d03-a35a-af14617ec50c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:16.558466 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 339/674] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:16.564237 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995008a-95ca-42eb-ab80-ad8cd264d838 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:16.575720 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995008a-95ca-42eb-ab80-ad8cd264d838 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:16.581299 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fec2b-d946-4835-856c-36fd649c855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:16.582416 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fec2b-d946-4835-856c-36fd649c855a admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:16.582919 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fec2b-d946-4835-856c-36fd649c855a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:16.583329 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fec2b-d946-4835-856c-36fd649c855a admin admin] PATH_INFO: `/v3/projects/1415eea0335a49bf800e8215498af679/users/0257a86ce85b4b4386cde32c8ed4b39a/roles/67bb9b9aab104609b23a2ab5e7d31142` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:16.601212 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fec2b-d946-4835-856c-36fd649c855a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1415eea0335a49bf800e8215498af679, user_id=0257a86ce85b4b4386cde32c8ed4b39a, role_id=67bb9b9aab104609b23a2ab5e7d31142)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:16.604018 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fec2b-d946-4835-856c-36fd649c855a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:16.627534 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 336/675] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:38:16 2022] PUT /identity/v3/projects/1415eea0335a49bf800e8215498af679/users/0257a86ce85b4b4386cde32c8ed4b39a/roles/67bb9b9aab104609b23a2ab5e7d31142 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:38:18.098973 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d17b70-6814-4770-988e-ac858bf0d1f0 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:18.099982 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d17b70-6814-4770-988e-ac858bf0d1f0 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:18.100461 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d17b70-6814-4770-988e-ac858bf0d1f0 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:18.102736 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 340/676] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:18.114574 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8462591-5016-45cb-ac3e-e93ee4187025 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:18.115472 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8462591-5016-45cb-ac3e-e93ee4187025 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:18.115965 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8462591-5016-45cb-ac3e-e93ee4187025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:18.141822 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-a8462591-5016-45cb-ac3e-e93ee4187025 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:18.143386 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a8462591-5016-45cb-ac3e-e93ee4187025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:18.222227 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 337/677] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:38:18.262894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d17b70-6814-4770-988e-ac858bf0d1f0 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:18.278741 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d17b70-6814-4770-988e-ac858bf0d1f0 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:18.283318 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8a556-5791-4bf3-8453-2b5e396a858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:18.284359 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8a556-5791-4bf3-8453-2b5e396a858e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:18.284868 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8a556-5791-4bf3-8453-2b5e396a858e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:18.285336 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8a556-5791-4bf3-8453-2b5e396a858e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:18.296048 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8a556-5791-4bf3-8453-2b5e396a858e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:18.303011 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-b5a8a556-5791-4bf3-8453-2b5e396a858e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:38:18.304715 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 341/678] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:38:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:18.310117 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8462591-5016-45cb-ac3e-e93ee4187025 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:18.326171 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8462591-5016-45cb-ac3e-e93ee4187025 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:18.337749 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3f28c-bbc4-4ad0-862d-310e4074e81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:18.338826 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3f28c-bbc4-4ad0-862d-310e4074e81a admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:18.339326 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3f28c-bbc4-4ad0-862d-310e4074e81a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:18.339790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3f28c-bbc4-4ad0-862d-310e4074e81a admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:18.340765 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3f28c-bbc4-4ad0-862d-310e4074e81a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:18.341306 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3f28c-bbc4-4ad0-862d-310e4074e81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:18.343125 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3f28c-bbc4-4ad0-862d-310e4074e81a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:18.352475 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 338/679] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:38:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:18.357861 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8a556-5791-4bf3-8453-2b5e396a858e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:18.368094 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8a556-5791-4bf3-8453-2b5e396a858e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:18.376194 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609f8c8-31f0-40d8-9d59-7a8a7767339f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:18.377320 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609f8c8-31f0-40d8-9d59-7a8a7767339f admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:18.377797 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609f8c8-31f0-40d8-9d59-7a8a7767339f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:18.378260 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609f8c8-31f0-40d8-9d59-7a8a7767339f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:18.389458 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609f8c8-31f0-40d8-9d59-7a8a7767339f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:18.391536 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609f8c8-31f0-40d8-9d59-7a8a7767339f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:18.412785 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-3609f8c8-31f0-40d8-9d59-7a8a7767339f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:18.418483 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 342/680] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:18.423674 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3f28c-bbc4-4ad0-862d-310e4074e81a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:18.432448 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962639e-6e7c-4769-84fe-535ed6a4821e None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:18.432728 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962639e-6e7c-4769-84fe-535ed6a4821e None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:18.433030 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962639e-6e7c-4769-84fe-535ed6a4821e None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:18.436200 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 343/681] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:18.440812 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3f28c-bbc4-4ad0-862d-310e4074e81a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:18.447936 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edaa414-a1b0-4e90-9fd4-e9e3c84c2be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:18.448600 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edaa414-a1b0-4e90-9fd4-e9e3c84c2be5 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:18.448904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edaa414-a1b0-4e90-9fd4-e9e3c84c2be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:18.449187 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edaa414-a1b0-4e90-9fd4-e9e3c84c2be5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:18.449935 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edaa414-a1b0-4e90-9fd4-e9e3c84c2be5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:18.450237 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edaa414-a1b0-4e90-9fd4-e9e3c84c2be5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:18.451839 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edaa414-a1b0-4e90-9fd4-e9e3c84c2be5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:18.454513 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c6a70-d370-4172-9bdc-098a2ea86c05 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:18.454794 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c6a70-d370-4172-9bdc-098a2ea86c05 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:18.455066 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c6a70-d370-4172-9bdc-098a2ea86c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:18.481012 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-1e3c6a70-d370-4172-9bdc-098a2ea86c05 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:18.482202 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-1e3c6a70-d370-4172-9bdc-098a2ea86c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:18.484925 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 339/682] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:18.490491 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edaa414-a1b0-4e90-9fd4-e9e3c84c2be5 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:18.504790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edaa414-a1b0-4e90-9fd4-e9e3c84c2be5 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:18.507262 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 344/683] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:38:18.511584 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01caf31c-eac2-4f90-aad5-582a7a0f5582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:18.512909 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caf31c-eac2-4f90-aad5-582a7a0f5582 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:18.513234 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caf31c-eac2-4f90-aad5-582a7a0f5582 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:18.513506 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caf31c-eac2-4f90-aad5-582a7a0f5582 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:18.521772 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01caf31c-eac2-4f90-aad5-582a7a0f5582 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:18.524167 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01caf31c-eac2-4f90-aad5-582a7a0f5582 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:18.530081 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c6a70-d370-4172-9bdc-098a2ea86c05 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:18.540683 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c6a70-d370-4172-9bdc-098a2ea86c05 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:18.550825 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-01caf31c-eac2-4f90-aad5-582a7a0f5582 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 17:38:18.551128 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82949e2-89e7-4f64-a228-ac143fb20df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:18.552186 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82949e2-89e7-4f64-a228-ac143fb20df2 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:18.552357 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 340/684] 10.222.0.31 () {56 vars in 1114 bytes} [Mon Jan 10 17:38:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:18.552816 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82949e2-89e7-4f64-a228-ac143fb20df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:18.553326 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82949e2-89e7-4f64-a228-ac143fb20df2 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:18.554194 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82949e2-89e7-4f64-a228-ac143fb20df2 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:18.555429 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING py.warnings [None req-f82949e2-89e7-4f64-a228-ac143fb20df2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:38:18.555429 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: warnings.warn(msg) Jan 10 17:38:18.555429 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: Jan 10 17:38:18.556642 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82949e2-89e7-4f64-a228-ac143fb20df2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:18.560941 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01caf31c-eac2-4f90-aad5-582a7a0f5582 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:18.567692 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01caf31c-eac2-4f90-aad5-582a7a0f5582 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:18.572315 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528594a-e3e4-4be5-b262-680d87b40aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:18.572999 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528594a-e3e4-4be5-b262-680d87b40aef admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:18.573328 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528594a-e3e4-4be5-b262-680d87b40aef admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:18.573593 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528594a-e3e4-4be5-b262-680d87b40aef admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:18.574496 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528594a-e3e4-4be5-b262-680d87b40aef admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:18.574802 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528594a-e3e4-4be5-b262-680d87b40aef admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:18.576690 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528594a-e3e4-4be5-b262-680d87b40aef admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:18.585712 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-f82949e2-89e7-4f64-a228-ac143fb20df2 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 10 17:38:18.585712 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 345/685] 10.222.0.31 () {56 vars in 1150 bytes} [Mon Jan 10 17:38:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:18.588689 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82949e2-89e7-4f64-a228-ac143fb20df2 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:18.604215 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82949e2-89e7-4f64-a228-ac143fb20df2 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:18.607352 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 341/686] 10.222.0.31 () {56 vars in 1154 bytes} [Mon Jan 10 17:38:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:18.613798 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528594a-e3e4-4be5-b262-680d87b40aef admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:18.619557 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a5a4b-27ac-4304-bc6e-047febbbecdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:18.620272 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a5a4b-27ac-4304-bc6e-047febbbecdb admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:18.620554 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a5a4b-27ac-4304-bc6e-047febbbecdb admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:18.620826 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a5a4b-27ac-4304-bc6e-047febbbecdb admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:18.622943 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a5a4b-27ac-4304-bc6e-047febbbecdb admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:18.623252 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a5a4b-27ac-4304-bc6e-047febbbecdb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:18.629077 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528594a-e3e4-4be5-b262-680d87b40aef admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:18.629227 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING py.warnings [None req-034a5a4b-27ac-4304-bc6e-047febbbecdb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:38:18.629227 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: warnings.warn(msg) Jan 10 17:38:18.629227 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: Jan 10 17:38:18.630084 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a5a4b-27ac-4304-bc6e-047febbbecdb admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:18.634809 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac45fa2-869a-4cf8-882e-54ed77395350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:18.637275 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac45fa2-869a-4cf8-882e-54ed77395350 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:18.637551 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac45fa2-869a-4cf8-882e-54ed77395350 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:18.637855 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac45fa2-869a-4cf8-882e-54ed77395350 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:18.638747 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 346/687] 10.222.0.31 () {56 vars in 1145 bytes} [Mon Jan 10 17:38:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:18.642530 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a5a4b-27ac-4304-bc6e-047febbbecdb admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:18.654589 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac45fa2-869a-4cf8-882e-54ed77395350 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:18.656404 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac45fa2-869a-4cf8-882e-54ed77395350 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:18.658703 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a5a4b-27ac-4304-bc6e-047febbbecdb admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:18.667858 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40766901-3ded-4a03-9725-a153bb2f5d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:18.669563 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40766901-3ded-4a03-9725-a153bb2f5d80 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:18.669885 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40766901-3ded-4a03-9725-a153bb2f5d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:18.670157 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40766901-3ded-4a03-9725-a153bb2f5d80 admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:18.673049 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40766901-3ded-4a03-9725-a153bb2f5d80 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:18.673594 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40766901-3ded-4a03-9725-a153bb2f5d80 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:18.673981 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 342/688] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:38:18.675778 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40766901-3ded-4a03-9725-a153bb2f5d80 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:18.679705 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac45fa2-869a-4cf8-882e-54ed77395350 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:18.687519 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 347/689] 10.222.0.31 () {56 vars in 1145 bytes} [Mon Jan 10 17:38:18 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:18.690949 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac45fa2-869a-4cf8-882e-54ed77395350 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:18.695791 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670be032-4240-4016-bf10-e4a0c21952a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:18.696669 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670be032-4240-4016-bf10-e4a0c21952a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:18.696978 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670be032-4240-4016-bf10-e4a0c21952a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:18.697250 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670be032-4240-4016-bf10-e4a0c21952a2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:18.709705 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670be032-4240-4016-bf10-e4a0c21952a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:18.711655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670be032-4240-4016-bf10-e4a0c21952a2 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:18.736874 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-670be032-4240-4016-bf10-e4a0c21952a2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:18.736874 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 343/690] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:18.741979 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40766901-3ded-4a03-9725-a153bb2f5d80 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:18.752972 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40766901-3ded-4a03-9725-a153bb2f5d80 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:18.757688 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e1a86-09e5-4fa9-bad1-c993024fd9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:18.758462 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e1a86-09e5-4fa9-bad1-c993024fd9ca admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:18.758739 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e1a86-09e5-4fa9-bad1-c993024fd9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:18.759014 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e1a86-09e5-4fa9-bad1-c993024fd9ca admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:18.759810 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e1a86-09e5-4fa9-bad1-c993024fd9ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:18.760108 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e1a86-09e5-4fa9-bad1-c993024fd9ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:18.761833 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e1a86-09e5-4fa9-bad1-c993024fd9ca admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:18.783449 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 348/691] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:18.789045 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670be032-4240-4016-bf10-e4a0c21952a2 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:18.802379 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670be032-4240-4016-bf10-e4a0c21952a2 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:18.807248 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c844c79-4c11-4adb-88a9-5aea3cc9214f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:18.808125 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c844c79-4c11-4adb-88a9-5aea3cc9214f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:18.808407 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c844c79-4c11-4adb-88a9-5aea3cc9214f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:18.808679 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c844c79-4c11-4adb-88a9-5aea3cc9214f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:18.816746 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c844c79-4c11-4adb-88a9-5aea3cc9214f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:18.818915 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c844c79-4c11-4adb-88a9-5aea3cc9214f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:18.839240 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-8c844c79-4c11-4adb-88a9-5aea3cc9214f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:18.840496 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 344/692] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:18.848393 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e1a86-09e5-4fa9-bad1-c993024fd9ca admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:18.861706 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e1a86-09e5-4fa9-bad1-c993024fd9ca admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:18.868494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac46c40-5cdc-497d-aa72-d2a2141d28e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:18.869219 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac46c40-5cdc-497d-aa72-d2a2141d28e0 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:18.869547 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac46c40-5cdc-497d-aa72-d2a2141d28e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:18.869818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac46c40-5cdc-497d-aa72-d2a2141d28e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:18.870691 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac46c40-5cdc-497d-aa72-d2a2141d28e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:18.870993 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac46c40-5cdc-497d-aa72-d2a2141d28e0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:18.872991 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac46c40-5cdc-497d-aa72-d2a2141d28e0 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:18.899864 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 349/693] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:18.905788 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c844c79-4c11-4adb-88a9-5aea3cc9214f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:18.922647 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c844c79-4c11-4adb-88a9-5aea3cc9214f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:18.930431 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94570f42-0d0f-4346-8d03-42a6843c93f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:18.931145 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94570f42-0d0f-4346-8d03-42a6843c93f0 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:18.931421 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94570f42-0d0f-4346-8d03-42a6843c93f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:18.931740 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94570f42-0d0f-4346-8d03-42a6843c93f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:18.932678 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94570f42-0d0f-4346-8d03-42a6843c93f0 admin admin] RBAC: Adding query filter params (role.id=3c05bedf79e04eb38d2ae66736030bfe, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=877acd6448214ef893d119e3b1043402) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:18.933072 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94570f42-0d0f-4346-8d03-42a6843c93f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:18.935013 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94570f42-0d0f-4346-8d03-42a6843c93f0 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:18.945880 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 345/694] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:38:18 2022] GET /identity/v3/role_assignments?user.id=877acd6448214ef893d119e3b1043402&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=3c05bedf79e04eb38d2ae66736030bfe => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:19.232270 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32b932-3533-46d6-907b-138e04e1d7e7 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:19.233001 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32b932-3533-46d6-907b-138e04e1d7e7 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:19.233001 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32b932-3533-46d6-907b-138e04e1d7e7 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:19.234722 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 350/695] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:19.241655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae61e44-6868-4650-971e-5b98c9f9557a None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:19.242201 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae61e44-6868-4650-971e-5b98c9f9557a None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:19.242201 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae61e44-6868-4650-971e-5b98c9f9557a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:19.259931 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-dae61e44-6868-4650-971e-5b98c9f9557a None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:19.261137 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-dae61e44-6868-4650-971e-5b98c9f9557a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:19.269568 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 346/696] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:38:19.292329 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32b932-3533-46d6-907b-138e04e1d7e7 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:19.310756 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32b932-3533-46d6-907b-138e04e1d7e7 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:19.315252 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de459e8b-29e0-4464-92c9-ccb6168ffc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:19.316061 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de459e8b-29e0-4464-92c9-ccb6168ffc93 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:19.316338 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de459e8b-29e0-4464-92c9-ccb6168ffc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:19.316610 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de459e8b-29e0-4464-92c9-ccb6168ffc93 admin admin] PATH_INFO: `/v3/services/network` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:19.317309 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de459e8b-29e0-4464-92c9-ccb6168ffc93 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:19.318931 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de459e8b-29e0-4464-92c9-ccb6168ffc93 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:19.336525 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-de459e8b-29e0-4464-92c9-ccb6168ffc93 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 10 17:38:19.338160 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 351/697] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:19 2022] GET /identity/v3/services/network => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:19.344017 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae61e44-6868-4650-971e-5b98c9f9557a None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:19.353095 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae61e44-6868-4650-971e-5b98c9f9557a None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:19.360912 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3adce-e184-4e45-ada5-df5b8e3477d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:19.361652 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3adce-e184-4e45-ada5-df5b8e3477d9 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:19.361933 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3adce-e184-4e45-ada5-df5b8e3477d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:19.362204 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3adce-e184-4e45-ada5-df5b8e3477d9 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:19.362927 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3adce-e184-4e45-ada5-df5b8e3477d9 admin admin] RBAC: Adding query filter params (name=network) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:19.363225 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3adce-e184-4e45-ada5-df5b8e3477d9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:19.364238 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING py.warnings [None req-8bb3adce-e184-4e45-ada5-df5b8e3477d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:38:19.364238 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: warnings.warn(msg) Jan 10 17:38:19.364238 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: Jan 10 17:38:19.365149 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3adce-e184-4e45-ada5-df5b8e3477d9 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:19.373748 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 347/698] 10.222.0.31 () {56 vars in 1133 bytes} [Mon Jan 10 17:38:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:19.379490 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de459e8b-29e0-4464-92c9-ccb6168ffc93 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:19.389284 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de459e8b-29e0-4464-92c9-ccb6168ffc93 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:19.396874 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e9af8-6ff6-47da-8e86-a82bcd1e654a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:19.397544 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e9af8-6ff6-47da-8e86-a82bcd1e654a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:19.397830 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e9af8-6ff6-47da-8e86-a82bcd1e654a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:19.398453 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e9af8-6ff6-47da-8e86-a82bcd1e654a admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:19.399172 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e9af8-6ff6-47da-8e86-a82bcd1e654a admin admin] RBAC: Adding query filter params (type=network) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:19.399473 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e9af8-6ff6-47da-8e86-a82bcd1e654a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:19.401088 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e9af8-6ff6-47da-8e86-a82bcd1e654a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:19.405982 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 352/699] 10.222.0.31 () {56 vars in 1133 bytes} [Mon Jan 10 17:38:19 2022] GET /identity/v3/services?type=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:19.467874 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388c27c-6919-466c-a068-cead0060e7c7 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:19.468203 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388c27c-6919-466c-a068-cead0060e7c7 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:19.468417 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388c27c-6919-466c-a068-cead0060e7c7 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:19.470509 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 348/700] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:19.476200 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1a657-57e2-4ab2-88bc-cf8904584ada None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:19.476521 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1a657-57e2-4ab2-88bc-cf8904584ada None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:19.476746 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1a657-57e2-4ab2-88bc-cf8904584ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:19.502319 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-47b1a657-57e2-4ab2-88bc-cf8904584ada None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:19.503451 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-47b1a657-57e2-4ab2-88bc-cf8904584ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:19.515632 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 353/701] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:38:19.562221 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388c27c-6919-466c-a068-cead0060e7c7 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:19.579459 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388c27c-6919-466c-a068-cead0060e7c7 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:19.585205 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a8708-9bc4-4f81-be8a-cfd026c1ae62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:19.586072 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a8708-9bc4-4f81-be8a-cfd026c1ae62 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:19.586350 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a8708-9bc4-4f81-be8a-cfd026c1ae62 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:19.586620 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a8708-9bc4-4f81-be8a-cfd026c1ae62 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:19.610245 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a8708-9bc4-4f81-be8a-cfd026c1ae62 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:19.612208 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a8708-9bc4-4f81-be8a-cfd026c1ae62 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:19.636669 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-0e5a8708-9bc4-4f81-be8a-cfd026c1ae62 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:19.638288 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 349/702] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:19.644269 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1a657-57e2-4ab2-88bc-cf8904584ada None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:19.659277 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1a657-57e2-4ab2-88bc-cf8904584ada None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:19.668902 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d3e50-01ab-4902-ba44-1699ad328aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:19.669573 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d3e50-01ab-4902-ba44-1699ad328aab admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:19.669848 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d3e50-01ab-4902-ba44-1699ad328aab admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:19.670121 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d3e50-01ab-4902-ba44-1699ad328aab admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:19.670873 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d3e50-01ab-4902-ba44-1699ad328aab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:19.671173 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d3e50-01ab-4902-ba44-1699ad328aab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:19.672801 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d3e50-01ab-4902-ba44-1699ad328aab admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:19.687671 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 354/703] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:19.693309 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a8708-9bc4-4f81-be8a-cfd026c1ae62 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:19.703954 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a8708-9bc4-4f81-be8a-cfd026c1ae62 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:19.709662 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ca49f-2de1-47a7-8e95-9cddc2151810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:19.710324 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ca49f-2de1-47a7-8e95-9cddc2151810 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:19.710605 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ca49f-2de1-47a7-8e95-9cddc2151810 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:19.710875 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ca49f-2de1-47a7-8e95-9cddc2151810 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:19.711610 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ca49f-2de1-47a7-8e95-9cddc2151810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:19.713550 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ca49f-2de1-47a7-8e95-9cddc2151810 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:19.744013 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 350/704] 10.222.0.31 () {60 vars in 1153 bytes} [Mon Jan 10 17:38:19 2022] POST /identity/v3/users => generated 254 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:38:19.809350 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059fbd9-b575-4bdd-8ff3-59287a1be39d None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:19.809638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059fbd9-b575-4bdd-8ff3-59287a1be39d None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:19.809918 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059fbd9-b575-4bdd-8ff3-59287a1be39d None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:19.811838 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 355/705] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:19.822516 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4c6c1-3728-4cf8-910f-f9b94e14b3ce None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:19.822878 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4c6c1-3728-4cf8-910f-f9b94e14b3ce None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:19.823165 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4c6c1-3728-4cf8-910f-f9b94e14b3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:19.845683 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-34e4c6c1-3728-4cf8-910f-f9b94e14b3ce None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:19.846940 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-34e4c6c1-3728-4cf8-910f-f9b94e14b3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:19.854968 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 351/706] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:38:19.890737 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059fbd9-b575-4bdd-8ff3-59287a1be39d None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:19.905926 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059fbd9-b575-4bdd-8ff3-59287a1be39d None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:19.910522 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cbf78-7214-4d75-aa77-e1671a751ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:19.911384 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cbf78-7214-4d75-aa77-e1671a751ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:19.911667 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cbf78-7214-4d75-aa77-e1671a751ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:19.911943 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cbf78-7214-4d75-aa77-e1671a751ef7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:19.928278 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cbf78-7214-4d75-aa77-e1671a751ef7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:19.935540 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-754cbf78-7214-4d75-aa77-e1671a751ef7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 17:38:19.936981 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 356/707] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:38:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:19.943240 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4c6c1-3728-4cf8-910f-f9b94e14b3ce None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:19.953065 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4c6c1-3728-4cf8-910f-f9b94e14b3ce None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:19.960897 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f931c4-a562-4b45-b00d-29ef0da7c8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:19.961669 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f931c4-a562-4b45-b00d-29ef0da7c8ce admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:19.961999 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f931c4-a562-4b45-b00d-29ef0da7c8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:19.962277 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f931c4-a562-4b45-b00d-29ef0da7c8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:19.963117 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f931c4-a562-4b45-b00d-29ef0da7c8ce admin admin] RBAC: Adding query filter params (name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:19.963603 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f931c4-a562-4b45-b00d-29ef0da7c8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:19.965484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f931c4-a562-4b45-b00d-29ef0da7c8ce admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:19.976174 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 352/708] 10.222.0.31 () {56 vars in 1124 bytes} [Mon Jan 10 17:38:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:19.981833 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cbf78-7214-4d75-aa77-e1671a751ef7 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:19.995095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cbf78-7214-4d75-aa77-e1671a751ef7 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:20.000892 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b106e5-be9c-43b3-a15f-ebe15e3d392e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:20.001781 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b106e5-be9c-43b3-a15f-ebe15e3d392e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:20.002123 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b106e5-be9c-43b3-a15f-ebe15e3d392e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:20.002450 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b106e5-be9c-43b3-a15f-ebe15e3d392e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:20.019272 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b106e5-be9c-43b3-a15f-ebe15e3d392e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:20.021312 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b106e5-be9c-43b3-a15f-ebe15e3d392e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:20.044615 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-17b106e5-be9c-43b3-a15f-ebe15e3d392e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:20.046264 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 357/709] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:20.051579 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f931c4-a562-4b45-b00d-29ef0da7c8ce admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:20.066487 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f931c4-a562-4b45-b00d-29ef0da7c8ce admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:20.076378 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f31de6-431b-4be2-824a-c208085e5d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:20.077138 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f31de6-431b-4be2-824a-c208085e5d52 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:20.077463 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f31de6-431b-4be2-824a-c208085e5d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:20.077737 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f31de6-431b-4be2-824a-c208085e5d52 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:20.078543 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f31de6-431b-4be2-824a-c208085e5d52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:20.078846 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f31de6-431b-4be2-824a-c208085e5d52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:20.080564 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f31de6-431b-4be2-824a-c208085e5d52 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:20.099337 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 353/710] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:20.104743 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b106e5-be9c-43b3-a15f-ebe15e3d392e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:20.116967 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b106e5-be9c-43b3-a15f-ebe15e3d392e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:20.123929 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5a431-2479-4610-96e9-edfc5510d5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:20.124784 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5a431-2479-4610-96e9-edfc5510d5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:20.125099 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5a431-2479-4610-96e9-edfc5510d5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:20.125409 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5a431-2479-4610-96e9-edfc5510d5c4 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:20.136984 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5a431-2479-4610-96e9-edfc5510d5c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:20.139112 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5a431-2479-4610-96e9-edfc5510d5c4 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:20.157743 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-a9e5a431-2479-4610-96e9-edfc5510d5c4 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 10 17:38:20.158223 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 358/711] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:38:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:20.163340 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f31de6-431b-4be2-824a-c208085e5d52 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:20.175888 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f31de6-431b-4be2-824a-c208085e5d52 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:20.181454 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e82ff-87d9-4b39-bf58-479b1e4a4ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:20.182216 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e82ff-87d9-4b39-bf58-479b1e4a4ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:20.182535 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e82ff-87d9-4b39-bf58-479b1e4a4ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:20.182805 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e82ff-87d9-4b39-bf58-479b1e4a4ec7 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:20.183654 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e82ff-87d9-4b39-bf58-479b1e4a4ec7 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:20.183995 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e82ff-87d9-4b39-bf58-479b1e4a4ec7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:20.185926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e82ff-87d9-4b39-bf58-479b1e4a4ec7 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:20.211475 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 354/712] 10.222.0.31 () {56 vars in 1156 bytes} [Mon Jan 10 17:38:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:20.217312 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5a431-2479-4610-96e9-edfc5510d5c4 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:20.229980 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5a431-2479-4610-96e9-edfc5510d5c4 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:20.235518 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabc9b8-afd6-454b-990d-f55c0d6226fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:20.236876 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabc9b8-afd6-454b-990d-f55c0d6226fe admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:20.237304 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabc9b8-afd6-454b-990d-f55c0d6226fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:20.237721 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabc9b8-afd6-454b-990d-f55c0d6226fe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:20.247410 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabc9b8-afd6-454b-990d-f55c0d6226fe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:20.249399 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabc9b8-afd6-454b-990d-f55c0d6226fe admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:20.260064 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 359/713] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:38:20.265463 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e82ff-87d9-4b39-bf58-479b1e4a4ec7 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:20.278831 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e82ff-87d9-4b39-bf58-479b1e4a4ec7 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:20.288410 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0f8e0-9de9-4c7b-b823-f0d888e15d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:20.289414 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0f8e0-9de9-4c7b-b823-f0d888e15d5b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:20.289789 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0f8e0-9de9-4c7b-b823-f0d888e15d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:20.290157 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0f8e0-9de9-4c7b-b823-f0d888e15d5b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:20.303545 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0f8e0-9de9-4c7b-b823-f0d888e15d5b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:20.305405 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0f8e0-9de9-4c7b-b823-f0d888e15d5b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:20.322109 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-8bb0f8e0-9de9-4c7b-b823-f0d888e15d5b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:20.323238 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 355/714] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:20.328899 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabc9b8-afd6-454b-990d-f55c0d6226fe admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:20.344878 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabc9b8-afd6-454b-990d-f55c0d6226fe admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:20.354450 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe5d8b-b343-4ad9-ae43-f19d0d9664c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:20.355414 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe5d8b-b343-4ad9-ae43-f19d0d9664c5 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:20.355874 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe5d8b-b343-4ad9-ae43-f19d0d9664c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:20.356293 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe5d8b-b343-4ad9-ae43-f19d0d9664c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:20.357255 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe5d8b-b343-4ad9-ae43-f19d0d9664c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:20.357744 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe5d8b-b343-4ad9-ae43-f19d0d9664c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:20.359626 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe5d8b-b343-4ad9-ae43-f19d0d9664c5 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:20.379186 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 360/715] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:20.384790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0f8e0-9de9-4c7b-b823-f0d888e15d5b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:20.396993 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0f8e0-9de9-4c7b-b823-f0d888e15d5b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:20.414030 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4222aa-b403-4c0b-8d82-b210a7ffe7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:20.414846 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4222aa-b403-4c0b-8d82-b210a7ffe7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:20.415123 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4222aa-b403-4c0b-8d82-b210a7ffe7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:20.415390 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4222aa-b403-4c0b-8d82-b210a7ffe7b2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:20.422945 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4222aa-b403-4c0b-8d82-b210a7ffe7b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:20.424999 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4222aa-b403-4c0b-8d82-b210a7ffe7b2 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:20.446822 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-fa4222aa-b403-4c0b-8d82-b210a7ffe7b2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:20.448078 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 356/716] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:20.454012 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe5d8b-b343-4ad9-ae43-f19d0d9664c5 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:20.466394 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe5d8b-b343-4ad9-ae43-f19d0d9664c5 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:20.481497 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc5c5e-db47-4595-8736-a9843d35c72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:20.482369 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc5c5e-db47-4595-8736-a9843d35c72e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:20.482794 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc5c5e-db47-4595-8736-a9843d35c72e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:20.483210 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc5c5e-db47-4595-8736-a9843d35c72e admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:20.484177 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc5c5e-db47-4595-8736-a9843d35c72e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:20.484643 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc5c5e-db47-4595-8736-a9843d35c72e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:20.486725 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc5c5e-db47-4595-8736-a9843d35c72e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:20.503987 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 361/717] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:20.510124 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4222aa-b403-4c0b-8d82-b210a7ffe7b2 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:20.528578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4222aa-b403-4c0b-8d82-b210a7ffe7b2 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:20.534495 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f26ffd-679f-48fd-91ee-acd126944142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:20.535325 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f26ffd-679f-48fd-91ee-acd126944142 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:20.535770 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f26ffd-679f-48fd-91ee-acd126944142 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:20.536188 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f26ffd-679f-48fd-91ee-acd126944142 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:20.537210 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f26ffd-679f-48fd-91ee-acd126944142 admin admin] RBAC: Adding query filter params (role.id=67bb9b9aab104609b23a2ab5e7d31142, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=0257a86ce85b4b4386cde32c8ed4b39a) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:20.537685 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f26ffd-679f-48fd-91ee-acd126944142 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:20.539672 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f26ffd-679f-48fd-91ee-acd126944142 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:20.549739 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 357/718] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:38:20 2022] GET /identity/v3/role_assignments?user.id=0257a86ce85b4b4386cde32c8ed4b39a&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=67bb9b9aab104609b23a2ab5e7d31142 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:21.808206 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dcee1-26ee-4a9e-989a-953efdfb5ab8 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:21.809246 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dcee1-26ee-4a9e-989a-953efdfb5ab8 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:21.809735 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dcee1-26ee-4a9e-989a-953efdfb5ab8 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:21.811772 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 362/719] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:21.817114 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4fcd6-697b-4d83-9ddc-67135ee22da2 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:21.817540 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4fcd6-697b-4d83-9ddc-67135ee22da2 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:21.817732 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4fcd6-697b-4d83-9ddc-67135ee22da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:21.835592 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-59f4fcd6-697b-4d83-9ddc-67135ee22da2 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:21.836761 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-59f4fcd6-697b-4d83-9ddc-67135ee22da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:21.850569 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 358/720] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 17:38:21.892283 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dcee1-26ee-4a9e-989a-953efdfb5ab8 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:21.904486 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749c2ea-e469-4814-bfa5-270bec40569f None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:21.904763 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749c2ea-e469-4814-bfa5-270bec40569f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:21.905034 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749c2ea-e469-4814-bfa5-270bec40569f None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:21.907086 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 359/721] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:21.908400 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dcee1-26ee-4a9e-989a-953efdfb5ab8 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:21.911696 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8284a-a176-434b-b97d-22e9693b36ed None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:21.912046 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8284a-a176-434b-b97d-22e9693b36ed None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:21.912331 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8284a-a176-434b-b97d-22e9693b36ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:21.914223 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cd767-bdae-420a-b8b9-ea492363099c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:21.915013 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cd767-bdae-420a-b8b9-ea492363099c admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:21.915294 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cd767-bdae-420a-b8b9-ea492363099c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:21.915566 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cd767-bdae-420a-b8b9-ea492363099c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:21.934613 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cd767-bdae-420a-b8b9-ea492363099c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:21.941440 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-414cd767-bdae-420a-b8b9-ea492363099c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:38:21.943928 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 363/722] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:38:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:21.948181 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-1be8284a-a176-434b-b97d-22e9693b36ed None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:21.949407 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-1be8284a-a176-434b-b97d-22e9693b36ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:21.951059 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cd767-bdae-420a-b8b9-ea492363099c admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:21.963122 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cd767-bdae-420a-b8b9-ea492363099c admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:21.965164 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 360/723] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 17:38:21.972151 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44518f-bae2-434a-ab61-268c7a739a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:21.972813 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44518f-bae2-434a-ab61-268c7a739a93 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:21.973121 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44518f-bae2-434a-ab61-268c7a739a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:21.973399 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44518f-bae2-434a-ab61-268c7a739a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:21.974161 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44518f-bae2-434a-ab61-268c7a739a93 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:21.974466 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44518f-bae2-434a-ab61-268c7a739a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:21.976071 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44518f-bae2-434a-ab61-268c7a739a93 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:21.986070 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 364/724] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:38:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:21.991356 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8284a-a176-434b-b97d-22e9693b36ed None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:22.001312 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8284a-a176-434b-b97d-22e9693b36ed None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:22.003056 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44518f-bae2-434a-ab61-268c7a739a93 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:22.011181 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43bb64-4bd4-41ea-b1f7-02a1f039b371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:22.011999 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43bb64-4bd4-41ea-b1f7-02a1f039b371 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:22.012281 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43bb64-4bd4-41ea-b1f7-02a1f039b371 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:22.012556 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43bb64-4bd4-41ea-b1f7-02a1f039b371 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:22.020243 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44518f-bae2-434a-ab61-268c7a739a93 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:22.030864 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df01ced-14b2-4de2-9c6e-ea6a7ff316c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:22.031535 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df01ced-14b2-4de2-9c6e-ea6a7ff316c2 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:22.032786 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df01ced-14b2-4de2-9c6e-ea6a7ff316c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:22.033099 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df01ced-14b2-4de2-9c6e-ea6a7ff316c2 admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:22.034188 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df01ced-14b2-4de2-9c6e-ea6a7ff316c2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:22.035409 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43bb64-4bd4-41ea-b1f7-02a1f039b371 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:22.036482 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING py.warnings [None req-9df01ced-14b2-4de2-9c6e-ea6a7ff316c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:38:22.036482 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: warnings.warn(msg) Jan 10 17:38:22.036482 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: Jan 10 17:38:22.038240 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43bb64-4bd4-41ea-b1f7-02a1f039b371 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:22.039254 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df01ced-14b2-4de2-9c6e-ea6a7ff316c2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:22.064731 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-1c43bb64-4bd4-41ea-b1f7-02a1f039b371 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:22.068363 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 365/725] 10.222.0.31 () {60 vars in 1162 bytes} [Mon Jan 10 17:38:22 2022] POST /identity/v3/services => generated 251 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:38:22.069823 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 361/726] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:22.078429 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df01ced-14b2-4de2-9c6e-ea6a7ff316c2 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:22.102873 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df01ced-14b2-4de2-9c6e-ea6a7ff316c2 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:22.107717 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9095e28-458e-4220-ad42-a949879bd5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:22.108419 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9095e28-458e-4220-ad42-a949879bd5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:22.108692 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9095e28-458e-4220-ad42-a949879bd5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:22.109038 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9095e28-458e-4220-ad42-a949879bd5b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:22.109806 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9095e28-458e-4220-ad42-a949879bd5b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:22.110158 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9095e28-458e-4220-ad42-a949879bd5b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:22.111930 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9095e28-458e-4220-ad42-a949879bd5b6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:22.126317 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 366/727] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:22.131834 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43bb64-4bd4-41ea-b1f7-02a1f039b371 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:22.147636 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43bb64-4bd4-41ea-b1f7-02a1f039b371 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:22.156018 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ce5e8-c2da-4f68-9f87-a5a020d66d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:22.156875 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ce5e8-c2da-4f68-9f87-a5a020d66d53 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:22.157210 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ce5e8-c2da-4f68-9f87-a5a020d66d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:22.157485 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ce5e8-c2da-4f68-9f87-a5a020d66d53 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:22.166494 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ce5e8-c2da-4f68-9f87-a5a020d66d53 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:22.168618 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ce5e8-c2da-4f68-9f87-a5a020d66d53 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:22.184063 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-864ce5e8-c2da-4f68-9f87-a5a020d66d53 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 17:38:22.185741 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 362/728] 10.222.0.31 () {56 vars in 1114 bytes} [Mon Jan 10 17:38:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:22.194393 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9095e28-458e-4220-ad42-a949879bd5b6 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:22.205853 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9095e28-458e-4220-ad42-a949879bd5b6 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:22.216900 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03fefd-f747-458d-86ec-a1b9c25f714a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:22.216900 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03fefd-f747-458d-86ec-a1b9c25f714a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:22.216900 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03fefd-f747-458d-86ec-a1b9c25f714a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:22.216900 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03fefd-f747-458d-86ec-a1b9c25f714a admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:22.217709 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03fefd-f747-458d-86ec-a1b9c25f714a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:22.217709 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03fefd-f747-458d-86ec-a1b9c25f714a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:22.217709 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03fefd-f747-458d-86ec-a1b9c25f714a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:22.243490 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 367/729] 10.222.0.31 () {56 vars in 1154 bytes} [Mon Jan 10 17:38:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:22.249479 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ce5e8-c2da-4f68-9f87-a5a020d66d53 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:22.262738 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ce5e8-c2da-4f68-9f87-a5a020d66d53 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:22.273835 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b9528-06bf-459e-8007-90ad90ba5fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:22.274742 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b9528-06bf-459e-8007-90ad90ba5fef admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:22.275027 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b9528-06bf-459e-8007-90ad90ba5fef admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:22.275300 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b9528-06bf-459e-8007-90ad90ba5fef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:22.295420 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b9528-06bf-459e-8007-90ad90ba5fef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:22.297362 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b9528-06bf-459e-8007-90ad90ba5fef admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:22.324326 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-4f5b9528-06bf-459e-8007-90ad90ba5fef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:22.325888 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 363/730] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:22.331130 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03fefd-f747-458d-86ec-a1b9c25f714a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:22.343921 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03fefd-f747-458d-86ec-a1b9c25f714a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:22.349057 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00f884-ed3f-4378-aa8b-d7a0e0397a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:22.350025 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00f884-ed3f-4378-aa8b-d7a0e0397a33 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:22.350541 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00f884-ed3f-4378-aa8b-d7a0e0397a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:22.351019 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00f884-ed3f-4378-aa8b-d7a0e0397a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:22.351968 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00f884-ed3f-4378-aa8b-d7a0e0397a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:22.352479 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00f884-ed3f-4378-aa8b-d7a0e0397a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:22.354305 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00f884-ed3f-4378-aa8b-d7a0e0397a33 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:22.367268 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 368/731] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:22.372417 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b9528-06bf-459e-8007-90ad90ba5fef admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:22.382765 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b9528-06bf-459e-8007-90ad90ba5fef admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:22.387598 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a8c8c-2aea-4814-a792-b518e6df04cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:22.388698 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a8c8c-2aea-4814-a792-b518e6df04cf admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:22.389958 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a8c8c-2aea-4814-a792-b518e6df04cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:22.390427 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a8c8c-2aea-4814-a792-b518e6df04cf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:22.398562 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a8c8c-2aea-4814-a792-b518e6df04cf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:22.400790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a8c8c-2aea-4814-a792-b518e6df04cf admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:22.402873 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7553da-2b76-490c-9fb5-1ffec7c0dddd None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:22.403361 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7553da-2b76-490c-9fb5-1ffec7c0dddd None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:22.403844 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7553da-2b76-490c-9fb5-1ffec7c0dddd None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:22.405892 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 369/732] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:38:22.410962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebfd62-d191-411f-882e-b5eae6658e1a None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:22.411463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebfd62-d191-411f-882e-b5eae6658e1a None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:22.411932 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebfd62-d191-411f-882e-b5eae6658e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:22.420028 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-0e9a8c8c-2aea-4814-a792-b518e6df04cf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:22.421327 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 364/733] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:22.427455 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a8c8c-2aea-4814-a792-b518e6df04cf admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:22.432344 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-d1ebfd62-d191-411f-882e-b5eae6658e1a None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:22.433821 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-d1ebfd62-d191-411f-882e-b5eae6658e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:22.440455 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a8c8c-2aea-4814-a792-b518e6df04cf admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:22.443821 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 370/734] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:22 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:38:22.447822 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1c0d2-0d97-44dc-96b9-ef7244120ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:22.448828 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1c0d2-0d97-44dc-96b9-ef7244120ecf admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:22.449341 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1c0d2-0d97-44dc-96b9-ef7244120ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:22.449869 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1c0d2-0d97-44dc-96b9-ef7244120ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:22.450900 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1c0d2-0d97-44dc-96b9-ef7244120ecf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:22.451394 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1c0d2-0d97-44dc-96b9-ef7244120ecf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:22.453626 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1c0d2-0d97-44dc-96b9-ef7244120ecf admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:22.468430 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 365/735] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:22.469081 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebfd62-d191-411f-882e-b5eae6658e1a None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:22.473162 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1c0d2-0d97-44dc-96b9-ef7244120ecf admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:22.478898 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebfd62-d191-411f-882e-b5eae6658e1a None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:22.484032 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1c0d2-0d97-44dc-96b9-ef7244120ecf admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:22.488148 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddb4f4-f79b-49d6-aad9-257f9f854b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:22.489267 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddb4f4-f79b-49d6-aad9-257f9f854b22 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:22.489796 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddb4f4-f79b-49d6-aad9-257f9f854b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:22.490281 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddb4f4-f79b-49d6-aad9-257f9f854b22 admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:22.490520 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfc5f9-cef9-49c4-af81-08caa7f06048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:22.491404 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfc5f9-cef9-49c4-af81-08caa7f06048 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:22.491689 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfc5f9-cef9-49c4-af81-08caa7f06048 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:22.491954 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddb4f4-f79b-49d6-aad9-257f9f854b22 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:22.492059 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfc5f9-cef9-49c4-af81-08caa7f06048 admin admin] PATH_INFO: `/v3/projects/1415eea0335a49bf800e8215498af679/users/877acd6448214ef893d119e3b1043402/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:22.494072 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfc5f9-cef9-49c4-af81-08caa7f06048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1415eea0335a49bf800e8215498af679, user_id=877acd6448214ef893d119e3b1043402, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:22.494457 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddb4f4-f79b-49d6-aad9-257f9f854b22 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:22.496636 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfc5f9-cef9-49c4-af81-08caa7f06048 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:22.516082 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 371/736] 10.222.0.31 () {60 vars in 1162 bytes} [Mon Jan 10 17:38:22 2022] POST /identity/v3/services => generated 240 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:38:22.520904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 366/737] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:38:22 2022] PUT /identity/v3/projects/1415eea0335a49bf800e8215498af679/users/877acd6448214ef893d119e3b1043402/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:38:22.857167 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a172caa-e5e3-4c92-bfd0-293dd70955f7 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:22.858132 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a172caa-e5e3-4c92-bfd0-293dd70955f7 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:22.858605 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a172caa-e5e3-4c92-bfd0-293dd70955f7 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:22.860984 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 372/738] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:22.867434 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e6451-3581-41f4-8a21-0b67ad5f2a96 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:22.867902 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e6451-3581-41f4-8a21-0b67ad5f2a96 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:22.868002 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e6451-3581-41f4-8a21-0b67ad5f2a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:22.890055 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-c87e6451-3581-41f4-8a21-0b67ad5f2a96 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:22.891265 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-c87e6451-3581-41f4-8a21-0b67ad5f2a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:22.976560 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 367/739] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:22 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:23.021278 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a172caa-e5e3-4c92-bfd0-293dd70955f7 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:23.042602 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a172caa-e5e3-4c92-bfd0-293dd70955f7 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:23.052829 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725ea92-1672-4dc0-a1f1-9496caae1d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:23.053949 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725ea92-1672-4dc0-a1f1-9496caae1d72 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:23.054425 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725ea92-1672-4dc0-a1f1-9496caae1d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:23.054910 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725ea92-1672-4dc0-a1f1-9496caae1d72 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:23.074241 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725ea92-1672-4dc0-a1f1-9496caae1d72 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:23.081464 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-7725ea92-1672-4dc0-a1f1-9496caae1d72 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 17:38:23.082894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 373/740] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:38:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:23.088926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e6451-3581-41f4-8a21-0b67ad5f2a96 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:23.102201 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e6451-3581-41f4-8a21-0b67ad5f2a96 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:23.111340 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b08fe8-ee34-4577-b402-eaa704e0b3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:23.112017 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b08fe8-ee34-4577-b402-eaa704e0b3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:23.112297 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b08fe8-ee34-4577-b402-eaa704e0b3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:23.112617 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b08fe8-ee34-4577-b402-eaa704e0b3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:23.113457 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b08fe8-ee34-4577-b402-eaa704e0b3a0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:23.113769 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b08fe8-ee34-4577-b402-eaa704e0b3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:23.115434 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b08fe8-ee34-4577-b402-eaa704e0b3a0 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:23.130392 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 368/741] 10.222.0.31 () {56 vars in 1124 bytes} [Mon Jan 10 17:38:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:23.135827 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725ea92-1672-4dc0-a1f1-9496caae1d72 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:23.149186 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725ea92-1672-4dc0-a1f1-9496caae1d72 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:23.156940 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bae69-cc0f-415b-88ce-02a664f7d6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:23.157975 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bae69-cc0f-415b-88ce-02a664f7d6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:23.158610 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bae69-cc0f-415b-88ce-02a664f7d6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:23.159007 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bae69-cc0f-415b-88ce-02a664f7d6d6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:23.176648 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6bae69-cc0f-415b-88ce-02a664f7d6d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:23.178780 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6bae69-cc0f-415b-88ce-02a664f7d6d6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:23.198680 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-4b6bae69-cc0f-415b-88ce-02a664f7d6d6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:23.200179 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 374/742] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:23.206504 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b08fe8-ee34-4577-b402-eaa704e0b3a0 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:23.225670 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b08fe8-ee34-4577-b402-eaa704e0b3a0 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:23.232919 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b93e38-fc46-42b7-a1a1-33e0491aa207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:23.233676 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b93e38-fc46-42b7-a1a1-33e0491aa207 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:23.234002 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b93e38-fc46-42b7-a1a1-33e0491aa207 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:23.234281 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b93e38-fc46-42b7-a1a1-33e0491aa207 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:23.235027 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b93e38-fc46-42b7-a1a1-33e0491aa207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:23.235385 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b93e38-fc46-42b7-a1a1-33e0491aa207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:23.237104 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b93e38-fc46-42b7-a1a1-33e0491aa207 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:23.254472 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 369/743] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:23.260034 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bae69-cc0f-415b-88ce-02a664f7d6d6 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:23.274623 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bae69-cc0f-415b-88ce-02a664f7d6d6 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:23.284962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf875eb7-e026-4f9d-a394-680c130450b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:23.285962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf875eb7-e026-4f9d-a394-680c130450b7 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:23.286381 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf875eb7-e026-4f9d-a394-680c130450b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:23.286797 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf875eb7-e026-4f9d-a394-680c130450b7 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:23.305947 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf875eb7-e026-4f9d-a394-680c130450b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:23.308137 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf875eb7-e026-4f9d-a394-680c130450b7 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:23.328702 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-bf875eb7-e026-4f9d-a394-680c130450b7 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 10 17:38:23.330508 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 375/744] 10.222.0.31 () {56 vars in 1138 bytes} [Mon Jan 10 17:38:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:23.335918 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b93e38-fc46-42b7-a1a1-33e0491aa207 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:23.353727 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b93e38-fc46-42b7-a1a1-33e0491aa207 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:23.366063 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4e679-69a1-4c28-b918-14ec6ef9c940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:23.366672 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4e679-69a1-4c28-b918-14ec6ef9c940 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:23.366948 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4e679-69a1-4c28-b918-14ec6ef9c940 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:23.367217 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4e679-69a1-4c28-b918-14ec6ef9c940 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:23.368068 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4e679-69a1-4c28-b918-14ec6ef9c940 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:23.368368 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4e679-69a1-4c28-b918-14ec6ef9c940 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:23.370246 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4e679-69a1-4c28-b918-14ec6ef9c940 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:23.394559 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 370/745] 10.222.0.31 () {56 vars in 1170 bytes} [Mon Jan 10 17:38:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:23.400630 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf875eb7-e026-4f9d-a394-680c130450b7 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:23.410615 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf875eb7-e026-4f9d-a394-680c130450b7 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:23.420911 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322f62c-b350-44a9-b11b-c27c6e4e33ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:23.421736 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322f62c-b350-44a9-b11b-c27c6e4e33ce admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:23.422158 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322f62c-b350-44a9-b11b-c27c6e4e33ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:23.422568 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322f62c-b350-44a9-b11b-c27c6e4e33ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:23.436461 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322f62c-b350-44a9-b11b-c27c6e4e33ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:23.438477 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322f62c-b350-44a9-b11b-c27c6e4e33ce admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:23.450000 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 376/746] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:23 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:38:23.455673 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4e679-69a1-4c28-b918-14ec6ef9c940 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:23.465774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4e679-69a1-4c28-b918-14ec6ef9c940 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:23.477784 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909008c2-635a-4438-9f37-aff0daf48b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:23.478915 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909008c2-635a-4438-9f37-aff0daf48b5c admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:23.479343 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909008c2-635a-4438-9f37-aff0daf48b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:23.479771 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909008c2-635a-4438-9f37-aff0daf48b5c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:23.492840 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909008c2-635a-4438-9f37-aff0daf48b5c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:23.495158 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909008c2-635a-4438-9f37-aff0daf48b5c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:23.519563 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-909008c2-635a-4438-9f37-aff0daf48b5c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:23.521056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 371/747] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:23.527190 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322f62c-b350-44a9-b11b-c27c6e4e33ce admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:23.539103 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322f62c-b350-44a9-b11b-c27c6e4e33ce admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:23.543895 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6333cdb-4179-40be-8128-6c444f13c0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:23.544714 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6333cdb-4179-40be-8128-6c444f13c0ae admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:23.545176 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6333cdb-4179-40be-8128-6c444f13c0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:23.545592 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6333cdb-4179-40be-8128-6c444f13c0ae admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:23.546462 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6333cdb-4179-40be-8128-6c444f13c0ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:23.546924 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6333cdb-4179-40be-8128-6c444f13c0ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:23.548644 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6333cdb-4179-40be-8128-6c444f13c0ae admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:23.563203 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 377/748] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:23.568807 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909008c2-635a-4438-9f37-aff0daf48b5c admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:23.578856 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909008c2-635a-4438-9f37-aff0daf48b5c admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:23.589016 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337b196-1235-4ee7-a24a-1d386e3c0fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:23.590004 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337b196-1235-4ee7-a24a-1d386e3c0fde admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:23.590426 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337b196-1235-4ee7-a24a-1d386e3c0fde admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:23.590858 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337b196-1235-4ee7-a24a-1d386e3c0fde admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:23.598494 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337b196-1235-4ee7-a24a-1d386e3c0fde admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:23.600639 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337b196-1235-4ee7-a24a-1d386e3c0fde admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:23.617969 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-4337b196-1235-4ee7-a24a-1d386e3c0fde admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:23.619705 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 372/749] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:23.625263 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6333cdb-4179-40be-8128-6c444f13c0ae admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:23.635195 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6333cdb-4179-40be-8128-6c444f13c0ae admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:23.644950 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b986e87-8237-4210-b48c-0c047e743b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:23.645837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b986e87-8237-4210-b48c-0c047e743b69 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:23.646285 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b986e87-8237-4210-b48c-0c047e743b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:23.646699 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b986e87-8237-4210-b48c-0c047e743b69 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:23.647642 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b986e87-8237-4210-b48c-0c047e743b69 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:23.648464 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b986e87-8237-4210-b48c-0c047e743b69 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:23.650497 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b986e87-8237-4210-b48c-0c047e743b69 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:23.671199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 378/750] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:23.677340 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337b196-1235-4ee7-a24a-1d386e3c0fde admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:23.688141 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337b196-1235-4ee7-a24a-1d386e3c0fde admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:23.699445 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460eca2c-d978-42a4-bbae-003495117d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:23.700345 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460eca2c-d978-42a4-bbae-003495117d8f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:23.700841 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460eca2c-d978-42a4-bbae-003495117d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:23.701346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460eca2c-d978-42a4-bbae-003495117d8f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:23.702393 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460eca2c-d978-42a4-bbae-003495117d8f admin admin] RBAC: Adding query filter params (role.id=67bb9b9aab104609b23a2ab5e7d31142, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=3b3dbe4735a54de1825abc28ecf00b84) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:23.702904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460eca2c-d978-42a4-bbae-003495117d8f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:23.704953 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460eca2c-d978-42a4-bbae-003495117d8f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:23.711361 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 373/751] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:38:23 2022] GET /identity/v3/role_assignments?user.id=3b3dbe4735a54de1825abc28ecf00b84&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=67bb9b9aab104609b23a2ab5e7d31142 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:23.973178 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9c6e4-dcad-4136-acba-a6b93fc2ecbb None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:23.974268 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9c6e4-dcad-4136-acba-a6b93fc2ecbb None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:23.974752 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9c6e4-dcad-4136-acba-a6b93fc2ecbb None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:23.977186 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 379/752] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:23.983475 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2540c-9fdf-4337-8216-86a8c72d5bf6 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:23.983985 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2540c-9fdf-4337-8216-86a8c72d5bf6 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:23.984086 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2540c-9fdf-4337-8216-86a8c72d5bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:24.009979 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-8be2540c-9fdf-4337-8216-86a8c72d5bf6 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:24.011208 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-8be2540c-9fdf-4337-8216-86a8c72d5bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:24.026202 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 374/753] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:23 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:24.069497 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9c6e4-dcad-4136-acba-a6b93fc2ecbb None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:24.084917 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9c6e4-dcad-4136-acba-a6b93fc2ecbb None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:24.089660 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdcca6-2612-4c99-9b9f-1ea29765ff37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:24.090459 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdcca6-2612-4c99-9b9f-1ea29765ff37 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:24.090730 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdcca6-2612-4c99-9b9f-1ea29765ff37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:24.091000 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdcca6-2612-4c99-9b9f-1ea29765ff37 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:24.103676 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcdcca6-2612-4c99-9b9f-1ea29765ff37 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:24.110369 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-7fcdcca6-2612-4c99-9b9f-1ea29765ff37 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:38:24.111825 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 380/754] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:38:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:24.117579 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2540c-9fdf-4337-8216-86a8c72d5bf6 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:24.126702 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2540c-9fdf-4337-8216-86a8c72d5bf6 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:24.131698 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a23859-4957-4c57-8944-bf07b55d38f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:24.132361 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a23859-4957-4c57-8944-bf07b55d38f1 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:24.132639 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a23859-4957-4c57-8944-bf07b55d38f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:24.132933 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a23859-4957-4c57-8944-bf07b55d38f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:24.133698 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a23859-4957-4c57-8944-bf07b55d38f1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:24.133997 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a23859-4957-4c57-8944-bf07b55d38f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:24.135605 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a23859-4957-4c57-8944-bf07b55d38f1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:24.151561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 375/755] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:38:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:24.157012 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdcca6-2612-4c99-9b9f-1ea29765ff37 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:24.173824 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdcca6-2612-4c99-9b9f-1ea29765ff37 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:24.186024 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9381e-4bf6-4db4-932d-3acb058ff71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:24.186822 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9381e-4bf6-4db4-932d-3acb058ff71a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:24.187105 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9381e-4bf6-4db4-932d-3acb058ff71a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:24.187377 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9381e-4bf6-4db4-932d-3acb058ff71a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:24.208919 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9381e-4bf6-4db4-932d-3acb058ff71a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:24.210816 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9381e-4bf6-4db4-932d-3acb058ff71a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:24.234447 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-f7c9381e-4bf6-4db4-932d-3acb058ff71a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:24.235910 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 381/756] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:24.241322 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a23859-4957-4c57-8944-bf07b55d38f1 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:24.263189 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a23859-4957-4c57-8944-bf07b55d38f1 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:24.272965 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ad0f9-36af-4936-ade0-66efe371d4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:24.273965 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ad0f9-36af-4936-ade0-66efe371d4ef admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:24.274245 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ad0f9-36af-4936-ade0-66efe371d4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:24.274517 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ad0f9-36af-4936-ade0-66efe371d4ef admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:24.275247 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ad0f9-36af-4936-ade0-66efe371d4ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:24.275552 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ad0f9-36af-4936-ade0-66efe371d4ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:24.277171 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ad0f9-36af-4936-ade0-66efe371d4ef admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:24.294380 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 376/757] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:24.299579 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9381e-4bf6-4db4-932d-3acb058ff71a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:24.311069 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9381e-4bf6-4db4-932d-3acb058ff71a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:24.318620 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02e046-c3b1-4db7-9921-7cadcf4b8abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:24.319463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02e046-c3b1-4db7-9921-7cadcf4b8abe admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:24.319758 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02e046-c3b1-4db7-9921-7cadcf4b8abe admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:24.320035 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02e046-c3b1-4db7-9921-7cadcf4b8abe admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:24.337173 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02e046-c3b1-4db7-9921-7cadcf4b8abe admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:24.339302 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02e046-c3b1-4db7-9921-7cadcf4b8abe admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:24.355419 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-5c02e046-c3b1-4db7-9921-7cadcf4b8abe admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 10 17:38:24.357044 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 382/758] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:38:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:24.362319 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ad0f9-36af-4936-ade0-66efe371d4ef admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:24.381850 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ad0f9-36af-4936-ade0-66efe371d4ef admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:24.394089 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e4649-87d4-48fa-a7f2-ff8e2dfae538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:24.394770 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e4649-87d4-48fa-a7f2-ff8e2dfae538 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:24.395046 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e4649-87d4-48fa-a7f2-ff8e2dfae538 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:24.395319 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e4649-87d4-48fa-a7f2-ff8e2dfae538 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:24.396177 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e4649-87d4-48fa-a7f2-ff8e2dfae538 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:24.396474 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e4649-87d4-48fa-a7f2-ff8e2dfae538 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:24.398712 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e4649-87d4-48fa-a7f2-ff8e2dfae538 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:24.424679 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 377/759] 10.222.0.31 () {56 vars in 1156 bytes} [Mon Jan 10 17:38:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:24.429920 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02e046-c3b1-4db7-9921-7cadcf4b8abe admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:24.442486 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02e046-c3b1-4db7-9921-7cadcf4b8abe admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:24.452495 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbf61b-3273-4f28-999b-87235943c87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:24.453218 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbf61b-3273-4f28-999b-87235943c87a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:24.453503 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbf61b-3273-4f28-999b-87235943c87a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:24.453777 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbf61b-3273-4f28-999b-87235943c87a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:24.462568 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccbf61b-3273-4f28-999b-87235943c87a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:24.464471 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccbf61b-3273-4f28-999b-87235943c87a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:24.479675 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 383/760] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:24 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:38:24.485460 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e4649-87d4-48fa-a7f2-ff8e2dfae538 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:24.501666 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e4649-87d4-48fa-a7f2-ff8e2dfae538 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:24.508793 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1858dc9-c810-4f09-94e1-a76f9bde0638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:24.509612 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1858dc9-c810-4f09-94e1-a76f9bde0638 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:24.509890 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1858dc9-c810-4f09-94e1-a76f9bde0638 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:24.510160 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1858dc9-c810-4f09-94e1-a76f9bde0638 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:24.532483 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1858dc9-c810-4f09-94e1-a76f9bde0638 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:24.535773 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1858dc9-c810-4f09-94e1-a76f9bde0638 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:24.555818 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-f1858dc9-c810-4f09-94e1-a76f9bde0638 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:24.557882 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 378/761] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:24.563209 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbf61b-3273-4f28-999b-87235943c87a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:24.577048 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbf61b-3273-4f28-999b-87235943c87a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:24.584476 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df10865-e491-4451-b925-39bd061f7e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:24.585187 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df10865-e491-4451-b925-39bd061f7e90 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:24.585481 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df10865-e491-4451-b925-39bd061f7e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:24.585756 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df10865-e491-4451-b925-39bd061f7e90 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:24.586508 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df10865-e491-4451-b925-39bd061f7e90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:24.586815 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df10865-e491-4451-b925-39bd061f7e90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:24.588511 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df10865-e491-4451-b925-39bd061f7e90 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:24.607357 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 384/762] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:24.612545 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1858dc9-c810-4f09-94e1-a76f9bde0638 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:24.622584 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1858dc9-c810-4f09-94e1-a76f9bde0638 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:24.632957 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420e1fb-ebab-48fa-9f84-cf72f2ecce3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:24.633974 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420e1fb-ebab-48fa-9f84-cf72f2ecce3f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:24.634464 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420e1fb-ebab-48fa-9f84-cf72f2ecce3f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:24.634938 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420e1fb-ebab-48fa-9f84-cf72f2ecce3f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:24.647561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420e1fb-ebab-48fa-9f84-cf72f2ecce3f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:24.650127 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420e1fb-ebab-48fa-9f84-cf72f2ecce3f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:24.669602 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-b420e1fb-ebab-48fa-9f84-cf72f2ecce3f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:24.671279 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 379/763] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:24.676759 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df10865-e491-4451-b925-39bd061f7e90 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:24.690228 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df10865-e491-4451-b925-39bd061f7e90 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:24.697246 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7452115-2a96-46a9-945a-7c0e78f035ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:24.698436 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7452115-2a96-46a9-945a-7c0e78f035ca admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:24.698905 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7452115-2a96-46a9-945a-7c0e78f035ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:24.699393 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7452115-2a96-46a9-945a-7c0e78f035ca admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:24.700783 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7452115-2a96-46a9-945a-7c0e78f035ca admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:24.701212 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7452115-2a96-46a9-945a-7c0e78f035ca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:24.703194 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7452115-2a96-46a9-945a-7c0e78f035ca admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:24.752880 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 385/764] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:24.774356 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420e1fb-ebab-48fa-9f84-cf72f2ecce3f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:24.793630 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420e1fb-ebab-48fa-9f84-cf72f2ecce3f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:24.817528 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10609778-7471-4dd8-b8b7-d4bfc15c3ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:24.818507 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10609778-7471-4dd8-b8b7-d4bfc15c3ace admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:24.818982 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10609778-7471-4dd8-b8b7-d4bfc15c3ace admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:24.819441 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10609778-7471-4dd8-b8b7-d4bfc15c3ace admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:24.820504 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10609778-7471-4dd8-b8b7-d4bfc15c3ace admin admin] RBAC: Adding query filter params (role.id=3c05bedf79e04eb38d2ae66736030bfe, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=0257a86ce85b4b4386cde32c8ed4b39a) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:24.821079 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10609778-7471-4dd8-b8b7-d4bfc15c3ace admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:24.823122 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10609778-7471-4dd8-b8b7-d4bfc15c3ace admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:24.837541 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 380/765] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:38:24 2022] GET /identity/v3/role_assignments?user.id=0257a86ce85b4b4386cde32c8ed4b39a&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=3c05bedf79e04eb38d2ae66736030bfe => generated 259 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:25.123350 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d27e6-f512-4c33-be0d-319ace94f1cd None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:25.123870 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d27e6-f512-4c33-be0d-319ace94f1cd None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:25.123870 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d27e6-f512-4c33-be0d-319ace94f1cd None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:25.125847 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 386/766] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:25.131807 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ec1e8-f991-4eb2-ad39-89aca8347b32 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:25.132307 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ec1e8-f991-4eb2-ad39-89aca8347b32 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:25.132409 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ec1e8-f991-4eb2-ad39-89aca8347b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:25.165947 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-988ec1e8-f991-4eb2-ad39-89aca8347b32 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:25.167185 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-988ec1e8-f991-4eb2-ad39-89aca8347b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:25.179444 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 381/767] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:25 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:25.256881 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d27e6-f512-4c33-be0d-319ace94f1cd None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:25.272050 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d27e6-f512-4c33-be0d-319ace94f1cd None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:25.277546 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f9d42-8cc1-437e-9a09-0a0ac6cd1e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:25.278401 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f9d42-8cc1-437e-9a09-0a0ac6cd1e23 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:25.278698 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f9d42-8cc1-437e-9a09-0a0ac6cd1e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:25.278973 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f9d42-8cc1-437e-9a09-0a0ac6cd1e23 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:25.279663 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f9d42-8cc1-437e-9a09-0a0ac6cd1e23 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:25.289419 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f9d42-8cc1-437e-9a09-0a0ac6cd1e23 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:25.308625 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-e88f9d42-8cc1-437e-9a09-0a0ac6cd1e23 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 10 17:38:25.310492 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 387/768] 10.222.0.31 () {56 vars in 1150 bytes} [Mon Jan 10 17:38:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:25.316571 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ec1e8-f991-4eb2-ad39-89aca8347b32 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:25.331058 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ec1e8-f991-4eb2-ad39-89aca8347b32 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:25.343766 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af8af7-7ad7-4127-9d43-42b3a82b794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:25.344441 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af8af7-7ad7-4127-9d43-42b3a82b794d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:25.344722 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af8af7-7ad7-4127-9d43-42b3a82b794d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:25.345027 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af8af7-7ad7-4127-9d43-42b3a82b794d admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:25.345821 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af8af7-7ad7-4127-9d43-42b3a82b794d admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:25.346161 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af8af7-7ad7-4127-9d43-42b3a82b794d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:25.347773 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af8af7-7ad7-4127-9d43-42b3a82b794d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:25.358213 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 382/769] 10.222.0.31 () {56 vars in 1145 bytes} [Mon Jan 10 17:38:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:25.364467 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f9d42-8cc1-437e-9a09-0a0ac6cd1e23 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:25.380906 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f9d42-8cc1-437e-9a09-0a0ac6cd1e23 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:25.400648 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa206851-b621-4109-865f-adae26174160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:25.401375 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa206851-b621-4109-865f-adae26174160 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:25.401661 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa206851-b621-4109-865f-adae26174160 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:25.401936 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa206851-b621-4109-865f-adae26174160 admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:25.402676 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa206851-b621-4109-865f-adae26174160 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:25.402986 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa206851-b621-4109-865f-adae26174160 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:25.404607 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa206851-b621-4109-865f-adae26174160 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:25.418134 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 388/770] 10.222.0.31 () {56 vars in 1145 bytes} [Mon Jan 10 17:38:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:25.423865 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af8af7-7ad7-4127-9d43-42b3a82b794d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:25.442591 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af8af7-7ad7-4127-9d43-42b3a82b794d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:25.453347 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19b0eb-ecac-41d1-8008-dc263290d307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:25.454022 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19b0eb-ecac-41d1-8008-dc263290d307 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:25.454305 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19b0eb-ecac-41d1-8008-dc263290d307 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:25.454579 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19b0eb-ecac-41d1-8008-dc263290d307 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:25.455479 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19b0eb-ecac-41d1-8008-dc263290d307 admin admin] RBAC: Adding query filter params (interface=public, service_id=ad2ec1ca4740473e99e1b66e515510ea, region_id=RegionOne) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:25.455784 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19b0eb-ecac-41d1-8008-dc263290d307 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:25.456816 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING py.warnings [None req-4f19b0eb-ecac-41d1-8008-dc263290d307 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:38:25.456816 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: warnings.warn(msg) Jan 10 17:38:25.456816 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: Jan 10 17:38:25.457718 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19b0eb-ecac-41d1-8008-dc263290d307 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:25.471158 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 383/771] 10.222.0.31 () {56 vars in 1272 bytes} [Mon Jan 10 17:38:25 2022] GET /identity/v3/endpoints?service_id=ad2ec1ca4740473e99e1b66e515510ea&interface=public®ion_id=RegionOne => generated 194 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:25.476554 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa206851-b621-4109-865f-adae26174160 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:25.490013 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa206851-b621-4109-865f-adae26174160 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:25.500729 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13668e06-5878-4ba7-9273-8580cf09ca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:25.501454 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13668e06-5878-4ba7-9273-8580cf09ca2a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:25.501723 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13668e06-5878-4ba7-9273-8580cf09ca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:25.502037 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13668e06-5878-4ba7-9273-8580cf09ca2a admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:25.502746 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13668e06-5878-4ba7-9273-8580cf09ca2a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:25.504358 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13668e06-5878-4ba7-9273-8580cf09ca2a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:25.510264 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 389/772] 10.222.0.31 () {56 vars in 1108 bytes} [Mon Jan 10 17:38:25 2022] GET /identity/v3/services => generated 772 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:25.728776 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca10fe-07c4-4091-80f1-736cd98a3d52 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:25.729155 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca10fe-07c4-4091-80f1-736cd98a3d52 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:25.729324 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca10fe-07c4-4091-80f1-736cd98a3d52 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:25.731422 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 384/773] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:25.737156 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08187e8b-3633-420a-9901-d6cb770fd090 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:25.737448 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08187e8b-3633-420a-9901-d6cb770fd090 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:25.737728 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08187e8b-3633-420a-9901-d6cb770fd090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:25.756353 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-08187e8b-3633-420a-9901-d6cb770fd090 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:25.762673 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-08187e8b-3633-420a-9901-d6cb770fd090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:25.769642 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc93547-7ea3-4fda-bae0-2afe38a20c6d None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:25.770415 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc93547-7ea3-4fda-bae0-2afe38a20c6d None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:25.770415 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc93547-7ea3-4fda-bae0-2afe38a20c6d None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:25.772616 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 390/774] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:25 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:25.772772 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 385/775] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:38:25.780432 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667c000-22e3-455c-ae24-d178fa46e70f None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:25.780721 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667c000-22e3-455c-ae24-d178fa46e70f None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:25.781106 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667c000-22e3-455c-ae24-d178fa46e70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:25.797249 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc93547-7ea3-4fda-bae0-2afe38a20c6d None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:25.800712 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-f667c000-22e3-455c-ae24-d178fa46e70f None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:25.802075 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-f667c000-22e3-455c-ae24-d178fa46e70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:25.810085 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 391/776] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:25 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:25.814683 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc93547-7ea3-4fda-bae0-2afe38a20c6d None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:25.819080 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf2200-3785-4624-a2af-4237c94cd64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:25.819866 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf2200-3785-4624-a2af-4237c94cd64f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:25.820147 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf2200-3785-4624-a2af-4237c94cd64f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:25.820421 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf2200-3785-4624-a2af-4237c94cd64f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:25.832962 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf2200-3785-4624-a2af-4237c94cd64f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:25.836206 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667c000-22e3-455c-ae24-d178fa46e70f None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:25.839960 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-8adf2200-3785-4624-a2af-4237c94cd64f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:38:25.841457 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 386/777] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:38:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:25.846646 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667c000-22e3-455c-ae24-d178fa46e70f None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:25.847252 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf2200-3785-4624-a2af-4237c94cd64f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:25.851691 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f260a0-5ca7-4538-a561-df264419663c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:25.852506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f260a0-5ca7-4538-a561-df264419663c admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:25.852788 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f260a0-5ca7-4538-a561-df264419663c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:25.853088 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f260a0-5ca7-4538-a561-df264419663c admin admin] PATH_INFO: `/v3/services/network` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:25.853772 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f260a0-5ca7-4538-a561-df264419663c admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:25.855399 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f260a0-5ca7-4538-a561-df264419663c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:25.857456 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf2200-3785-4624-a2af-4237c94cd64f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:25.862662 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19977647-7dc7-4924-9d13-2edd4842c745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:25.863322 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19977647-7dc7-4924-9d13-2edd4842c745 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:25.863604 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19977647-7dc7-4924-9d13-2edd4842c745 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:25.863928 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19977647-7dc7-4924-9d13-2edd4842c745 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:25.864697 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19977647-7dc7-4924-9d13-2edd4842c745 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:25.865069 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19977647-7dc7-4924-9d13-2edd4842c745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:25.866724 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19977647-7dc7-4924-9d13-2edd4842c745 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:25.867590 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-94f260a0-5ca7-4538-a561-df264419663c admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 10 17:38:25.873153 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 392/778] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:25 2022] GET /identity/v3/services/network => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:25.874772 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f260a0-5ca7-4538-a561-df264419663c admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:25.876146 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 387/779] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:38:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:25.881614 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19977647-7dc7-4924-9d13-2edd4842c745 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:25.885111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f260a0-5ca7-4538-a561-df264419663c admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:25.889550 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3faef0-1893-42e7-8110-0860568a31ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:25.890225 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3faef0-1893-42e7-8110-0860568a31ed admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:25.890506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3faef0-1893-42e7-8110-0860568a31ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:25.890775 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3faef0-1893-42e7-8110-0860568a31ed admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:25.891504 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3faef0-1893-42e7-8110-0860568a31ed admin admin] RBAC: Adding query filter params (name=network) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:25.891814 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3faef0-1893-42e7-8110-0860568a31ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:25.893912 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3faef0-1893-42e7-8110-0860568a31ed admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:25.894376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19977647-7dc7-4924-9d13-2edd4842c745 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:25.899524 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660d061-bc40-4570-af18-9f092604c6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:25.900217 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 393/780] 10.222.0.31 () {56 vars in 1133 bytes} [Mon Jan 10 17:38:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:25.900787 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660d061-bc40-4570-af18-9f092604c6fd admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:25.901322 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660d061-bc40-4570-af18-9f092604c6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:25.901793 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660d061-bc40-4570-af18-9f092604c6fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:25.906043 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3faef0-1893-42e7-8110-0860568a31ed admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:25.917419 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660d061-bc40-4570-af18-9f092604c6fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:25.919133 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3faef0-1893-42e7-8110-0860568a31ed admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:25.919801 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660d061-bc40-4570-af18-9f092604c6fd admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:25.925024 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3890f68-40d5-41a7-ac34-2bdc8112c3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:25.925694 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3890f68-40d5-41a7-ac34-2bdc8112c3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:25.925977 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3890f68-40d5-41a7-ac34-2bdc8112c3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:25.926256 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3890f68-40d5-41a7-ac34-2bdc8112c3f7 admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:25.926984 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3890f68-40d5-41a7-ac34-2bdc8112c3f7 admin admin] RBAC: Adding query filter params (type=network) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:25.927299 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3890f68-40d5-41a7-ac34-2bdc8112c3f7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:25.928933 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3890f68-40d5-41a7-ac34-2bdc8112c3f7 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:25.935643 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 394/781] 10.222.0.31 () {56 vars in 1133 bytes} [Mon Jan 10 17:38:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:25.940949 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-1660d061-bc40-4570-af18-9f092604c6fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:25.941337 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3890f68-40d5-41a7-ac34-2bdc8112c3f7 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:25.942852 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 388/782] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:25.948468 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660d061-bc40-4570-af18-9f092604c6fd admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:25.951127 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3890f68-40d5-41a7-ac34-2bdc8112c3f7 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:25.956265 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a42e9-e483-494c-8b97-e976d0f85c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:25.957221 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a42e9-e483-494c-8b97-e976d0f85c5d admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:25.957507 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a42e9-e483-494c-8b97-e976d0f85c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:25.957780 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a42e9-e483-494c-8b97-e976d0f85c5d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:25.958590 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a42e9-e483-494c-8b97-e976d0f85c5d admin admin] RBAC: Adding query filter params (interface=public, service_id=f1d4f0db35c047b5885aa407df22bad2, region_id=RegionOne) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:25.958903 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a42e9-e483-494c-8b97-e976d0f85c5d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:25.959931 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING py.warnings [None req-bc1a42e9-e483-494c-8b97-e976d0f85c5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:38:25.959931 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: warnings.warn(msg) Jan 10 17:38:25.959931 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: Jan 10 17:38:25.960378 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660d061-bc40-4570-af18-9f092604c6fd admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:25.960806 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a42e9-e483-494c-8b97-e976d0f85c5d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:25.965361 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c4f1c-4905-46c8-ab9a-26c8a34be7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:25.966314 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c4f1c-4905-46c8-ab9a-26c8a34be7aa admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:25.966764 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c4f1c-4905-46c8-ab9a-26c8a34be7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:25.967267 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c4f1c-4905-46c8-ab9a-26c8a34be7aa admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:25.968167 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c4f1c-4905-46c8-ab9a-26c8a34be7aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:25.968683 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c4f1c-4905-46c8-ab9a-26c8a34be7aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:25.969702 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 395/783] 10.222.0.31 () {56 vars in 1272 bytes} [Mon Jan 10 17:38:25 2022] GET /identity/v3/endpoints?service_id=f1d4f0db35c047b5885aa407df22bad2&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:25.971075 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c4f1c-4905-46c8-ab9a-26c8a34be7aa admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:25.975552 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a42e9-e483-494c-8b97-e976d0f85c5d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:25.989030 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a42e9-e483-494c-8b97-e976d0f85c5d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:25.989453 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 389/784] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:25.990907 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c4f1c-4905-46c8-ab9a-26c8a34be7aa admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:25.991136 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d677f3e-cf22-4f5c-9bbc-3ab8df62b99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:25.991890 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d677f3e-cf22-4f5c-9bbc-3ab8df62b99e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:25.992198 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d677f3e-cf22-4f5c-9bbc-3ab8df62b99e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:25.992456 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d677f3e-cf22-4f5c-9bbc-3ab8df62b99e admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:25.993186 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d677f3e-cf22-4f5c-9bbc-3ab8df62b99e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:25.994788 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d677f3e-cf22-4f5c-9bbc-3ab8df62b99e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:26.001680 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 396/785] 10.222.0.31 () {56 vars in 1108 bytes} [Mon Jan 10 17:38:25 2022] GET /identity/v3/services => generated 772 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:26.002109 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c4f1c-4905-46c8-ab9a-26c8a34be7aa admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:26.009371 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e438fa6-343a-461c-9ef9-a91061198ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:26.010584 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e438fa6-343a-461c-9ef9-a91061198ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:26.011052 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e438fa6-343a-461c-9ef9-a91061198ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:26.011550 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e438fa6-343a-461c-9ef9-a91061198ee9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:26.020525 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e438fa6-343a-461c-9ef9-a91061198ee9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:26.023399 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e438fa6-343a-461c-9ef9-a91061198ee9 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:26.039135 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-2e438fa6-343a-461c-9ef9-a91061198ee9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 17:38:26.041151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 390/786] 10.222.0.31 () {56 vars in 1114 bytes} [Mon Jan 10 17:38:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:26.047047 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d677f3e-cf22-4f5c-9bbc-3ab8df62b99e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:26.057658 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d677f3e-cf22-4f5c-9bbc-3ab8df62b99e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:26.062614 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f67f4-06a9-4e4c-9b60-2f3000b85df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:26.063592 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f67f4-06a9-4e4c-9b60-2f3000b85df7 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:26.064093 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f67f4-06a9-4e4c-9b60-2f3000b85df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:26.064603 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f67f4-06a9-4e4c-9b60-2f3000b85df7 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:26.065739 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f67f4-06a9-4e4c-9b60-2f3000b85df7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:26.066239 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f67f4-06a9-4e4c-9b60-2f3000b85df7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:26.068460 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f67f4-06a9-4e4c-9b60-2f3000b85df7 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:26.087723 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 397/787] 10.222.0.31 () {56 vars in 1154 bytes} [Mon Jan 10 17:38:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:26.093864 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e438fa6-343a-461c-9ef9-a91061198ee9 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:26.107038 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e438fa6-343a-461c-9ef9-a91061198ee9 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:26.113583 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81715134-4a5d-4c40-ad2f-da543201b185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:26.114707 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81715134-4a5d-4c40-ad2f-da543201b185 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:26.115208 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81715134-4a5d-4c40-ad2f-da543201b185 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:26.115697 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81715134-4a5d-4c40-ad2f-da543201b185 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:26.129333 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81715134-4a5d-4c40-ad2f-da543201b185 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:26.131484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81715134-4a5d-4c40-ad2f-da543201b185 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:26.144170 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 391/788] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:26 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:38:26.151263 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f67f4-06a9-4e4c-9b60-2f3000b85df7 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:26.163429 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f67f4-06a9-4e4c-9b60-2f3000b85df7 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:26.173606 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a24e76-d071-403d-91dd-9365b4dc9cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:26.174519 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a24e76-d071-403d-91dd-9365b4dc9cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:26.174808 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a24e76-d071-403d-91dd-9365b4dc9cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:26.175084 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a24e76-d071-403d-91dd-9365b4dc9cf0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:26.186971 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a24e76-d071-403d-91dd-9365b4dc9cf0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:26.188866 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a24e76-d071-403d-91dd-9365b4dc9cf0 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:26.219843 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-04a24e76-d071-403d-91dd-9365b4dc9cf0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:26.221187 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 398/789] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:26.226820 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81715134-4a5d-4c40-ad2f-da543201b185 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:26.242122 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81715134-4a5d-4c40-ad2f-da543201b185 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:26.250893 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62555622-c67f-43a7-a594-bcc366ae9d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:26.251864 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62555622-c67f-43a7-a594-bcc366ae9d0a admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:26.252371 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62555622-c67f-43a7-a594-bcc366ae9d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:26.252814 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62555622-c67f-43a7-a594-bcc366ae9d0a admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:26.253785 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62555622-c67f-43a7-a594-bcc366ae9d0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:26.254261 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62555622-c67f-43a7-a594-bcc366ae9d0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:26.256117 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62555622-c67f-43a7-a594-bcc366ae9d0a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:26.269766 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 392/790] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:26.275865 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a24e76-d071-403d-91dd-9365b4dc9cf0 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:26.290289 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a24e76-d071-403d-91dd-9365b4dc9cf0 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:26.297225 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e2f15-398a-4a80-a98f-3f4f792bf79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:26.298053 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e2f15-398a-4a80-a98f-3f4f792bf79f admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:26.298341 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e2f15-398a-4a80-a98f-3f4f792bf79f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:26.298644 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e2f15-398a-4a80-a98f-3f4f792bf79f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:26.309043 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e2f15-398a-4a80-a98f-3f4f792bf79f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:26.311066 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e2f15-398a-4a80-a98f-3f4f792bf79f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:26.330836 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-8a2e2f15-398a-4a80-a98f-3f4f792bf79f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:26.332455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 399/791] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:26.338185 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62555622-c67f-43a7-a594-bcc366ae9d0a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:26.350912 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62555622-c67f-43a7-a594-bcc366ae9d0a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:26.355637 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7653d-5687-49f0-9ad0-c10201b5c8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:26.356516 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7653d-5687-49f0-9ad0-c10201b5c8fc admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:26.357031 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7653d-5687-49f0-9ad0-c10201b5c8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:26.357446 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7653d-5687-49f0-9ad0-c10201b5c8fc admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:26.358376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7653d-5687-49f0-9ad0-c10201b5c8fc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:26.358820 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7653d-5687-49f0-9ad0-c10201b5c8fc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:26.362270 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7653d-5687-49f0-9ad0-c10201b5c8fc admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:26.375246 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 393/792] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:26.381354 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e2f15-398a-4a80-a98f-3f4f792bf79f admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:26.391907 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e2f15-398a-4a80-a98f-3f4f792bf79f admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:26.396590 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc6350-8f8b-4923-a0b6-c682bfefdeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:26.397422 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc6350-8f8b-4923-a0b6-c682bfefdeb2 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:26.397828 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc6350-8f8b-4923-a0b6-c682bfefdeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:26.398574 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc6350-8f8b-4923-a0b6-c682bfefdeb2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:26.399515 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc6350-8f8b-4923-a0b6-c682bfefdeb2 admin admin] RBAC: Adding query filter params (role.id=3c05bedf79e04eb38d2ae66736030bfe, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=877acd6448214ef893d119e3b1043402) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:26.399972 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc6350-8f8b-4923-a0b6-c682bfefdeb2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:26.402075 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc6350-8f8b-4923-a0b6-c682bfefdeb2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:26.408946 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 400/793] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:38:26 2022] GET /identity/v3/role_assignments?user.id=877acd6448214ef893d119e3b1043402&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=3c05bedf79e04eb38d2ae66736030bfe => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:26.964441 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c1b09-558c-45d6-9266-71e0942962f9 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:26.964804 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c1b09-558c-45d6-9266-71e0942962f9 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:26.965029 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c1b09-558c-45d6-9266-71e0942962f9 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:26.967058 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 394/794] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:26.972114 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3e373-ea51-4aac-bb77-16fba9a4b0b4 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:26.972405 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3e373-ea51-4aac-bb77-16fba9a4b0b4 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:26.972683 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3e373-ea51-4aac-bb77-16fba9a4b0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:26.994096 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-14a3e373-ea51-4aac-bb77-16fba9a4b0b4 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:26.995230 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-14a3e373-ea51-4aac-bb77-16fba9a4b0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:27.011206 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 401/795] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:26 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:27.040210 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c1b09-558c-45d6-9266-71e0942962f9 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:27.058765 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c1b09-558c-45d6-9266-71e0942962f9 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:27.063317 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee58322-5f72-490b-9896-0438910a9b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:27.064412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee58322-5f72-490b-9896-0438910a9b33 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:27.064989 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee58322-5f72-490b-9896-0438910a9b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:27.065467 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee58322-5f72-490b-9896-0438910a9b33 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:27.082079 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee58322-5f72-490b-9896-0438910a9b33 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:27.089345 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-1ee58322-5f72-490b-9896-0438910a9b33 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 17:38:27.091105 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 395/796] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:38:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:27.096663 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3e373-ea51-4aac-bb77-16fba9a4b0b4 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:27.112492 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3e373-ea51-4aac-bb77-16fba9a4b0b4 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:27.123619 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5dabd-d7da-48c6-9d77-77ff4e1c5d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:27.124350 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5dabd-d7da-48c6-9d77-77ff4e1c5d53 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:27.124640 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5dabd-d7da-48c6-9d77-77ff4e1c5d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:27.124943 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5dabd-d7da-48c6-9d77-77ff4e1c5d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:27.125725 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5dabd-d7da-48c6-9d77-77ff4e1c5d53 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:27.126038 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5dabd-d7da-48c6-9d77-77ff4e1c5d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:27.127747 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5dabd-d7da-48c6-9d77-77ff4e1c5d53 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:27.142320 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 402/797] 10.222.0.31 () {56 vars in 1124 bytes} [Mon Jan 10 17:38:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:27.148411 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee58322-5f72-490b-9896-0438910a9b33 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:27.162065 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee58322-5f72-490b-9896-0438910a9b33 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:27.166821 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b84155-63d4-451f-9a6e-7c157745961e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:27.167859 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b84155-63d4-451f-9a6e-7c157745961e admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:27.168332 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b84155-63d4-451f-9a6e-7c157745961e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:27.168796 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b84155-63d4-451f-9a6e-7c157745961e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:27.184594 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b84155-63d4-451f-9a6e-7c157745961e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:27.186755 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b84155-63d4-451f-9a6e-7c157745961e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:27.208487 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-60b84155-63d4-451f-9a6e-7c157745961e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:27.210064 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 396/798] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:27.215839 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5dabd-d7da-48c6-9d77-77ff4e1c5d53 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:27.229842 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5dabd-d7da-48c6-9d77-77ff4e1c5d53 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:27.234575 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2813d0-3f08-4e45-a9a0-69f1fbfc6b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:27.235485 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2813d0-3f08-4e45-a9a0-69f1fbfc6b77 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:27.235962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2813d0-3f08-4e45-a9a0-69f1fbfc6b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:27.236470 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2813d0-3f08-4e45-a9a0-69f1fbfc6b77 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:27.237432 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2813d0-3f08-4e45-a9a0-69f1fbfc6b77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:27.237947 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2813d0-3f08-4e45-a9a0-69f1fbfc6b77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:27.239762 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2813d0-3f08-4e45-a9a0-69f1fbfc6b77 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:27.256311 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 403/799] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:27.261461 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b84155-63d4-451f-9a6e-7c157745961e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:27.271547 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b84155-63d4-451f-9a6e-7c157745961e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:27.276513 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80036277-a9aa-4d96-8ec3-902ef8e326e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:27.277598 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80036277-a9aa-4d96-8ec3-902ef8e326e2 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:27.278072 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80036277-a9aa-4d96-8ec3-902ef8e326e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:27.278536 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80036277-a9aa-4d96-8ec3-902ef8e326e2 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:27.291283 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80036277-a9aa-4d96-8ec3-902ef8e326e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:27.293653 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80036277-a9aa-4d96-8ec3-902ef8e326e2 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:27.313249 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-80036277-a9aa-4d96-8ec3-902ef8e326e2 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 10 17:38:27.315113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 397/800] 10.222.0.31 () {56 vars in 1138 bytes} [Mon Jan 10 17:38:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:27.320402 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2813d0-3f08-4e45-a9a0-69f1fbfc6b77 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:27.333881 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2813d0-3f08-4e45-a9a0-69f1fbfc6b77 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:27.338641 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d3d08-f1c9-4f35-8bf5-5d87e815e43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:27.339599 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d3d08-f1c9-4f35-8bf5-5d87e815e43c admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:27.340087 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d3d08-f1c9-4f35-8bf5-5d87e815e43c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:27.340566 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d3d08-f1c9-4f35-8bf5-5d87e815e43c admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:27.341654 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d3d08-f1c9-4f35-8bf5-5d87e815e43c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:27.342209 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d3d08-f1c9-4f35-8bf5-5d87e815e43c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:27.344313 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d3d08-f1c9-4f35-8bf5-5d87e815e43c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:27.374486 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 404/801] 10.222.0.31 () {56 vars in 1170 bytes} [Mon Jan 10 17:38:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:27.380491 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80036277-a9aa-4d96-8ec3-902ef8e326e2 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:27.394037 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80036277-a9aa-4d96-8ec3-902ef8e326e2 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:27.399179 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a5e57-e01b-4d05-82dc-43bb0ba85672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:27.400263 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a5e57-e01b-4d05-82dc-43bb0ba85672 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:27.400755 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a5e57-e01b-4d05-82dc-43bb0ba85672 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:27.401248 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a5e57-e01b-4d05-82dc-43bb0ba85672 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:27.418318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a5e57-e01b-4d05-82dc-43bb0ba85672 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:27.420436 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a5e57-e01b-4d05-82dc-43bb0ba85672 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:27.439344 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-269a5e57-e01b-4d05-82dc-43bb0ba85672 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:27.440867 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 398/802] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:27.447307 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d3d08-f1c9-4f35-8bf5-5d87e815e43c admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:27.461948 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d3d08-f1c9-4f35-8bf5-5d87e815e43c admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:27.466718 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6717066-04d1-41c3-8150-f2b4918ecbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:27.467787 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6717066-04d1-41c3-8150-f2b4918ecbc4 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:27.468260 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6717066-04d1-41c3-8150-f2b4918ecbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:27.468732 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6717066-04d1-41c3-8150-f2b4918ecbc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:27.469722 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6717066-04d1-41c3-8150-f2b4918ecbc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:27.470218 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6717066-04d1-41c3-8150-f2b4918ecbc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:27.472190 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6717066-04d1-41c3-8150-f2b4918ecbc4 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:27.492954 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a5e57-e01b-4d05-82dc-43bb0ba85672 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:27.493127 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 405/803] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:27.508916 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a5e57-e01b-4d05-82dc-43bb0ba85672 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:27.513754 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40041d7-d2cb-4f99-9479-36a2a0b47e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:27.514860 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40041d7-d2cb-4f99-9479-36a2a0b47e82 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:27.515380 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40041d7-d2cb-4f99-9479-36a2a0b47e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:27.515840 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40041d7-d2cb-4f99-9479-36a2a0b47e82 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:27.527576 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40041d7-d2cb-4f99-9479-36a2a0b47e82 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:27.529868 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40041d7-d2cb-4f99-9479-36a2a0b47e82 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:27.547493 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-f40041d7-d2cb-4f99-9479-36a2a0b47e82 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:27.548988 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 399/804] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:27.554605 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6717066-04d1-41c3-8150-f2b4918ecbc4 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:27.570687 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6717066-04d1-41c3-8150-f2b4918ecbc4 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:27.585500 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6481b-f131-4601-8dd3-0606d19deb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:27.586190 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6481b-f131-4601-8dd3-0606d19deb9e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:27.586479 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6481b-f131-4601-8dd3-0606d19deb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:27.586758 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6481b-f131-4601-8dd3-0606d19deb9e admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:27.587566 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6481b-f131-4601-8dd3-0606d19deb9e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:27.587881 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6481b-f131-4601-8dd3-0606d19deb9e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:27.589785 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6481b-f131-4601-8dd3-0606d19deb9e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:27.606853 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 406/805] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:27.612764 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40041d7-d2cb-4f99-9479-36a2a0b47e82 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:27.628075 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40041d7-d2cb-4f99-9479-36a2a0b47e82 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:27.632875 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e28ab-1137-4598-84d0-fb698c049f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:27.634048 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e28ab-1137-4598-84d0-fb698c049f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:27.634517 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e28ab-1137-4598-84d0-fb698c049f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:27.635032 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e28ab-1137-4598-84d0-fb698c049f81 admin admin] PATH_INFO: `/v3/projects/1415eea0335a49bf800e8215498af679/users/3b3dbe4735a54de1825abc28ecf00b84/roles/67bb9b9aab104609b23a2ab5e7d31142` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:27.658656 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e28ab-1137-4598-84d0-fb698c049f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1415eea0335a49bf800e8215498af679, user_id=3b3dbe4735a54de1825abc28ecf00b84, role_id=67bb9b9aab104609b23a2ab5e7d31142)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:27.661747 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e28ab-1137-4598-84d0-fb698c049f81 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:27.690231 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 400/806] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:38:27 2022] PUT /identity/v3/projects/1415eea0335a49bf800e8215498af679/users/3b3dbe4735a54de1825abc28ecf00b84/roles/67bb9b9aab104609b23a2ab5e7d31142 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:38:27.808894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16770b-776c-413c-8fbf-269dd007d1a6 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:27.809097 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16770b-776c-413c-8fbf-269dd007d1a6 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:27.809379 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16770b-776c-413c-8fbf-269dd007d1a6 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:27.811588 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 407/807] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:27.818882 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48205000-d208-40f1-9dcd-63acdcf5312b None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:27.819470 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48205000-d208-40f1-9dcd-63acdcf5312b None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:27.819940 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48205000-d208-40f1-9dcd-63acdcf5312b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:27.842456 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-48205000-d208-40f1-9dcd-63acdcf5312b None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:27.844149 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-48205000-d208-40f1-9dcd-63acdcf5312b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:27.925075 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 401/808] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:27 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:27.961326 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16770b-776c-413c-8fbf-269dd007d1a6 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:27.985610 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16770b-776c-413c-8fbf-269dd007d1a6 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:27.990313 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4298c-a962-479d-b0e3-9ba314bf3dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:27.991142 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4298c-a962-479d-b0e3-9ba314bf3dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:27.991427 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4298c-a962-479d-b0e3-9ba314bf3dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:27.991703 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4298c-a962-479d-b0e3-9ba314bf3dc4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:28.014940 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4298c-a962-479d-b0e3-9ba314bf3dc4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:28.021928 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-ffe4298c-a962-479d-b0e3-9ba314bf3dc4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:38:28.023836 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 408/809] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:38:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:28.029653 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48205000-d208-40f1-9dcd-63acdcf5312b None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:28.041843 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48205000-d208-40f1-9dcd-63acdcf5312b None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:28.047820 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb998484-aa6e-4242-a4f4-176d658db7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:28.048755 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb998484-aa6e-4242-a4f4-176d658db7fe admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:28.049294 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb998484-aa6e-4242-a4f4-176d658db7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:28.049760 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb998484-aa6e-4242-a4f4-176d658db7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:28.050752 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb998484-aa6e-4242-a4f4-176d658db7fe admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:28.051242 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb998484-aa6e-4242-a4f4-176d658db7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:28.053988 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb998484-aa6e-4242-a4f4-176d658db7fe admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:28.069511 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 402/810] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:38:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:28.075151 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4298c-a962-479d-b0e3-9ba314bf3dc4 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:28.088786 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4298c-a962-479d-b0e3-9ba314bf3dc4 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:28.093325 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca345ea3-4bd4-40ab-a7b6-f33a9e7eea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:28.094126 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca345ea3-4bd4-40ab-a7b6-f33a9e7eea65 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:28.094411 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca345ea3-4bd4-40ab-a7b6-f33a9e7eea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:28.094686 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca345ea3-4bd4-40ab-a7b6-f33a9e7eea65 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:28.111055 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca345ea3-4bd4-40ab-a7b6-f33a9e7eea65 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:28.113123 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca345ea3-4bd4-40ab-a7b6-f33a9e7eea65 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:28.140939 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-ca345ea3-4bd4-40ab-a7b6-f33a9e7eea65 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:28.142537 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 409/811] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:28.148474 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb998484-aa6e-4242-a4f4-176d658db7fe admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:28.166579 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb998484-aa6e-4242-a4f4-176d658db7fe admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:28.181544 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12669f3d-7128-43da-9b7e-65f77298d4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:28.182228 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12669f3d-7128-43da-9b7e-65f77298d4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:28.182515 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12669f3d-7128-43da-9b7e-65f77298d4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:28.182794 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12669f3d-7128-43da-9b7e-65f77298d4d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:28.183551 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12669f3d-7128-43da-9b7e-65f77298d4d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:28.183860 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12669f3d-7128-43da-9b7e-65f77298d4d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:28.185561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12669f3d-7128-43da-9b7e-65f77298d4d8 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:28.202579 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 403/812] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:28.208102 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca345ea3-4bd4-40ab-a7b6-f33a9e7eea65 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:28.225976 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca345ea3-4bd4-40ab-a7b6-f33a9e7eea65 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:28.233529 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10badb72-7983-4d08-91e3-25b7c4a30f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:28.234393 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10badb72-7983-4d08-91e3-25b7c4a30f34 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:28.234674 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10badb72-7983-4d08-91e3-25b7c4a30f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:28.234946 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10badb72-7983-4d08-91e3-25b7c4a30f34 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:28.248714 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10badb72-7983-4d08-91e3-25b7c4a30f34 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:28.250865 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10badb72-7983-4d08-91e3-25b7c4a30f34 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:28.268375 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-10badb72-7983-4d08-91e3-25b7c4a30f34 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 10 17:38:28.270072 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 410/813] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:38:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:28.276195 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12669f3d-7128-43da-9b7e-65f77298d4d8 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:28.290548 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12669f3d-7128-43da-9b7e-65f77298d4d8 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:28.305520 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661f8a5-95fb-4880-a09b-b49dbf3d82f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:28.306209 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661f8a5-95fb-4880-a09b-b49dbf3d82f9 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:28.306500 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661f8a5-95fb-4880-a09b-b49dbf3d82f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:28.306931 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661f8a5-95fb-4880-a09b-b49dbf3d82f9 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:28.307800 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661f8a5-95fb-4880-a09b-b49dbf3d82f9 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:28.308111 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661f8a5-95fb-4880-a09b-b49dbf3d82f9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:28.309995 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661f8a5-95fb-4880-a09b-b49dbf3d82f9 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:28.332795 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 404/814] 10.222.0.31 () {56 vars in 1156 bytes} [Mon Jan 10 17:38:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:28.338134 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10badb72-7983-4d08-91e3-25b7c4a30f34 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:28.353818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10badb72-7983-4d08-91e3-25b7c4a30f34 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:28.361134 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5fd9a-6124-4102-a8d5-8f00fcd5a33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:28.362043 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5fd9a-6124-4102-a8d5-8f00fcd5a33b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:28.362325 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5fd9a-6124-4102-a8d5-8f00fcd5a33b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:28.362597 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5fd9a-6124-4102-a8d5-8f00fcd5a33b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:28.366450 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e382d91-5900-47a7-9bdf-b2fbc0c49690 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:28.366963 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e382d91-5900-47a7-9bdf-b2fbc0c49690 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:28.367458 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e382d91-5900-47a7-9bdf-b2fbc0c49690 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:28.369738 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 405/815] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:38:28.374907 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b84cef-9af4-4702-929c-698e73dd7a87 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:28.375446 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b84cef-9af4-4702-929c-698e73dd7a87 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:28.375914 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b84cef-9af4-4702-929c-698e73dd7a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:28.383005 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5fd9a-6124-4102-a8d5-8f00fcd5a33b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:28.384882 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5fd9a-6124-4102-a8d5-8f00fcd5a33b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:28.394807 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-59b84cef-9af4-4702-929c-698e73dd7a87 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:28.396266 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-59b84cef-9af4-4702-929c-698e73dd7a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:28.404878 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 406/816] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:28 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:38:28.413627 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-73a5fd9a-6124-4102-a8d5-8f00fcd5a33b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:28.414939 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 411/817] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:28.420200 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b84cef-9af4-4702-929c-698e73dd7a87 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:28.433794 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b84cef-9af4-4702-929c-698e73dd7a87 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:28.438529 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3b5f3-b4f0-46a8-b95c-93e1ad37d9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:28.439499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3b5f3-b4f0-46a8-b95c-93e1ad37d9da admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:28.440030 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3b5f3-b4f0-46a8-b95c-93e1ad37d9da admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:28.440518 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3b5f3-b4f0-46a8-b95c-93e1ad37d9da admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:28.445588 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3b5f3-b4f0-46a8-b95c-93e1ad37d9da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:28.446113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3b5f3-b4f0-46a8-b95c-93e1ad37d9da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:28.448102 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3b5f3-b4f0-46a8-b95c-93e1ad37d9da admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:28.451824 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5fd9a-6124-4102-a8d5-8f00fcd5a33b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:28.463254 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 407/818] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:28.470735 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5fd9a-6124-4102-a8d5-8f00fcd5a33b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:28.472079 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3b5f3-b4f0-46a8-b95c-93e1ad37d9da admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:28.481037 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e828f-e89c-402c-9247-c5f2fa200631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:28.481849 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e828f-e89c-402c-9247-c5f2fa200631 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:28.482178 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e828f-e89c-402c-9247-c5f2fa200631 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:28.482451 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e828f-e89c-402c-9247-c5f2fa200631 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:28.483126 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e828f-e89c-402c-9247-c5f2fa200631 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:28.487239 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e828f-e89c-402c-9247-c5f2fa200631 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:28.493091 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3b5f3-b4f0-46a8-b95c-93e1ad37d9da admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:28.504459 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f9cef-bd33-434a-8a4b-6ce587338eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:28.505316 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f9cef-bd33-434a-8a4b-6ce587338eae admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:28.505594 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f9cef-bd33-434a-8a4b-6ce587338eae admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:28.505870 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f9cef-bd33-434a-8a4b-6ce587338eae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:28.510297 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-023e828f-e89c-402c-9247-c5f2fa200631 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 10 17:38:28.514780 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 412/819] 10.222.0.31 () {56 vars in 1150 bytes} [Mon Jan 10 17:38:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:28.517266 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f9cef-bd33-434a-8a4b-6ce587338eae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:28.519443 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f9cef-bd33-434a-8a4b-6ce587338eae admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:28.520869 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e828f-e89c-402c-9247-c5f2fa200631 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:28.536083 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e828f-e89c-402c-9247-c5f2fa200631 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:28.545815 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351288fa-9bba-40c4-a76a-1278bc17abe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:28.546464 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351288fa-9bba-40c4-a76a-1278bc17abe1 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:28.546790 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351288fa-9bba-40c4-a76a-1278bc17abe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:28.547072 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351288fa-9bba-40c4-a76a-1278bc17abe1 admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:28.547801 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351288fa-9bba-40c4-a76a-1278bc17abe1 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:28.548110 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351288fa-9bba-40c4-a76a-1278bc17abe1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:28.551438 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351288fa-9bba-40c4-a76a-1278bc17abe1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:28.553904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-a22f9cef-bd33-434a-8a4b-6ce587338eae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:28.555180 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 408/820] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:28.562395 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f9cef-bd33-434a-8a4b-6ce587338eae admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:28.568908 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 413/821] 10.222.0.31 () {56 vars in 1145 bytes} [Mon Jan 10 17:38:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:28.578067 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351288fa-9bba-40c4-a76a-1278bc17abe1 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:28.579430 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f9cef-bd33-434a-8a4b-6ce587338eae admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:28.584255 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff87bd4-ec6f-4d83-a074-f265366d7efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:28.585177 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff87bd4-ec6f-4d83-a074-f265366d7efa admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:28.585652 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff87bd4-ec6f-4d83-a074-f265366d7efa admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:28.586116 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff87bd4-ec6f-4d83-a074-f265366d7efa admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:28.587111 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff87bd4-ec6f-4d83-a074-f265366d7efa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:28.587628 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff87bd4-ec6f-4d83-a074-f265366d7efa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:28.589694 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff87bd4-ec6f-4d83-a074-f265366d7efa admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:28.596885 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351288fa-9bba-40c4-a76a-1278bc17abe1 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:28.605546 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 409/822] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:28.607570 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf7b3c-1505-472e-8db0-3429c20685e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:28.608325 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf7b3c-1505-472e-8db0-3429c20685e1 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:28.609310 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff87bd4-ec6f-4d83-a074-f265366d7efa admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:28.609867 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf7b3c-1505-472e-8db0-3429c20685e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:28.610141 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf7b3c-1505-472e-8db0-3429c20685e1 admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:28.610966 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf7b3c-1505-472e-8db0-3429c20685e1 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:28.611324 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf7b3c-1505-472e-8db0-3429c20685e1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:28.614804 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf7b3c-1505-472e-8db0-3429c20685e1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:28.625652 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff87bd4-ec6f-4d83-a074-f265366d7efa admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:28.627526 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 414/823] 10.222.0.31 () {56 vars in 1145 bytes} [Mon Jan 10 17:38:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:28.631677 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22f386-9b80-4350-a4fa-374b55af7367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:28.632692 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22f386-9b80-4350-a4fa-374b55af7367 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:28.633611 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf7b3c-1505-472e-8db0-3429c20685e1 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:28.638615 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22f386-9b80-4350-a4fa-374b55af7367 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:28.639916 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22f386-9b80-4350-a4fa-374b55af7367 admin admin] PATH_INFO: `/v3/projects/1415eea0335a49bf800e8215498af679/users/0257a86ce85b4b4386cde32c8ed4b39a/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:28.644596 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf7b3c-1505-472e-8db0-3429c20685e1 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:28.645421 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22f386-9b80-4350-a4fa-374b55af7367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1415eea0335a49bf800e8215498af679, user_id=0257a86ce85b4b4386cde32c8ed4b39a, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:28.649187 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22f386-9b80-4350-a4fa-374b55af7367 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:28.656786 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e8fbc-b592-47f9-bbc3-104cde9d5af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:28.657477 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e8fbc-b592-47f9-bbc3-104cde9d5af6 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:28.657859 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e8fbc-b592-47f9-bbc3-104cde9d5af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:28.658275 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e8fbc-b592-47f9-bbc3-104cde9d5af6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:28.659241 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e8fbc-b592-47f9-bbc3-104cde9d5af6 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:28.660456 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING py.warnings [None req-1e4e8fbc-b592-47f9-bbc3-104cde9d5af6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:38:28.660456 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: warnings.warn(msg) Jan 10 17:38:28.660456 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: Jan 10 17:38:28.661677 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e8fbc-b592-47f9-bbc3-104cde9d5af6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:28.677092 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 410/824] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:38:28 2022] PUT /identity/v3/projects/1415eea0335a49bf800e8215498af679/users/0257a86ce85b4b4386cde32c8ed4b39a/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:38:28.704144 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 415/825] 10.222.0.31 () {60 vars in 1165 bytes} [Mon Jan 10 17:38:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:38:29.261440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81a124-129f-49ab-aefa-f59c69a67977 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:29.262130 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81a124-129f-49ab-aefa-f59c69a67977 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:29.262130 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81a124-129f-49ab-aefa-f59c69a67977 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:29.264129 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 411/826] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:29.271830 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a434cf2-b318-43ec-86eb-5606edf10cdd None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:29.272420 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a434cf2-b318-43ec-86eb-5606edf10cdd None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:29.272420 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a434cf2-b318-43ec-86eb-5606edf10cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:29.294322 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-9a434cf2-b318-43ec-86eb-5606edf10cdd None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:29.295531 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-9a434cf2-b318-43ec-86eb-5606edf10cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:29.384307 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 416/827] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:29 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:29.420322 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81a124-129f-49ab-aefa-f59c69a67977 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:29.436270 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81a124-129f-49ab-aefa-f59c69a67977 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:29.440891 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f724786-bb69-405a-8e23-aa4ce953b0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:29.441912 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f724786-bb69-405a-8e23-aa4ce953b0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:29.442395 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f724786-bb69-405a-8e23-aa4ce953b0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:29.442880 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f724786-bb69-405a-8e23-aa4ce953b0b0 admin admin] PATH_INFO: `/v3/services/network` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:29.443827 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f724786-bb69-405a-8e23-aa4ce953b0b0 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:29.445062 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING py.warnings [None req-5f724786-bb69-405a-8e23-aa4ce953b0b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:38:29.445062 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: warnings.warn(msg) Jan 10 17:38:29.445062 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: Jan 10 17:38:29.446262 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f724786-bb69-405a-8e23-aa4ce953b0b0 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:29.463922 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-5f724786-bb69-405a-8e23-aa4ce953b0b0 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 10 17:38:29.465758 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 412/828] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:29 2022] GET /identity/v3/services/network => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:29.471442 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a434cf2-b318-43ec-86eb-5606edf10cdd None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:29.485951 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a434cf2-b318-43ec-86eb-5606edf10cdd None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:29.492772 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50d2fe-a941-474d-8ed4-866899ebecf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:29.493464 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50d2fe-a941-474d-8ed4-866899ebecf1 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:29.493745 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50d2fe-a941-474d-8ed4-866899ebecf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:29.494019 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50d2fe-a941-474d-8ed4-866899ebecf1 admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:29.494749 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50d2fe-a941-474d-8ed4-866899ebecf1 admin admin] RBAC: Adding query filter params (name=network) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:29.495050 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50d2fe-a941-474d-8ed4-866899ebecf1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:29.496654 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50d2fe-a941-474d-8ed4-866899ebecf1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:29.504939 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 417/829] 10.222.0.31 () {56 vars in 1133 bytes} [Mon Jan 10 17:38:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:29.510145 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f724786-bb69-405a-8e23-aa4ce953b0b0 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:29.524689 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f724786-bb69-405a-8e23-aa4ce953b0b0 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:29.529363 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c20cfb-063c-40ad-adc8-fd7e274da6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:29.530236 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c20cfb-063c-40ad-adc8-fd7e274da6aa admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:29.530731 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c20cfb-063c-40ad-adc8-fd7e274da6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:29.531198 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c20cfb-063c-40ad-adc8-fd7e274da6aa admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:29.532110 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c20cfb-063c-40ad-adc8-fd7e274da6aa admin admin] RBAC: Adding query filter params (type=network) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:29.532610 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c20cfb-063c-40ad-adc8-fd7e274da6aa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:29.534484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c20cfb-063c-40ad-adc8-fd7e274da6aa admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:29.546186 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 413/830] 10.222.0.31 () {56 vars in 1133 bytes} [Mon Jan 10 17:38:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:29.551423 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50d2fe-a941-474d-8ed4-866899ebecf1 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:29.565974 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50d2fe-a941-474d-8ed4-866899ebecf1 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:29.573178 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39676ef6-d049-4b74-809b-e79ea5d4d857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:29.573839 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39676ef6-d049-4b74-809b-e79ea5d4d857 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:29.574115 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39676ef6-d049-4b74-809b-e79ea5d4d857 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:29.574385 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39676ef6-d049-4b74-809b-e79ea5d4d857 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:29.575143 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39676ef6-d049-4b74-809b-e79ea5d4d857 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:29.576736 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39676ef6-d049-4b74-809b-e79ea5d4d857 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:29.615144 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 418/831] 10.222.0.31 () {60 vars in 1165 bytes} [Mon Jan 10 17:38:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:38:29.808703 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f507f7-38fc-4254-bf08-bd6168631596 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:29.809371 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f507f7-38fc-4254-bf08-bd6168631596 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:29.809863 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f507f7-38fc-4254-bf08-bd6168631596 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:29.811913 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 414/832] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:29.819537 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd499a4d-4811-4d7a-9730-f0dd780dda26 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:29.819878 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd499a4d-4811-4d7a-9730-f0dd780dda26 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:29.820117 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd499a4d-4811-4d7a-9730-f0dd780dda26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:29.838700 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-fd499a4d-4811-4d7a-9730-f0dd780dda26 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:29.839931 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-fd499a4d-4811-4d7a-9730-f0dd780dda26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:29.864480 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 419/833] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:29 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:29.899827 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f507f7-38fc-4254-bf08-bd6168631596 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:29.914191 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f507f7-38fc-4254-bf08-bd6168631596 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:29.918835 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26753966-4403-48ae-b890-b7868b5e2f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:29.919688 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26753966-4403-48ae-b890-b7868b5e2f08 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:29.919971 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26753966-4403-48ae-b890-b7868b5e2f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:29.920242 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26753966-4403-48ae-b890-b7868b5e2f08 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:29.921001 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26753966-4403-48ae-b890-b7868b5e2f08 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:29.922662 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26753966-4403-48ae-b890-b7868b5e2f08 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:29.934446 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-26753966-4403-48ae-b890-b7868b5e2f08 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 10 17:38:29.935953 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 415/834] 10.222.0.31 () {56 vars in 1153 bytes} [Mon Jan 10 17:38:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:29.941937 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd499a4d-4811-4d7a-9730-f0dd780dda26 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:29.951014 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd499a4d-4811-4d7a-9730-f0dd780dda26 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:29.955773 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda4811-3b8a-42cd-8f4b-00f18eef8eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:29.956446 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda4811-3b8a-42cd-8f4b-00f18eef8eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:29.956730 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda4811-3b8a-42cd-8f4b-00f18eef8eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:29.957079 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda4811-3b8a-42cd-8f4b-00f18eef8eb1 admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:29.957814 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda4811-3b8a-42cd-8f4b-00f18eef8eb1 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:29.958171 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda4811-3b8a-42cd-8f4b-00f18eef8eb1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:29.959834 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda4811-3b8a-42cd-8f4b-00f18eef8eb1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:29.968693 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 420/835] 10.222.0.31 () {56 vars in 1147 bytes} [Mon Jan 10 17:38:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:29.974180 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26753966-4403-48ae-b890-b7868b5e2f08 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:29.984258 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26753966-4403-48ae-b890-b7868b5e2f08 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:29.989124 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc811258-75bf-4378-98ff-0c12e6e1d4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:29.989831 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc811258-75bf-4378-98ff-0c12e6e1d4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:29.990113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc811258-75bf-4378-98ff-0c12e6e1d4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:29.990393 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc811258-75bf-4378-98ff-0c12e6e1d4d0 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:29.991191 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc811258-75bf-4378-98ff-0c12e6e1d4d0 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:29.991496 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc811258-75bf-4378-98ff-0c12e6e1d4d0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:29.993176 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc811258-75bf-4378-98ff-0c12e6e1d4d0 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:29.998364 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 416/836] 10.222.0.31 () {56 vars in 1147 bytes} [Mon Jan 10 17:38:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:30.713275 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429b3c5-e98c-414c-9d1c-db7ab1f8b27a None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:30.713801 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429b3c5-e98c-414c-9d1c-db7ab1f8b27a None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:30.713801 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429b3c5-e98c-414c-9d1c-db7ab1f8b27a None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:30.721066 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 421/837] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:30.726544 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81979afb-1ff3-492a-942a-814e3242c77e None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:30.727001 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81979afb-1ff3-492a-942a-814e3242c77e None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:30.727078 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81979afb-1ff3-492a-942a-814e3242c77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:30.748725 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-81979afb-1ff3-492a-942a-814e3242c77e None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:30.749962 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-81979afb-1ff3-492a-942a-814e3242c77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:30.758275 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 417/838] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:30 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:30.783386 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429b3c5-e98c-414c-9d1c-db7ab1f8b27a None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:30.795972 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429b3c5-e98c-414c-9d1c-db7ab1f8b27a None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:30.800586 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5c50e-363b-4f8d-9f97-c4e3a57ea9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:30.801613 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5c50e-363b-4f8d-9f97-c4e3a57ea9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:30.802090 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5c50e-363b-4f8d-9f97-c4e3a57ea9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:30.802528 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5c50e-363b-4f8d-9f97-c4e3a57ea9a6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:30.812969 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5c50e-363b-4f8d-9f97-c4e3a57ea9a6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:30.820026 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-fdf5c50e-363b-4f8d-9f97-c4e3a57ea9a6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 17:38:30.821737 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 422/839] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:38:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:30.827662 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81979afb-1ff3-492a-942a-814e3242c77e None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:30.837057 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81979afb-1ff3-492a-942a-814e3242c77e None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:30.841808 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56ee04-a032-4864-aa73-8f6bbeb91f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:30.842660 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56ee04-a032-4864-aa73-8f6bbeb91f2e admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:30.843111 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56ee04-a032-4864-aa73-8f6bbeb91f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:30.843578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56ee04-a032-4864-aa73-8f6bbeb91f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:30.844505 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56ee04-a032-4864-aa73-8f6bbeb91f2e admin admin] RBAC: Adding query filter params (name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:30.845016 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56ee04-a032-4864-aa73-8f6bbeb91f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:30.847127 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56ee04-a032-4864-aa73-8f6bbeb91f2e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:30.856079 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 418/840] 10.222.0.31 () {56 vars in 1124 bytes} [Mon Jan 10 17:38:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:30.861853 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5c50e-363b-4f8d-9f97-c4e3a57ea9a6 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:30.872204 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5c50e-363b-4f8d-9f97-c4e3a57ea9a6 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:30.876919 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cc1c6-e8fd-41e1-ad27-ecebcb98e593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:30.877914 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cc1c6-e8fd-41e1-ad27-ecebcb98e593 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:30.878380 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cc1c6-e8fd-41e1-ad27-ecebcb98e593 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:30.878822 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cc1c6-e8fd-41e1-ad27-ecebcb98e593 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:30.889526 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5cc1c6-e8fd-41e1-ad27-ecebcb98e593 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:30.891620 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5cc1c6-e8fd-41e1-ad27-ecebcb98e593 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:30.910407 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-8d5cc1c6-e8fd-41e1-ad27-ecebcb98e593 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:30.912340 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 423/841] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:30.918493 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56ee04-a032-4864-aa73-8f6bbeb91f2e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:30.929306 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56ee04-a032-4864-aa73-8f6bbeb91f2e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:30.934197 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf33a75-b483-47b8-b75f-9f72942ef8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:30.935051 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf33a75-b483-47b8-b75f-9f72942ef8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:30.935526 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf33a75-b483-47b8-b75f-9f72942ef8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:30.935971 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf33a75-b483-47b8-b75f-9f72942ef8e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:30.936922 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf33a75-b483-47b8-b75f-9f72942ef8e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:30.937397 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf33a75-b483-47b8-b75f-9f72942ef8e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:30.939155 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf33a75-b483-47b8-b75f-9f72942ef8e5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:30.952140 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 419/842] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:30.957943 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cc1c6-e8fd-41e1-ad27-ecebcb98e593 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:30.967923 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cc1c6-e8fd-41e1-ad27-ecebcb98e593 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:30.972738 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb6263-0e53-4199-b6d0-93bd9b75d254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:30.973813 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb6263-0e53-4199-b6d0-93bd9b75d254 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:30.974286 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb6263-0e53-4199-b6d0-93bd9b75d254 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:30.974761 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb6263-0e53-4199-b6d0-93bd9b75d254 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:30.982794 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb6263-0e53-4199-b6d0-93bd9b75d254 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:30.985197 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb6263-0e53-4199-b6d0-93bd9b75d254 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:31.000392 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-8abb6263-0e53-4199-b6d0-93bd9b75d254 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 10 17:38:31.001932 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 424/843] 10.222.0.31 () {56 vars in 1138 bytes} [Mon Jan 10 17:38:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:31.007773 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf33a75-b483-47b8-b75f-9f72942ef8e5 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.018201 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf33a75-b483-47b8-b75f-9f72942ef8e5 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.023490 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5394110-12c6-42ef-9720-b5418ac1c696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.024351 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5394110-12c6-42ef-9720-b5418ac1c696 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.024886 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5394110-12c6-42ef-9720-b5418ac1c696 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.025329 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5394110-12c6-42ef-9720-b5418ac1c696 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.026407 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5394110-12c6-42ef-9720-b5418ac1c696 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:31.026884 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5394110-12c6-42ef-9720-b5418ac1c696 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:31.029032 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5394110-12c6-42ef-9720-b5418ac1c696 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:31.047796 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 420/844] 10.222.0.31 () {56 vars in 1170 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:31.053784 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb6263-0e53-4199-b6d0-93bd9b75d254 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.064003 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb6263-0e53-4199-b6d0-93bd9b75d254 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.069084 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cac02-7a12-4a8e-a6ff-e2879979c38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.069983 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cac02-7a12-4a8e-a6ff-e2879979c38f admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.070462 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cac02-7a12-4a8e-a6ff-e2879979c38f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.070952 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cac02-7a12-4a8e-a6ff-e2879979c38f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.079516 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303cac02-7a12-4a8e-a6ff-e2879979c38f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:31.081580 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303cac02-7a12-4a8e-a6ff-e2879979c38f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:31.091095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 425/845] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:38:31.096966 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5394110-12c6-42ef-9720-b5418ac1c696 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.107123 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5394110-12c6-42ef-9720-b5418ac1c696 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.112075 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0438c3-7603-4ed8-9656-6c087e2ed226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.113202 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0438c3-7603-4ed8-9656-6c087e2ed226 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.113653 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0438c3-7603-4ed8-9656-6c087e2ed226 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.114228 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0438c3-7603-4ed8-9656-6c087e2ed226 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.125372 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0438c3-7603-4ed8-9656-6c087e2ed226 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:31.127595 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0438c3-7603-4ed8-9656-6c087e2ed226 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:31.146309 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-cc0438c3-7603-4ed8-9656-6c087e2ed226 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:31.148431 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 421/846] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:31.153890 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cac02-7a12-4a8e-a6ff-e2879979c38f admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.163209 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cac02-7a12-4a8e-a6ff-e2879979c38f admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.167812 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fd4a6-02f0-42f4-ba3d-e057bfdc1c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.168508 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fd4a6-02f0-42f4-ba3d-e057bfdc1c7d admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.168790 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fd4a6-02f0-42f4-ba3d-e057bfdc1c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.169120 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fd4a6-02f0-42f4-ba3d-e057bfdc1c7d admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.169854 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fd4a6-02f0-42f4-ba3d-e057bfdc1c7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:31.170156 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fd4a6-02f0-42f4-ba3d-e057bfdc1c7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:31.171798 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fd4a6-02f0-42f4-ba3d-e057bfdc1c7d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:31.188685 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 426/847] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:31.190285 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0438c3-7603-4ed8-9656-6c087e2ed226 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.201007 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0438c3-7603-4ed8-9656-6c087e2ed226 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.205948 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bde0f-1ae7-44e0-8662-0ea232b2f0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.206851 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bde0f-1ae7-44e0-8662-0ea232b2f0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.207129 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bde0f-1ae7-44e0-8662-0ea232b2f0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.207407 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bde0f-1ae7-44e0-8662-0ea232b2f0d7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.215999 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1bde0f-1ae7-44e0-8662-0ea232b2f0d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:31.218350 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1bde0f-1ae7-44e0-8662-0ea232b2f0d7 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:31.232502 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-fc1bde0f-1ae7-44e0-8662-0ea232b2f0d7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:31.238512 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 422/848] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:31.239906 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fd4a6-02f0-42f4-ba3d-e057bfdc1c7d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.249916 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fd4a6-02f0-42f4-ba3d-e057bfdc1c7d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.254593 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca499e-42b0-4d43-867d-f823badc940c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.255248 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca499e-42b0-4d43-867d-f823badc940c admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.255576 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca499e-42b0-4d43-867d-f823badc940c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.255852 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca499e-42b0-4d43-867d-f823badc940c admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.256656 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca499e-42b0-4d43-867d-f823badc940c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:31.257062 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca499e-42b0-4d43-867d-f823badc940c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:31.258995 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca499e-42b0-4d43-867d-f823badc940c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:31.276941 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 427/849] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:31.278567 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bde0f-1ae7-44e0-8662-0ea232b2f0d7 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.290536 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bde0f-1ae7-44e0-8662-0ea232b2f0d7 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.295180 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78898350-8783-4a16-8157-0c1a199be99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.295912 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78898350-8783-4a16-8157-0c1a199be99b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.296193 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78898350-8783-4a16-8157-0c1a199be99b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.296461 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78898350-8783-4a16-8157-0c1a199be99b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.297347 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78898350-8783-4a16-8157-0c1a199be99b admin admin] RBAC: Adding query filter params (role.id=67bb9b9aab104609b23a2ab5e7d31142, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=3b3dbe4735a54de1825abc28ecf00b84) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:31.297698 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78898350-8783-4a16-8157-0c1a199be99b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:31.299630 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78898350-8783-4a16-8157-0c1a199be99b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:31.313066 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 423/850] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/role_assignments?user.id=3b3dbe4735a54de1825abc28ecf00b84&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=67bb9b9aab104609b23a2ab5e7d31142 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:31.375142 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480661d-9cbc-4986-956c-ba3c46eaf019 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.375784 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480661d-9cbc-4986-956c-ba3c46eaf019 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.376260 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480661d-9cbc-4986-956c-ba3c46eaf019 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.378904 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 428/851] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:31.385012 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2fdd5-3772-4a42-baf0-888c49196c77 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.385309 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2fdd5-3772-4a42-baf0-888c49196c77 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.385562 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2fdd5-3772-4a42-baf0-888c49196c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.408679 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-acc2fdd5-3772-4a42-baf0-888c49196c77 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:31.410308 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-acc2fdd5-3772-4a42-baf0-888c49196c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:31.418862 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 424/852] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:31 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:31.444741 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480661d-9cbc-4986-956c-ba3c46eaf019 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.458186 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480661d-9cbc-4986-956c-ba3c46eaf019 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.463136 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8389b8-67d6-43b1-bbc8-eb3f682bc0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.464288 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8389b8-67d6-43b1-bbc8-eb3f682bc0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.464763 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8389b8-67d6-43b1-bbc8-eb3f682bc0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.465276 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8389b8-67d6-43b1-bbc8-eb3f682bc0f2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.477222 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8389b8-67d6-43b1-bbc8-eb3f682bc0f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:31.484506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-cf8389b8-67d6-43b1-bbc8-eb3f682bc0f2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:38:31.486567 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 429/853] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:31.492906 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2fdd5-3772-4a42-baf0-888c49196c77 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.502769 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2fdd5-3772-4a42-baf0-888c49196c77 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.507810 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169729a9-44dd-4096-b08b-8e5aa9869304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.508803 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169729a9-44dd-4096-b08b-8e5aa9869304 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.509329 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169729a9-44dd-4096-b08b-8e5aa9869304 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.509805 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169729a9-44dd-4096-b08b-8e5aa9869304 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.510803 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169729a9-44dd-4096-b08b-8e5aa9869304 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:31.511304 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169729a9-44dd-4096-b08b-8e5aa9869304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:31.513199 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169729a9-44dd-4096-b08b-8e5aa9869304 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:31.523625 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 425/854] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:31.529633 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8389b8-67d6-43b1-bbc8-eb3f682bc0f2 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.539994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8389b8-67d6-43b1-bbc8-eb3f682bc0f2 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.544951 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2e49c-0c84-46af-9259-7097e8940c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.545975 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2e49c-0c84-46af-9259-7097e8940c92 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.546450 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2e49c-0c84-46af-9259-7097e8940c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.546939 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2e49c-0c84-46af-9259-7097e8940c92 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.558556 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2e49c-0c84-46af-9259-7097e8940c92 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:31.560716 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2e49c-0c84-46af-9259-7097e8940c92 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:31.577073 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-4db2e49c-0c84-46af-9259-7097e8940c92 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:31.578602 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 430/855] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:31.584453 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169729a9-44dd-4096-b08b-8e5aa9869304 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.594346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169729a9-44dd-4096-b08b-8e5aa9869304 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.598899 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f005b2-ebcd-4c70-b4fe-cde06f705124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.599555 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f005b2-ebcd-4c70-b4fe-cde06f705124 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.599844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f005b2-ebcd-4c70-b4fe-cde06f705124 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.600110 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f005b2-ebcd-4c70-b4fe-cde06f705124 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.601022 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f005b2-ebcd-4c70-b4fe-cde06f705124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:31.601196 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f005b2-ebcd-4c70-b4fe-cde06f705124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:31.602797 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f005b2-ebcd-4c70-b4fe-cde06f705124 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:31.615040 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 426/856] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:31.620795 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2e49c-0c84-46af-9259-7097e8940c92 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.632157 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2e49c-0c84-46af-9259-7097e8940c92 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.636882 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ac94f-f1d6-4f89-8ed2-264763339073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.637836 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ac94f-f1d6-4f89-8ed2-264763339073 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.638254 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ac94f-f1d6-4f89-8ed2-264763339073 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.638682 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ac94f-f1d6-4f89-8ed2-264763339073 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.647463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ac94f-f1d6-4f89-8ed2-264763339073 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:31.650067 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ac94f-f1d6-4f89-8ed2-264763339073 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:31.654610 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7a021-e763-4e47-ad9e-e3a0f6710556 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.654997 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7a021-e763-4e47-ad9e-e3a0f6710556 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.655347 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7a021-e763-4e47-ad9e-e3a0f6710556 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.657533 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 427/857] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:38:31.664012 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e4e6c-c2dc-4763-b2b7-493221c3da9a None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.664298 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e4e6c-c2dc-4763-b2b7-493221c3da9a None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.664575 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e4e6c-c2dc-4763-b2b7-493221c3da9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.665577 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-f30ac94f-f1d6-4f89-8ed2-264763339073 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 10 17:38:31.667421 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 431/858] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:31.673807 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ac94f-f1d6-4f89-8ed2-264763339073 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.685137 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-143e4e6c-c2dc-4763-b2b7-493221c3da9a None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:31.686387 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-143e4e6c-c2dc-4763-b2b7-493221c3da9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:31.687515 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ac94f-f1d6-4f89-8ed2-264763339073 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.692387 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0eab21-f136-4003-a97a-9299b728c4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.693320 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0eab21-f136-4003-a97a-9299b728c4ff admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.693918 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0eab21-f136-4003-a97a-9299b728c4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.694376 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0eab21-f136-4003-a97a-9299b728c4ff admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.695262 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 428/859] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:31 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:38:31.695648 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0eab21-f136-4003-a97a-9299b728c4ff admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:31.696104 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0eab21-f136-4003-a97a-9299b728c4ff admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:31.698305 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0eab21-f136-4003-a97a-9299b728c4ff admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:31.716998 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 432/860] 10.222.0.31 () {56 vars in 1156 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:31.718209 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e4e6c-c2dc-4763-b2b7-493221c3da9a None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.725431 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0eab21-f136-4003-a97a-9299b728c4ff admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.728119 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e4e6c-c2dc-4763-b2b7-493221c3da9a None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.732781 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c57a7-8d9d-4f66-a588-679f820e648b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.734225 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c57a7-8d9d-4f66-a588-679f820e648b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.734225 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c57a7-8d9d-4f66-a588-679f820e648b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.734420 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c57a7-8d9d-4f66-a588-679f820e648b admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.735188 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c57a7-8d9d-4f66-a588-679f820e648b admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:31.737111 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c57a7-8d9d-4f66-a588-679f820e648b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:31.740883 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0eab21-f136-4003-a97a-9299b728c4ff admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.743711 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163c612-be6a-4c0d-b7f0-eff8e6dbdbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.744350 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163c612-be6a-4c0d-b7f0-eff8e6dbdbee admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.744629 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163c612-be6a-4c0d-b7f0-eff8e6dbdbee admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.744937 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163c612-be6a-4c0d-b7f0-eff8e6dbdbee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.751128 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-e31c57a7-8d9d-4f66-a588-679f820e648b admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 10 17:38:31.752832 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 429/861] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:31.753140 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163c612-be6a-4c0d-b7f0-eff8e6dbdbee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:31.754956 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163c612-be6a-4c0d-b7f0-eff8e6dbdbee admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:31.758736 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c57a7-8d9d-4f66-a588-679f820e648b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.764457 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 433/862] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:38:31.769663 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c57a7-8d9d-4f66-a588-679f820e648b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.769859 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163c612-be6a-4c0d-b7f0-eff8e6dbdbee admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.775432 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8641b79-fb4a-4c7f-9935-974c92980535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.776200 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8641b79-fb4a-4c7f-9935-974c92980535 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.776549 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8641b79-fb4a-4c7f-9935-974c92980535 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.777017 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8641b79-fb4a-4c7f-9935-974c92980535 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.777817 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8641b79-fb4a-4c7f-9935-974c92980535 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:31.778205 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8641b79-fb4a-4c7f-9935-974c92980535 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:31.779894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163c612-be6a-4c0d-b7f0-eff8e6dbdbee admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.780004 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8641b79-fb4a-4c7f-9935-974c92980535 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:31.785112 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4238e1-28f9-4d32-b902-944d27f96cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.785740 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 430/863] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:31.785967 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4238e1-28f9-4d32-b902-944d27f96cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.786249 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4238e1-28f9-4d32-b902-944d27f96cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.786523 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4238e1-28f9-4d32-b902-944d27f96cf7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.791024 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8641b79-fb4a-4c7f-9935-974c92980535 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.800586 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4238e1-28f9-4d32-b902-944d27f96cf7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:31.801051 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8641b79-fb4a-4c7f-9935-974c92980535 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.802646 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4238e1-28f9-4d32-b902-944d27f96cf7 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:31.805769 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d855804-f355-4ff5-b00e-8310d756e133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.806461 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d855804-f355-4ff5-b00e-8310d756e133 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.806739 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d855804-f355-4ff5-b00e-8310d756e133 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.807050 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d855804-f355-4ff5-b00e-8310d756e133 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.807769 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d855804-f355-4ff5-b00e-8310d756e133 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:31.808070 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d855804-f355-4ff5-b00e-8310d756e133 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:31.809823 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d855804-f355-4ff5-b00e-8310d756e133 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:31.815022 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 431/864] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:31.824130 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-4a4238e1-28f9-4d32-b902-944d27f96cf7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:31.825851 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 434/865] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:31.831450 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d855804-f355-4ff5-b00e-8310d756e133 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.842438 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d855804-f355-4ff5-b00e-8310d756e133 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.847794 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d0c56-7ef6-4220-adef-457f67d2330b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.848920 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d0c56-7ef6-4220-adef-457f67d2330b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.849420 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d0c56-7ef6-4220-adef-457f67d2330b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.849940 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d0c56-7ef6-4220-adef-457f67d2330b admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.850945 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d0c56-7ef6-4220-adef-457f67d2330b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:31.851492 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d0c56-7ef6-4220-adef-457f67d2330b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:31.853450 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d0c56-7ef6-4220-adef-457f67d2330b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:31.867799 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 432/866] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:31.873784 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4238e1-28f9-4d32-b902-944d27f96cf7 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.884927 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4238e1-28f9-4d32-b902-944d27f96cf7 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.890211 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975070af-86cb-4a5d-ad46-14b76064dcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.891439 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975070af-86cb-4a5d-ad46-14b76064dcb5 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.891954 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975070af-86cb-4a5d-ad46-14b76064dcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.892909 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975070af-86cb-4a5d-ad46-14b76064dcb5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.901638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975070af-86cb-4a5d-ad46-14b76064dcb5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:31.904066 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975070af-86cb-4a5d-ad46-14b76064dcb5 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:31.919168 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-975070af-86cb-4a5d-ad46-14b76064dcb5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:31.921132 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 435/867] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:31.927463 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d0c56-7ef6-4220-adef-457f67d2330b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.938086 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d0c56-7ef6-4220-adef-457f67d2330b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.943378 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04dd9b1-b996-4c06-b2bc-16d461f35b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.944365 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dd9b1-b996-4c06-b2bc-16d461f35b21 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.944927 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dd9b1-b996-4c06-b2bc-16d461f35b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.945421 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dd9b1-b996-4c06-b2bc-16d461f35b21 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.946539 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04dd9b1-b996-4c06-b2bc-16d461f35b21 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:31.947080 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04dd9b1-b996-4c06-b2bc-16d461f35b21 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:31.949239 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04dd9b1-b996-4c06-b2bc-16d461f35b21 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:31.963201 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 433/868] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:31.969778 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975070af-86cb-4a5d-ad46-14b76064dcb5 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:31.981571 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975070af-86cb-4a5d-ad46-14b76064dcb5 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:31.986922 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733aa1b-578c-4f00-bf19-df20a4e1c1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:31.987968 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733aa1b-578c-4f00-bf19-df20a4e1c1ac admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:31.988447 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733aa1b-578c-4f00-bf19-df20a4e1c1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:31.989019 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733aa1b-578c-4f00-bf19-df20a4e1c1ac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:31.990169 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733aa1b-578c-4f00-bf19-df20a4e1c1ac admin admin] RBAC: Adding query filter params (role.id=3c05bedf79e04eb38d2ae66736030bfe, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=0257a86ce85b4b4386cde32c8ed4b39a) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:31.990712 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733aa1b-578c-4f00-bf19-df20a4e1c1ac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:31.992894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733aa1b-578c-4f00-bf19-df20a4e1c1ac admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:32.000664 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 436/869] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:38:31 2022] GET /identity/v3/role_assignments?user.id=0257a86ce85b4b4386cde32c8ed4b39a&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=3c05bedf79e04eb38d2ae66736030bfe => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:32.489791 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0eb3a-e389-4fac-a6f1-1203c5113dfa None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:32.490168 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0eb3a-e389-4fac-a6f1-1203c5113dfa None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:32.490357 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0eb3a-e389-4fac-a6f1-1203c5113dfa None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:32.492415 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 434/870] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:32.497602 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c6877-7d4d-4f9c-93d9-51ba8ca58eb0 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:32.497896 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c6877-7d4d-4f9c-93d9-51ba8ca58eb0 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:32.498176 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c6877-7d4d-4f9c-93d9-51ba8ca58eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:32.516053 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-c36c6877-7d4d-4f9c-93d9-51ba8ca58eb0 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:32.517293 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-c36c6877-7d4d-4f9c-93d9-51ba8ca58eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:32.525671 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 437/871] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:32 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:38:32.549741 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0eb3a-e389-4fac-a6f1-1203c5113dfa None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:32.562105 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0eb3a-e389-4fac-a6f1-1203c5113dfa None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:32.566606 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cd76f-4f82-4957-b3ec-511605a0acf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:32.567262 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cd76f-4f82-4957-b3ec-511605a0acf5 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:32.567545 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cd76f-4f82-4957-b3ec-511605a0acf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:32.567822 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cd76f-4f82-4957-b3ec-511605a0acf5 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:32.568584 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cd76f-4f82-4957-b3ec-511605a0acf5 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:32.569639 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING py.warnings [None req-b94cd76f-4f82-4957-b3ec-511605a0acf5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:38:32.569639 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: warnings.warn(msg) Jan 10 17:38:32.569639 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: Jan 10 17:38:32.570522 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cd76f-4f82-4957-b3ec-511605a0acf5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:32.589288 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 435/872] 10.222.0.31 () {60 vars in 1162 bytes} [Mon Jan 10 17:38:32 2022] POST /identity/v3/services => generated 269 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:38:33.878438 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbabef-dfc4-4a23-b0e8-f686213bd705 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:33.878959 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbabef-dfc4-4a23-b0e8-f686213bd705 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:33.878959 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbabef-dfc4-4a23-b0e8-f686213bd705 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:33.881029 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 438/873] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:33.886442 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166e2c3-7c28-4aba-b1ef-d0fb4d33a093 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:33.886846 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166e2c3-7c28-4aba-b1ef-d0fb4d33a093 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:33.887014 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166e2c3-7c28-4aba-b1ef-d0fb4d33a093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:33.905301 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-1166e2c3-7c28-4aba-b1ef-d0fb4d33a093 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:33.906465 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-1166e2c3-7c28-4aba-b1ef-d0fb4d33a093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:33.928958 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 436/874] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:33 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:33.947908 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbabef-dfc4-4a23-b0e8-f686213bd705 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:33.960287 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbabef-dfc4-4a23-b0e8-f686213bd705 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:33.964602 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61998b-c198-4e1e-a5dd-7118f298886f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:33.965439 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61998b-c198-4e1e-a5dd-7118f298886f admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:33.965716 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61998b-c198-4e1e-a5dd-7118f298886f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:33.965985 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61998b-c198-4e1e-a5dd-7118f298886f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:33.976665 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61998b-c198-4e1e-a5dd-7118f298886f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:33.984064 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-0e61998b-c198-4e1e-a5dd-7118f298886f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 10 17:38:33.988955 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 439/875] 10.222.0.31 () {56 vars in 1141 bytes} [Mon Jan 10 17:38:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:33.991507 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166e2c3-7c28-4aba-b1ef-d0fb4d33a093 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:34.000842 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166e2c3-7c28-4aba-b1ef-d0fb4d33a093 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:34.005614 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e567f8d-4317-4dc5-bb40-1c32aefde193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:34.006307 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e567f8d-4317-4dc5-bb40-1c32aefde193 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:34.006585 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e567f8d-4317-4dc5-bb40-1c32aefde193 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:34.006855 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e567f8d-4317-4dc5-bb40-1c32aefde193 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:34.007634 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e567f8d-4317-4dc5-bb40-1c32aefde193 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:34.007936 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e567f8d-4317-4dc5-bb40-1c32aefde193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:34.009612 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e567f8d-4317-4dc5-bb40-1c32aefde193 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:34.024412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 437/876] 10.222.0.31 () {56 vars in 1136 bytes} [Mon Jan 10 17:38:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:34.025925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61998b-c198-4e1e-a5dd-7118f298886f admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:34.036166 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61998b-c198-4e1e-a5dd-7118f298886f admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:34.040673 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c4bca-8262-46a9-b2e1-e36a7e23902a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:34.041496 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c4bca-8262-46a9-b2e1-e36a7e23902a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:34.041773 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c4bca-8262-46a9-b2e1-e36a7e23902a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:34.042042 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c4bca-8262-46a9-b2e1-e36a7e23902a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:34.053123 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c4bca-8262-46a9-b2e1-e36a7e23902a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:34.054975 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c4bca-8262-46a9-b2e1-e36a7e23902a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:34.070892 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-972c4bca-8262-46a9-b2e1-e36a7e23902a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:34.076786 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 440/877] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:34.078143 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e567f8d-4317-4dc5-bb40-1c32aefde193 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:34.087834 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e567f8d-4317-4dc5-bb40-1c32aefde193 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:34.092255 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97919e01-8093-4b2c-8b39-59983d5610cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:34.092929 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97919e01-8093-4b2c-8b39-59983d5610cf admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:34.093206 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97919e01-8093-4b2c-8b39-59983d5610cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:34.093476 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97919e01-8093-4b2c-8b39-59983d5610cf admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:34.094207 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97919e01-8093-4b2c-8b39-59983d5610cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:34.094506 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97919e01-8093-4b2c-8b39-59983d5610cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:34.096153 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97919e01-8093-4b2c-8b39-59983d5610cf admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:34.112724 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 438/878] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:34.114127 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c4bca-8262-46a9-b2e1-e36a7e23902a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:34.123939 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c4bca-8262-46a9-b2e1-e36a7e23902a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:34.128486 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11894ebc-0e94-462a-94c1-00ee2ae9e458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:34.129326 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894ebc-0e94-462a-94c1-00ee2ae9e458 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:34.129603 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894ebc-0e94-462a-94c1-00ee2ae9e458 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:34.129876 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894ebc-0e94-462a-94c1-00ee2ae9e458 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:34.138346 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11894ebc-0e94-462a-94c1-00ee2ae9e458 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:34.140535 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11894ebc-0e94-462a-94c1-00ee2ae9e458 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:34.155737 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-11894ebc-0e94-462a-94c1-00ee2ae9e458 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 10 17:38:34.160954 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 441/879] 10.222.0.31 () {56 vars in 1138 bytes} [Mon Jan 10 17:38:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:34.163034 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97919e01-8093-4b2c-8b39-59983d5610cf admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:34.172809 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97919e01-8093-4b2c-8b39-59983d5610cf admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:34.177368 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378e645-1c3a-40ea-b2b4-720a93ccd7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:34.178030 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378e645-1c3a-40ea-b2b4-720a93ccd7df admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:34.178311 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378e645-1c3a-40ea-b2b4-720a93ccd7df admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:34.178576 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378e645-1c3a-40ea-b2b4-720a93ccd7df admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:34.179425 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378e645-1c3a-40ea-b2b4-720a93ccd7df admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:34.179726 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378e645-1c3a-40ea-b2b4-720a93ccd7df admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:34.181589 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378e645-1c3a-40ea-b2b4-720a93ccd7df admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:34.199870 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 439/880] 10.222.0.31 () {56 vars in 1170 bytes} [Mon Jan 10 17:38:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:34.205260 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11894ebc-0e94-462a-94c1-00ee2ae9e458 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:34.208827 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0973d-972c-45e4-b87e-5546df7cddb3 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:34.209150 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0973d-972c-45e4-b87e-5546df7cddb3 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:34.209426 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0973d-972c-45e4-b87e-5546df7cddb3 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:34.211362 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 440/881] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:38:34.215380 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11894ebc-0e94-462a-94c1-00ee2ae9e458 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:34.216080 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8183e-7812-4672-bd99-d4eead4928cc None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:34.216366 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8183e-7812-4672-bd99-d4eead4928cc None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:34.216642 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8183e-7812-4672-bd99-d4eead4928cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:34.220013 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab692a1-f7a0-45ca-a082-f52a08ebb648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:34.220786 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab692a1-f7a0-45ca-a082-f52a08ebb648 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:34.221105 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab692a1-f7a0-45ca-a082-f52a08ebb648 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:34.221379 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab692a1-f7a0-45ca-a082-f52a08ebb648 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:34.229548 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab692a1-f7a0-45ca-a082-f52a08ebb648 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:34.231362 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab692a1-f7a0-45ca-a082-f52a08ebb648 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:34.234441 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-fdd8183e-7812-4672-bd99-d4eead4928cc None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:34.235552 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-fdd8183e-7812-4672-bd99-d4eead4928cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:34.245151 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 442/882] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:34 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:38:34.246506 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 441/883] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:34 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:38:34.246689 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab692a1-f7a0-45ca-a082-f52a08ebb648 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:34.255260 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab692a1-f7a0-45ca-a082-f52a08ebb648 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:34.259683 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b9713-d122-4689-ab6a-50cc61dd659e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:34.260446 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b9713-d122-4689-ab6a-50cc61dd659e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:34.260720 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b9713-d122-4689-ab6a-50cc61dd659e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:34.261023 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b9713-d122-4689-ab6a-50cc61dd659e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:34.270720 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8183e-7812-4672-bd99-d4eead4928cc None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:34.272060 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b9713-d122-4689-ab6a-50cc61dd659e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:34.274293 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b9713-d122-4689-ab6a-50cc61dd659e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:34.280158 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8183e-7812-4672-bd99-d4eead4928cc None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:34.285990 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368d1e9-0ad9-4a0a-808c-0f837a434318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:34.286536 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368d1e9-0ad9-4a0a-808c-0f837a434318 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:34.286815 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368d1e9-0ad9-4a0a-808c-0f837a434318 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:34.287143 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368d1e9-0ad9-4a0a-808c-0f837a434318 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:34.287883 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368d1e9-0ad9-4a0a-808c-0f837a434318 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:34.289576 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368d1e9-0ad9-4a0a-808c-0f837a434318 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:34.290795 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-326b9713-d122-4689-ab6a-50cc61dd659e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:34.292149 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 443/884] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:34.298006 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b9713-d122-4689-ab6a-50cc61dd659e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:34.308940 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 442/885] 10.222.0.31 () {60 vars in 1162 bytes} [Mon Jan 10 17:38:34 2022] POST /identity/v3/services => generated 251 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:38:34.315635 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b9713-d122-4689-ab6a-50cc61dd659e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:34.331584 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c2d7b-9d5f-4707-a00c-150b67186abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:34.332273 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c2d7b-9d5f-4707-a00c-150b67186abf admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:34.332551 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c2d7b-9d5f-4707-a00c-150b67186abf admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:34.332822 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c2d7b-9d5f-4707-a00c-150b67186abf admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:34.333604 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c2d7b-9d5f-4707-a00c-150b67186abf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:34.333905 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c2d7b-9d5f-4707-a00c-150b67186abf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:34.335555 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c2d7b-9d5f-4707-a00c-150b67186abf admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:34.348965 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 444/886] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:34.355060 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368d1e9-0ad9-4a0a-808c-0f837a434318 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:34.366030 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368d1e9-0ad9-4a0a-808c-0f837a434318 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:34.370675 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa37a1-74a5-4b6e-935b-ba00cc5b5ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:34.371548 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa37a1-74a5-4b6e-935b-ba00cc5b5ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:34.371828 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa37a1-74a5-4b6e-935b-ba00cc5b5ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:34.372102 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa37a1-74a5-4b6e-935b-ba00cc5b5ff8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:34.380260 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa37a1-74a5-4b6e-935b-ba00cc5b5ff8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:34.382357 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa37a1-74a5-4b6e-935b-ba00cc5b5ff8 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:34.397373 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-d2fa37a1-74a5-4b6e-935b-ba00cc5b5ff8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:34.403975 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 443/887] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:34.406522 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c2d7b-9d5f-4707-a00c-150b67186abf admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:34.416112 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c2d7b-9d5f-4707-a00c-150b67186abf admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:34.421309 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22a884-e424-4d85-bc9c-f3ee5266c4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:34.422384 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22a884-e424-4d85-bc9c-f3ee5266c4dd admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:34.422912 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22a884-e424-4d85-bc9c-f3ee5266c4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:34.423390 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22a884-e424-4d85-bc9c-f3ee5266c4dd admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:34.424534 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22a884-e424-4d85-bc9c-f3ee5266c4dd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:34.425098 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22a884-e424-4d85-bc9c-f3ee5266c4dd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:34.427343 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22a884-e424-4d85-bc9c-f3ee5266c4dd admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:34.440809 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 445/888] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:34.452218 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa37a1-74a5-4b6e-935b-ba00cc5b5ff8 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:34.462878 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa37a1-74a5-4b6e-935b-ba00cc5b5ff8 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:34.468052 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b5091-d8d8-409e-a14b-e0745055bb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:34.469096 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b5091-d8d8-409e-a14b-e0745055bb7b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:34.469514 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b5091-d8d8-409e-a14b-e0745055bb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:34.470024 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b5091-d8d8-409e-a14b-e0745055bb7b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:34.471069 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b5091-d8d8-409e-a14b-e0745055bb7b admin admin] RBAC: Adding query filter params (role.id=154bb7abbd4e4872b138a1ce5d451348, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=3b3dbe4735a54de1825abc28ecf00b84) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:34.471565 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b5091-d8d8-409e-a14b-e0745055bb7b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:34.473707 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b5091-d8d8-409e-a14b-e0745055bb7b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:34.484629 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 444/889] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:38:34 2022] GET /identity/v3/role_assignments?user.id=3b3dbe4735a54de1825abc28ecf00b84&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=154bb7abbd4e4872b138a1ce5d451348 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:34.492501 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf8229-091f-48a6-8efb-5e2d59652307 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:34.492792 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf8229-091f-48a6-8efb-5e2d59652307 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:34.493128 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf8229-091f-48a6-8efb-5e2d59652307 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:34.495261 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 446/890] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:38:34.502868 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b1b03-fd47-4f5d-bca5-90873e940da2 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:34.503179 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b1b03-fd47-4f5d-bca5-90873e940da2 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:34.503435 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b1b03-fd47-4f5d-bca5-90873e940da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:34.523650 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-f15b1b03-fd47-4f5d-bca5-90873e940da2 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:34.524897 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f15b1b03-fd47-4f5d-bca5-90873e940da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:34.533840 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 445/891] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:34 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:34.557254 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf8229-091f-48a6-8efb-5e2d59652307 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:34.570737 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf8229-091f-48a6-8efb-5e2d59652307 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:34.576215 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7fa4a-d466-4b33-b93f-9173b05a54db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:34.577101 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7fa4a-d466-4b33-b93f-9173b05a54db admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:34.577385 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7fa4a-d466-4b33-b93f-9173b05a54db admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:34.577661 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7fa4a-d466-4b33-b93f-9173b05a54db admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:34.578347 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7fa4a-d466-4b33-b93f-9173b05a54db admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:34.580072 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7fa4a-d466-4b33-b93f-9173b05a54db admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:34.592458 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-7ca7fa4a-d466-4b33-b93f-9173b05a54db admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 10 17:38:34.594172 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 447/892] 10.222.0.31 () {56 vars in 1147 bytes} [Mon Jan 10 17:38:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:34.600802 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b1b03-fd47-4f5d-bca5-90873e940da2 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:34.610802 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b1b03-fd47-4f5d-bca5-90873e940da2 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:34.616330 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f727019-9993-4e33-8e39-816f81f812bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:34.617081 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f727019-9993-4e33-8e39-816f81f812bc admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:34.617375 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f727019-9993-4e33-8e39-816f81f812bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:34.617646 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f727019-9993-4e33-8e39-816f81f812bc admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:34.618406 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f727019-9993-4e33-8e39-816f81f812bc admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:34.618712 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f727019-9993-4e33-8e39-816f81f812bc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:34.620387 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f727019-9993-4e33-8e39-816f81f812bc admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:34.626286 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 446/893] 10.222.0.31 () {56 vars in 1143 bytes} [Mon Jan 10 17:38:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:34.632625 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7fa4a-d466-4b33-b93f-9173b05a54db admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:34.645331 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7fa4a-d466-4b33-b93f-9173b05a54db admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:34.653556 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401625e0-ee87-45c9-bce1-8de2d02d48c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:34.654272 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401625e0-ee87-45c9-bce1-8de2d02d48c0 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:34.654556 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401625e0-ee87-45c9-bce1-8de2d02d48c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:34.654831 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401625e0-ee87-45c9-bce1-8de2d02d48c0 admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:34.655575 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401625e0-ee87-45c9-bce1-8de2d02d48c0 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:34.655883 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401625e0-ee87-45c9-bce1-8de2d02d48c0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:34.657622 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401625e0-ee87-45c9-bce1-8de2d02d48c0 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:34.663252 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 448/894] 10.222.0.31 () {56 vars in 1143 bytes} [Mon Jan 10 17:38:34 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:35.056540 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03645c53-7a9f-44e4-8a8b-4bffa549fcfc None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:35.057140 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03645c53-7a9f-44e4-8a8b-4bffa549fcfc None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:35.057140 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03645c53-7a9f-44e4-8a8b-4bffa549fcfc None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:35.059153 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 447/895] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:35.064573 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b1b5c-5537-4e2e-8a39-57cc40dddc45 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:35.065417 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b1b5c-5537-4e2e-8a39-57cc40dddc45 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:35.065904 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b1b5c-5537-4e2e-8a39-57cc40dddc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:35.083924 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-829b1b5c-5537-4e2e-8a39-57cc40dddc45 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:35.085409 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-829b1b5c-5537-4e2e-8a39-57cc40dddc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:35.093528 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 449/896] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:35 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:38:35.117589 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03645c53-7a9f-44e4-8a8b-4bffa549fcfc None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:35.130035 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03645c53-7a9f-44e4-8a8b-4bffa549fcfc None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:35.134667 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2656d-2bae-4d61-a5e2-13b22d1d9537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:35.135702 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2656d-2bae-4d61-a5e2-13b22d1d9537 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:35.136216 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2656d-2bae-4d61-a5e2-13b22d1d9537 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:35.136681 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2656d-2bae-4d61-a5e2-13b22d1d9537 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:35.137562 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2656d-2bae-4d61-a5e2-13b22d1d9537 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:35.139349 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2656d-2bae-4d61-a5e2-13b22d1d9537 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:35.151891 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-8bc2656d-2bae-4d61-a5e2-13b22d1d9537 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 10 17:38:35.153665 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 448/897] 10.222.0.31 () {56 vars in 1153 bytes} [Mon Jan 10 17:38:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:35.159991 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b1b5c-5537-4e2e-8a39-57cc40dddc45 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:35.169601 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b1b5c-5537-4e2e-8a39-57cc40dddc45 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:35.175402 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d1c66-da89-4af0-93f7-7dc1ff1f8b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:35.176350 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d1c66-da89-4af0-93f7-7dc1ff1f8b14 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:35.176877 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d1c66-da89-4af0-93f7-7dc1ff1f8b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:35.177347 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d1c66-da89-4af0-93f7-7dc1ff1f8b14 admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:35.178295 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d1c66-da89-4af0-93f7-7dc1ff1f8b14 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:35.178835 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d1c66-da89-4af0-93f7-7dc1ff1f8b14 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:35.180678 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d1c66-da89-4af0-93f7-7dc1ff1f8b14 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:35.186084 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 450/898] 10.222.0.31 () {56 vars in 1147 bytes} [Mon Jan 10 17:38:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:35.192045 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2656d-2bae-4d61-a5e2-13b22d1d9537 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:35.201897 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2656d-2bae-4d61-a5e2-13b22d1d9537 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:35.206660 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfab5c-8e6d-4d9d-b32b-f0b3cfc78513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:35.207557 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfab5c-8e6d-4d9d-b32b-f0b3cfc78513 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:35.208047 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfab5c-8e6d-4d9d-b32b-f0b3cfc78513 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:35.208514 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfab5c-8e6d-4d9d-b32b-f0b3cfc78513 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:35.209452 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfab5c-8e6d-4d9d-b32b-f0b3cfc78513 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:35.209946 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfab5c-8e6d-4d9d-b32b-f0b3cfc78513 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:35.211725 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfab5c-8e6d-4d9d-b32b-f0b3cfc78513 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:35.217404 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 449/899] 10.222.0.31 () {56 vars in 1147 bytes} [Mon Jan 10 17:38:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:35.223332 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d1c66-da89-4af0-93f7-7dc1ff1f8b14 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:35.233504 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d1c66-da89-4af0-93f7-7dc1ff1f8b14 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:35.238431 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5191e7-ccf2-464a-92b6-ddd4816590b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:35.239371 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5191e7-ccf2-464a-92b6-ddd4816590b1 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:35.239846 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5191e7-ccf2-464a-92b6-ddd4816590b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:35.240310 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5191e7-ccf2-464a-92b6-ddd4816590b1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:35.241378 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5191e7-ccf2-464a-92b6-ddd4816590b1 admin admin] RBAC: Adding query filter params (interface=public, service_id=9ba43b7218ad42c9ad83e9e40e56a457, region_id=RegionOne) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:35.241939 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5191e7-ccf2-464a-92b6-ddd4816590b1 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:35.243797 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5191e7-ccf2-464a-92b6-ddd4816590b1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:35.249856 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 451/900] 10.222.0.31 () {56 vars in 1272 bytes} [Mon Jan 10 17:38:35 2022] GET /identity/v3/endpoints?service_id=9ba43b7218ad42c9ad83e9e40e56a457&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:35.255427 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfab5c-8e6d-4d9d-b32b-f0b3cfc78513 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:35.265824 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfab5c-8e6d-4d9d-b32b-f0b3cfc78513 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:35.270797 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3b0c7-28b6-42ec-ad1a-7b52c36acc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:35.271851 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3b0c7-28b6-42ec-ad1a-7b52c36acc5d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:35.272334 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3b0c7-28b6-42ec-ad1a-7b52c36acc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:35.272842 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3b0c7-28b6-42ec-ad1a-7b52c36acc5d admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:35.274169 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3b0c7-28b6-42ec-ad1a-7b52c36acc5d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:35.276064 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3b0c7-28b6-42ec-ad1a-7b52c36acc5d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:35.282620 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 450/901] 10.222.0.31 () {56 vars in 1108 bytes} [Mon Jan 10 17:38:35 2022] GET /identity/v3/services => generated 1268 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:38:36.830858 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2158e-67ee-471f-a7a9-ef1ab18dd64c None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:36.831380 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2158e-67ee-471f-a7a9-ef1ab18dd64c None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:36.831380 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2158e-67ee-471f-a7a9-ef1ab18dd64c None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:36.833448 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 452/902] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:36.838754 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470223d-fc2a-4526-886e-cff8ccbe1a4c None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:36.839145 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470223d-fc2a-4526-886e-cff8ccbe1a4c None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:36.839323 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470223d-fc2a-4526-886e-cff8ccbe1a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:36.857205 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-4470223d-fc2a-4526-886e-cff8ccbe1a4c None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:36.858393 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-4470223d-fc2a-4526-886e-cff8ccbe1a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:36.866443 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 451/903] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:36 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:36.890990 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2158e-67ee-471f-a7a9-ef1ab18dd64c None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:36.901930 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12787419-9f42-45be-9641-b578900b4327 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:36.902213 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12787419-9f42-45be-9641-b578900b4327 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:36.902489 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12787419-9f42-45be-9641-b578900b4327 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:36.903908 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2158e-67ee-471f-a7a9-ef1ab18dd64c None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:36.904596 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 452/904] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:36.908398 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec96de8-f5ea-45a6-a1e0-8db7e2abc355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:36.909264 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec96de8-f5ea-45a6-a1e0-8db7e2abc355 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:36.909451 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b8f3f-2fa7-40fb-9e69-cf702086f644 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:36.909544 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec96de8-f5ea-45a6-a1e0-8db7e2abc355 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:36.909706 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b8f3f-2fa7-40fb-9e69-cf702086f644 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:36.909798 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec96de8-f5ea-45a6-a1e0-8db7e2abc355 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:36.909979 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b8f3f-2fa7-40fb-9e69-cf702086f644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:36.910476 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec96de8-f5ea-45a6-a1e0-8db7e2abc355 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:36.912290 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec96de8-f5ea-45a6-a1e0-8db7e2abc355 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:36.923745 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-cec96de8-f5ea-45a6-a1e0-8db7e2abc355 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 10 17:38:36.925230 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 453/905] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:38:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:36.931311 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec96de8-f5ea-45a6-a1e0-8db7e2abc355 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:36.932589 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-d15b8f3f-2fa7-40fb-9e69-cf702086f644 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:36.933774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-d15b8f3f-2fa7-40fb-9e69-cf702086f644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:36.943771 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec96de8-f5ea-45a6-a1e0-8db7e2abc355 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:36.943908 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 453/906] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:36 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:38:36.951000 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f145c-837b-4028-ac5a-c7155ed217cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:36.951579 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f145c-837b-4028-ac5a-c7155ed217cc admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:36.951865 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f145c-837b-4028-ac5a-c7155ed217cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:36.952139 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f145c-837b-4028-ac5a-c7155ed217cc admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:36.952884 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f145c-837b-4028-ac5a-c7155ed217cc admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:36.953206 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f145c-837b-4028-ac5a-c7155ed217cc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:36.954824 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f145c-837b-4028-ac5a-c7155ed217cc admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:36.960178 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 454/907] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:38:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:36.965801 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b8f3f-2fa7-40fb-9e69-cf702086f644 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:36.971625 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f145c-837b-4028-ac5a-c7155ed217cc admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:36.976115 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b8f3f-2fa7-40fb-9e69-cf702086f644 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:36.981040 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c019873-9c17-4735-87e9-2c4dfc6d05c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:36.981931 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c019873-9c17-4735-87e9-2c4dfc6d05c3 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:36.982397 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c019873-9c17-4735-87e9-2c4dfc6d05c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:36.982851 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c019873-9c17-4735-87e9-2c4dfc6d05c3 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:36.983808 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c019873-9c17-4735-87e9-2c4dfc6d05c3 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:36.984310 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c019873-9c17-4735-87e9-2c4dfc6d05c3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:36.986160 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c019873-9c17-4735-87e9-2c4dfc6d05c3 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:36.986337 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f145c-837b-4028-ac5a-c7155ed217cc admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:36.995159 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 454/908] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:38:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:36.997300 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c676a3-daa2-4b7c-a4df-a0ba828cc780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:36.998894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c676a3-daa2-4b7c-a4df-a0ba828cc780 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:36.999595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c676a3-daa2-4b7c-a4df-a0ba828cc780 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.000275 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c676a3-daa2-4b7c-a4df-a0ba828cc780 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.001996 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c019873-9c17-4735-87e9-2c4dfc6d05c3 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:37.011582 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c019873-9c17-4735-87e9-2c4dfc6d05c3 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:37.013826 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c676a3-daa2-4b7c-a4df-a0ba828cc780 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:37.016430 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e36634-d860-4c73-b5e6-8ff04b67cefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:37.017372 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36634-d860-4c73-b5e6-8ff04b67cefb admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:37.017856 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36634-d860-4c73-b5e6-8ff04b67cefb admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.018314 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36634-d860-4c73-b5e6-8ff04b67cefb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.019311 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e36634-d860-4c73-b5e6-8ff04b67cefb admin admin] RBAC: Adding query filter params (interface=public, service_id=f3166d03c77945b696987e77fc582b32, region_id=RegionOne) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:37.019814 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e36634-d860-4c73-b5e6-8ff04b67cefb admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:37.021604 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e36634-d860-4c73-b5e6-8ff04b67cefb admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:37.022087 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-15c676a3-daa2-4b7c-a4df-a0ba828cc780 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 10 17:38:37.024527 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 455/909] 10.222.0.31 () {56 vars in 1141 bytes} [Mon Jan 10 17:38:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:37.032515 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c676a3-daa2-4b7c-a4df-a0ba828cc780 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:37.032812 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 455/910] 10.222.0.31 () {56 vars in 1272 bytes} [Mon Jan 10 17:38:37 2022] GET /identity/v3/endpoints?service_id=f3166d03c77945b696987e77fc582b32&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:37.034257 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e36634-d860-4c73-b5e6-8ff04b67cefb admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:37.043899 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e36634-d860-4c73-b5e6-8ff04b67cefb admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:37.045284 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c676a3-daa2-4b7c-a4df-a0ba828cc780 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:37.049697 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c96a5-4ae7-4983-9092-704ceac5d65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:37.050620 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c96a5-4ae7-4983-9092-704ceac5d65c admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:37.051035 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c96a5-4ae7-4983-9092-704ceac5d65c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.051245 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b4e29-8f69-4472-b190-bdc6c94d6265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:37.051721 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c96a5-4ae7-4983-9092-704ceac5d65c admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.052464 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b4e29-8f69-4472-b190-bdc6c94d6265 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:37.052705 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c96a5-4ae7-4983-9092-704ceac5d65c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:37.053137 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b4e29-8f69-4472-b190-bdc6c94d6265 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.053667 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b4e29-8f69-4472-b190-bdc6c94d6265 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.054767 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c96a5-4ae7-4983-9092-704ceac5d65c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:37.055100 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b4e29-8f69-4472-b190-bdc6c94d6265 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:37.055729 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b4e29-8f69-4472-b190-bdc6c94d6265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:37.057986 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b4e29-8f69-4472-b190-bdc6c94d6265 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:37.067830 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 456/912] 10.222.0.31 () {56 vars in 1136 bytes} [Mon Jan 10 17:38:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:37.068134 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 456/912] 10.222.0.31 () {56 vars in 1108 bytes} [Mon Jan 10 17:38:37 2022] GET /identity/v3/services => generated 1268 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:38:37.073614 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b4e29-8f69-4472-b190-bdc6c94d6265 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:37.084312 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b4e29-8f69-4472-b190-bdc6c94d6265 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:37.084769 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa7ddc-19c1-46e0-b427-fb703b3b918f None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:37.085099 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa7ddc-19c1-46e0-b427-fb703b3b918f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.085375 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa7ddc-19c1-46e0-b427-fb703b3b918f None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.089503 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bda85-07dc-4d52-88b4-45f214f1a0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:37.090462 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bda85-07dc-4d52-88b4-45f214f1a0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:37.090844 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bda85-07dc-4d52-88b4-45f214f1a0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.091241 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bda85-07dc-4d52-88b4-45f214f1a0b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.091637 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 457/913] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:38:37.093416 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06240b12-186e-4f4f-b7b5-5ec3f049df76 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:37.093772 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06240b12-186e-4f4f-b7b5-5ec3f049df76 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.094156 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06240b12-186e-4f4f-b7b5-5ec3f049df76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.104206 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bda85-07dc-4d52-88b4-45f214f1a0b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:37.106229 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bda85-07dc-4d52-88b4-45f214f1a0b1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:37.114506 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-06240b12-186e-4f4f-b7b5-5ec3f049df76 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:37.115810 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-06240b12-186e-4f4f-b7b5-5ec3f049df76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:37.124148 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-8f0bda85-07dc-4d52-88b4-45f214f1a0b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:37.125864 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 457/914] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:37.131665 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bda85-07dc-4d52-88b4-45f214f1a0b1 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:37.133021 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 458/915] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:37 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:38:37.142261 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bda85-07dc-4d52-88b4-45f214f1a0b1 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:37.148515 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44694ac9-f248-4a7e-be5e-609178aa6686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:37.149288 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06240b12-186e-4f4f-b7b5-5ec3f049df76 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:37.149481 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44694ac9-f248-4a7e-be5e-609178aa6686 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:37.149680 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44694ac9-f248-4a7e-be5e-609178aa6686 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.149961 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44694ac9-f248-4a7e-be5e-609178aa6686 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.150727 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44694ac9-f248-4a7e-be5e-609178aa6686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:37.151035 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44694ac9-f248-4a7e-be5e-609178aa6686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:37.152774 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44694ac9-f248-4a7e-be5e-609178aa6686 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:37.159377 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06240b12-186e-4f4f-b7b5-5ec3f049df76 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:37.166786 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b58b71-7598-4883-849a-b09dd6f41866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:37.167173 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 458/916] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:37.167509 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b58b71-7598-4883-849a-b09dd6f41866 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:37.167790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b58b71-7598-4883-849a-b09dd6f41866 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.168110 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b58b71-7598-4883-849a-b09dd6f41866 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.168907 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b58b71-7598-4883-849a-b09dd6f41866 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:37.170661 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b58b71-7598-4883-849a-b09dd6f41866 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:37.172826 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44694ac9-f248-4a7e-be5e-609178aa6686 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:37.183562 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44694ac9-f248-4a7e-be5e-609178aa6686 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:37.189729 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e59e36-810e-4bed-84ec-c8cafa418670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:37.190565 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e59e36-810e-4bed-84ec-c8cafa418670 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:37.190846 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e59e36-810e-4bed-84ec-c8cafa418670 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.191120 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e59e36-810e-4bed-84ec-c8cafa418670 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.192932 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 459/917] 10.222.0.31 () {60 vars in 1162 bytes} [Mon Jan 10 17:38:37 2022] POST /identity/v3/services => generated 241 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:38:37.205625 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e59e36-810e-4bed-84ec-c8cafa418670 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:37.207909 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e59e36-810e-4bed-84ec-c8cafa418670 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:37.225355 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-75e59e36-810e-4bed-84ec-c8cafa418670 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 10 17:38:37.227039 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 459/918] 10.222.0.31 () {56 vars in 1138 bytes} [Mon Jan 10 17:38:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:37.233562 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b58b71-7598-4883-849a-b09dd6f41866 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:37.256305 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b58b71-7598-4883-849a-b09dd6f41866 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:37.261152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cde1e-20fb-4c50-b16b-6020e0ae3b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:37.261904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cde1e-20fb-4c50-b16b-6020e0ae3b9d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:37.262189 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cde1e-20fb-4c50-b16b-6020e0ae3b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.262464 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cde1e-20fb-4c50-b16b-6020e0ae3b9d admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.263397 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200cde1e-20fb-4c50-b16b-6020e0ae3b9d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:37.263711 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200cde1e-20fb-4c50-b16b-6020e0ae3b9d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:37.265755 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200cde1e-20fb-4c50-b16b-6020e0ae3b9d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:37.291576 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 460/919] 10.222.0.31 () {56 vars in 1170 bytes} [Mon Jan 10 17:38:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:37.297045 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e59e36-810e-4bed-84ec-c8cafa418670 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:37.310741 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e59e36-810e-4bed-84ec-c8cafa418670 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:37.315942 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3411ba6-6dc9-46a6-b77d-b9c87895528a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:37.316775 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3411ba6-6dc9-46a6-b77d-b9c87895528a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:37.317123 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3411ba6-6dc9-46a6-b77d-b9c87895528a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.317489 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3411ba6-6dc9-46a6-b77d-b9c87895528a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.333780 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3411ba6-6dc9-46a6-b77d-b9c87895528a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:37.336811 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3411ba6-6dc9-46a6-b77d-b9c87895528a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:37.363168 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-d3411ba6-6dc9-46a6-b77d-b9c87895528a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:37.364783 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 460/920] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:37.371210 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cde1e-20fb-4c50-b16b-6020e0ae3b9d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:37.383411 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cde1e-20fb-4c50-b16b-6020e0ae3b9d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:37.388357 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1181bc-d9b2-4293-9d0a-67767f8bfdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:37.389089 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1181bc-d9b2-4293-9d0a-67767f8bfdbc admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:37.389411 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1181bc-d9b2-4293-9d0a-67767f8bfdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.389688 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1181bc-d9b2-4293-9d0a-67767f8bfdbc admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.390469 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1181bc-d9b2-4293-9d0a-67767f8bfdbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:37.390832 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1181bc-d9b2-4293-9d0a-67767f8bfdbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:37.392601 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1181bc-d9b2-4293-9d0a-67767f8bfdbc admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:37.406446 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 461/921] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:37.412459 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3411ba6-6dc9-46a6-b77d-b9c87895528a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:37.422849 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3411ba6-6dc9-46a6-b77d-b9c87895528a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:37.427894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8679d7-11f4-4318-97fd-491b305c55f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:37.429061 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8679d7-11f4-4318-97fd-491b305c55f4 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:37.429539 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8679d7-11f4-4318-97fd-491b305c55f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.430031 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8679d7-11f4-4318-97fd-491b305c55f4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.438044 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8679d7-11f4-4318-97fd-491b305c55f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:37.440548 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8679d7-11f4-4318-97fd-491b305c55f4 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:37.454986 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-0b8679d7-11f4-4318-97fd-491b305c55f4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:37.461008 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 461/922] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:37.463159 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1181bc-d9b2-4293-9d0a-67767f8bfdbc admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:37.473317 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1181bc-d9b2-4293-9d0a-67767f8bfdbc admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:37.478081 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79e7e8-9e38-45dc-a8f6-d5d1ac5a3a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:37.478969 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79e7e8-9e38-45dc-a8f6-d5d1ac5a3a54 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:37.479439 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79e7e8-9e38-45dc-a8f6-d5d1ac5a3a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.479913 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79e7e8-9e38-45dc-a8f6-d5d1ac5a3a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.480927 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79e7e8-9e38-45dc-a8f6-d5d1ac5a3a54 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:37.481433 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79e7e8-9e38-45dc-a8f6-d5d1ac5a3a54 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:37.483476 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79e7e8-9e38-45dc-a8f6-d5d1ac5a3a54 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:37.496868 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 462/923] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:37.502872 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8679d7-11f4-4318-97fd-491b305c55f4 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:37.514244 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8679d7-11f4-4318-97fd-491b305c55f4 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:37.518836 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a1ffb-3d50-4077-9bd7-6eecd3723b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:37.519726 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a1ffb-3d50-4077-9bd7-6eecd3723b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:37.520006 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a1ffb-3d50-4077-9bd7-6eecd3723b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.520281 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a1ffb-3d50-4077-9bd7-6eecd3723b88 admin admin] PATH_INFO: `/v3/projects/1415eea0335a49bf800e8215498af679/users/3b3dbe4735a54de1825abc28ecf00b84/roles/154bb7abbd4e4872b138a1ce5d451348` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.522532 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a1ffb-3d50-4077-9bd7-6eecd3723b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1415eea0335a49bf800e8215498af679, user_id=3b3dbe4735a54de1825abc28ecf00b84, role_id=154bb7abbd4e4872b138a1ce5d451348)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:37.525581 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a1ffb-3d50-4077-9bd7-6eecd3723b88 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:37.542643 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 462/924] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:38:37 2022] PUT /identity/v3/projects/1415eea0335a49bf800e8215498af679/users/3b3dbe4735a54de1825abc28ecf00b84/roles/154bb7abbd4e4872b138a1ce5d451348 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:38:37.687048 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f509ab-34bf-45ca-8914-ef25b4024dd1 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:37.687416 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f509ab-34bf-45ca-8914-ef25b4024dd1 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.687602 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f509ab-34bf-45ca-8914-ef25b4024dd1 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.689904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 463/925] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:37.695694 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f6042-8dff-40b4-b413-7afab8891fb9 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:37.695973 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f6042-8dff-40b4-b413-7afab8891fb9 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.696250 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f6042-8dff-40b4-b413-7afab8891fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.714675 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-ab2f6042-8dff-40b4-b413-7afab8891fb9 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:37.718148 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-ab2f6042-8dff-40b4-b413-7afab8891fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:37.786522 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 463/926] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:37 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:37.810731 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f509ab-34bf-45ca-8914-ef25b4024dd1 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:37.824594 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f509ab-34bf-45ca-8914-ef25b4024dd1 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:37.829025 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abbc6b-56ce-44ed-8273-1a8053598c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:37.829864 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abbc6b-56ce-44ed-8273-1a8053598c83 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:37.830144 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abbc6b-56ce-44ed-8273-1a8053598c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.830416 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abbc6b-56ce-44ed-8273-1a8053598c83 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.831084 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abbc6b-56ce-44ed-8273-1a8053598c83 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:37.832674 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abbc6b-56ce-44ed-8273-1a8053598c83 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:37.843875 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-77abbc6b-56ce-44ed-8273-1a8053598c83 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 10 17:38:37.845426 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 464/927] 10.222.0.31 () {56 vars in 1153 bytes} [Mon Jan 10 17:38:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:37.851156 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f6042-8dff-40b4-b413-7afab8891fb9 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:37.860411 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f6042-8dff-40b4-b413-7afab8891fb9 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:37.865168 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51a4f3-5824-41bd-909a-3dba8f99ef14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:37.865929 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51a4f3-5824-41bd-909a-3dba8f99ef14 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:37.866215 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51a4f3-5824-41bd-909a-3dba8f99ef14 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.866485 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51a4f3-5824-41bd-909a-3dba8f99ef14 admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.867211 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51a4f3-5824-41bd-909a-3dba8f99ef14 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:37.867513 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51a4f3-5824-41bd-909a-3dba8f99ef14 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:37.869178 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51a4f3-5824-41bd-909a-3dba8f99ef14 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:37.874446 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 464/928] 10.222.0.31 () {56 vars in 1147 bytes} [Mon Jan 10 17:38:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:37.879891 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abbc6b-56ce-44ed-8273-1a8053598c83 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:37.889813 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abbc6b-56ce-44ed-8273-1a8053598c83 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:37.894567 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a694526-4021-460c-8dc5-1cc706098cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:37.895217 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a694526-4021-460c-8dc5-1cc706098cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:37.895552 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a694526-4021-460c-8dc5-1cc706098cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.895826 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a694526-4021-460c-8dc5-1cc706098cc1 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.896546 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a694526-4021-460c-8dc5-1cc706098cc1 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:37.896945 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a694526-4021-460c-8dc5-1cc706098cc1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:37.898939 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a694526-4021-460c-8dc5-1cc706098cc1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:37.904275 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 465/929] 10.222.0.31 () {56 vars in 1147 bytes} [Mon Jan 10 17:38:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:37.910002 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51a4f3-5824-41bd-909a-3dba8f99ef14 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:37.922092 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51a4f3-5824-41bd-909a-3dba8f99ef14 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:37.926629 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afb41e-65f8-49bb-a909-9e53ded2f0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:37.927278 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afb41e-65f8-49bb-a909-9e53ded2f0ca admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:37.927557 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afb41e-65f8-49bb-a909-9e53ded2f0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:37.927828 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afb41e-65f8-49bb-a909-9e53ded2f0ca admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:37.928584 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afb41e-65f8-49bb-a909-9e53ded2f0ca admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:37.930231 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afb41e-65f8-49bb-a909-9e53ded2f0ca admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:37.951480 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 465/930] 10.222.0.31 () {60 vars in 1165 bytes} [Mon Jan 10 17:38:37 2022] POST /identity/v3/endpoints => generated 347 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:38:39.583584 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aaeb14-d610-4557-a431-26d8a4d13098 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:39.584118 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aaeb14-d610-4557-a431-26d8a4d13098 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:39.584118 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aaeb14-d610-4557-a431-26d8a4d13098 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:39.586199 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 466/931] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:39.591596 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767a766-6731-449e-bc48-7aa45b376377 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:39.592013 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767a766-6731-449e-bc48-7aa45b376377 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:39.592179 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767a766-6731-449e-bc48-7aa45b376377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:39.610114 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-5767a766-6731-449e-bc48-7aa45b376377 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:39.611353 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-5767a766-6731-449e-bc48-7aa45b376377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:39.628716 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 466/932] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:39 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:38:39.653958 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aaeb14-d610-4557-a431-26d8a4d13098 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:39.666467 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aaeb14-d610-4557-a431-26d8a4d13098 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:39.670901 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca8b27-710f-4872-b51b-59c4cca16364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:39.671691 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca8b27-710f-4872-b51b-59c4cca16364 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:39.671972 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca8b27-710f-4872-b51b-59c4cca16364 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:39.672470 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca8b27-710f-4872-b51b-59c4cca16364 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:39.673179 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca8b27-710f-4872-b51b-59c4cca16364 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:39.674833 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca8b27-710f-4872-b51b-59c4cca16364 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:39.682950 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1246183-bb0a-4c33-87a4-b97e96cca373 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:39.683241 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1246183-bb0a-4c33-87a4-b97e96cca373 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:39.683522 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1246183-bb0a-4c33-87a4-b97e96cca373 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:39.685564 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 467/933] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:38:39.689566 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-35ca8b27-710f-4872-b51b-59c4cca16364 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 10 17:38:39.691086 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 467/934] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:38:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:39.693956 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635b8a1-e7c3-479d-b66d-8af40abdb26c None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:39.694246 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635b8a1-e7c3-479d-b66d-8af40abdb26c None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:39.694521 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635b8a1-e7c3-479d-b66d-8af40abdb26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:39.696804 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca8b27-710f-4872-b51b-59c4cca16364 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:39.707994 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca8b27-710f-4872-b51b-59c4cca16364 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:39.712799 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c26f35-a2dd-40db-a333-c075956d8d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:39.713087 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-1635b8a1-e7c3-479d-b66d-8af40abdb26c None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:39.713484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c26f35-a2dd-40db-a333-c075956d8d93 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:39.713761 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c26f35-a2dd-40db-a333-c075956d8d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:39.714030 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c26f35-a2dd-40db-a333-c075956d8d93 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:39.714232 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-1635b8a1-e7c3-479d-b66d-8af40abdb26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:39.714744 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c26f35-a2dd-40db-a333-c075956d8d93 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:39.715046 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c26f35-a2dd-40db-a333-c075956d8d93 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:39.716623 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c26f35-a2dd-40db-a333-c075956d8d93 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:39.725638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 468/936] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:39 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:39.725790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 468/936] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:38:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:39.732971 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c26f35-a2dd-40db-a333-c075956d8d93 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:39.737996 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c26f35-a2dd-40db-a333-c075956d8d93 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:39.742564 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e127d3c-c31d-49e6-b212-b460b266b7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:39.743325 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e127d3c-c31d-49e6-b212-b460b266b7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:39.743695 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e127d3c-c31d-49e6-b212-b460b266b7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:39.744061 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e127d3c-c31d-49e6-b212-b460b266b7c8 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:39.744917 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e127d3c-c31d-49e6-b212-b460b266b7c8 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:39.745316 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e127d3c-c31d-49e6-b212-b460b266b7c8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:39.746991 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e127d3c-c31d-49e6-b212-b460b266b7c8 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:39.752818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635b8a1-e7c3-479d-b66d-8af40abdb26c None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:39.756877 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 469/937] 10.222.0.31 () {56 vars in 1135 bytes} [Mon Jan 10 17:38:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:39.758176 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e127d3c-c31d-49e6-b212-b460b266b7c8 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:39.762871 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635b8a1-e7c3-479d-b66d-8af40abdb26c None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:39.768785 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e127d3c-c31d-49e6-b212-b460b266b7c8 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:39.770867 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda9632-456a-4c07-a0ea-42f560422830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:39.771762 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda9632-456a-4c07-a0ea-42f560422830 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:39.772186 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda9632-456a-4c07-a0ea-42f560422830 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:39.772600 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda9632-456a-4c07-a0ea-42f560422830 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:39.774000 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda9632-456a-4c07-a0ea-42f560422830 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:39.775405 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62f993-fae4-4a72-aa89-429c9ef32680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:39.776247 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62f993-fae4-4a72-aa89-429c9ef32680 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:39.776507 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda9632-456a-4c07-a0ea-42f560422830 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:39.776931 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62f993-fae4-4a72-aa89-429c9ef32680 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:39.777555 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62f993-fae4-4a72-aa89-429c9ef32680 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:39.778698 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62f993-fae4-4a72-aa89-429c9ef32680 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:39.780120 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING py.warnings [None req-fa62f993-fae4-4a72-aa89-429c9ef32680 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:38:39.780120 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: warnings.warn(msg) Jan 10 17:38:39.780120 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: Jan 10 17:38:39.781633 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62f993-fae4-4a72-aa89-429c9ef32680 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:39.795173 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-beda9632-456a-4c07-a0ea-42f560422830 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 10 17:38:39.802509 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 469/938] 10.222.0.31 () {56 vars in 1147 bytes} [Mon Jan 10 17:38:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:39.804496 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 470/939] 10.222.0.31 () {60 vars in 1165 bytes} [Mon Jan 10 17:38:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:38:39.809137 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda9632-456a-4c07-a0ea-42f560422830 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:39.824002 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda9632-456a-4c07-a0ea-42f560422830 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:39.839363 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c32dd-69db-4889-b3c9-f82cfc2c2426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:39.839950 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c32dd-69db-4889-b3c9-f82cfc2c2426 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:39.840234 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c32dd-69db-4889-b3c9-f82cfc2c2426 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:39.840510 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c32dd-69db-4889-b3c9-f82cfc2c2426 admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:39.841775 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c32dd-69db-4889-b3c9-f82cfc2c2426 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:39.842280 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c32dd-69db-4889-b3c9-f82cfc2c2426 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:39.845026 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c32dd-69db-4889-b3c9-f82cfc2c2426 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:39.851567 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 470/940] 10.222.0.31 () {56 vars in 1143 bytes} [Mon Jan 10 17:38:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:39.858724 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62f993-fae4-4a72-aa89-429c9ef32680 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:39.870127 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62f993-fae4-4a72-aa89-429c9ef32680 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:39.874892 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450fd5f-f97d-4785-95ef-88c4e2be5a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:39.875630 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450fd5f-f97d-4785-95ef-88c4e2be5a57 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:39.875980 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450fd5f-f97d-4785-95ef-88c4e2be5a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:39.876245 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450fd5f-f97d-4785-95ef-88c4e2be5a57 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:39.877051 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450fd5f-f97d-4785-95ef-88c4e2be5a57 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:39.877359 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450fd5f-f97d-4785-95ef-88c4e2be5a57 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:39.879045 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450fd5f-f97d-4785-95ef-88c4e2be5a57 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:39.885301 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 471/941] 10.222.0.31 () {56 vars in 1143 bytes} [Mon Jan 10 17:38:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:39.893461 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c32dd-69db-4889-b3c9-f82cfc2c2426 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:39.903962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c32dd-69db-4889-b3c9-f82cfc2c2426 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:39.908823 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27ebf9-05a1-43c4-ba92-dfacdd91b144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:39.909522 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27ebf9-05a1-43c4-ba92-dfacdd91b144 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:39.909804 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27ebf9-05a1-43c4-ba92-dfacdd91b144 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:39.910133 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27ebf9-05a1-43c4-ba92-dfacdd91b144 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:39.910959 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27ebf9-05a1-43c4-ba92-dfacdd91b144 admin admin] RBAC: Adding query filter params (interface=public, service_id=d44143a1fbd54d289ec1cec38439b3b3, region_id=RegionOne) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:39.911269 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27ebf9-05a1-43c4-ba92-dfacdd91b144 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:39.913076 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27ebf9-05a1-43c4-ba92-dfacdd91b144 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:39.919323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 471/942] 10.222.0.31 () {56 vars in 1272 bytes} [Mon Jan 10 17:38:39 2022] GET /identity/v3/endpoints?service_id=d44143a1fbd54d289ec1cec38439b3b3&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:39.925245 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450fd5f-f97d-4785-95ef-88c4e2be5a57 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:39.935825 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450fd5f-f97d-4785-95ef-88c4e2be5a57 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:39.940819 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bfca3-eb8c-4ee4-8987-4776ec393899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:39.941561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bfca3-eb8c-4ee4-8987-4776ec393899 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:39.941841 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bfca3-eb8c-4ee4-8987-4776ec393899 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:39.942115 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bfca3-eb8c-4ee4-8987-4776ec393899 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:39.942827 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bfca3-eb8c-4ee4-8987-4776ec393899 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:39.944486 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bfca3-eb8c-4ee4-8987-4776ec393899 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:39.951732 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 472/943] 10.222.0.31 () {56 vars in 1108 bytes} [Mon Jan 10 17:38:39 2022] GET /identity/v3/services => generated 1497 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:38:40.032632 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446a780-b4c2-4458-a4d0-9bd10e5a14a2 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:40.033054 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446a780-b4c2-4458-a4d0-9bd10e5a14a2 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:40.033270 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446a780-b4c2-4458-a4d0-9bd10e5a14a2 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:40.035434 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 472/944] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:40.041420 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6b255-e898-454f-9d76-ced4bc51e709 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:40.041843 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6b255-e898-454f-9d76-ced4bc51e709 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:40.042216 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6b255-e898-454f-9d76-ced4bc51e709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:40.062351 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-dfc6b255-e898-454f-9d76-ced4bc51e709 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:40.063891 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-dfc6b255-e898-454f-9d76-ced4bc51e709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:40.072780 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 473/945] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:40 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:40.098569 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446a780-b4c2-4458-a4d0-9bd10e5a14a2 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:40.112993 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446a780-b4c2-4458-a4d0-9bd10e5a14a2 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:40.119909 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1af2e-cc5e-4ea2-8f8b-06dde3155638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:40.120743 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1af2e-cc5e-4ea2-8f8b-06dde3155638 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:40.121112 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1af2e-cc5e-4ea2-8f8b-06dde3155638 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:40.121389 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1af2e-cc5e-4ea2-8f8b-06dde3155638 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:40.136314 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1af2e-cc5e-4ea2-8f8b-06dde3155638 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:40.144082 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-57c1af2e-cc5e-4ea2-8f8b-06dde3155638 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 10 17:38:40.145721 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 473/946] 10.222.0.31 () {56 vars in 1141 bytes} [Mon Jan 10 17:38:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:40.152446 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6b255-e898-454f-9d76-ced4bc51e709 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:40.163897 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6b255-e898-454f-9d76-ced4bc51e709 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:40.170986 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581ffbd-faf5-4725-b9e0-2dc71b9318a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:40.171992 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581ffbd-faf5-4725-b9e0-2dc71b9318a9 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:40.172414 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581ffbd-faf5-4725-b9e0-2dc71b9318a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:40.172896 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581ffbd-faf5-4725-b9e0-2dc71b9318a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:40.174179 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581ffbd-faf5-4725-b9e0-2dc71b9318a9 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:40.174678 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581ffbd-faf5-4725-b9e0-2dc71b9318a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:40.177562 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581ffbd-faf5-4725-b9e0-2dc71b9318a9 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:40.189843 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 474/947] 10.222.0.31 () {56 vars in 1136 bytes} [Mon Jan 10 17:38:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:40.197058 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1af2e-cc5e-4ea2-8f8b-06dde3155638 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:40.210190 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1af2e-cc5e-4ea2-8f8b-06dde3155638 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:40.216793 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ab9fd-b80d-40da-ab90-b4d2305f640b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:40.217628 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ab9fd-b80d-40da-ab90-b4d2305f640b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:40.217909 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ab9fd-b80d-40da-ab90-b4d2305f640b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:40.218179 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ab9fd-b80d-40da-ab90-b4d2305f640b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:40.232415 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ab9fd-b80d-40da-ab90-b4d2305f640b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:40.234317 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ab9fd-b80d-40da-ab90-b4d2305f640b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:40.252054 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-b87ab9fd-b80d-40da-ab90-b4d2305f640b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:40.253776 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 474/948] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:40.259434 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581ffbd-faf5-4725-b9e0-2dc71b9318a9 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:40.269675 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581ffbd-faf5-4725-b9e0-2dc71b9318a9 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:40.274892 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203e5ca-0f38-49e9-bc27-d02580025d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:40.275601 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203e5ca-0f38-49e9-bc27-d02580025d19 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:40.275891 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203e5ca-0f38-49e9-bc27-d02580025d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:40.276169 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203e5ca-0f38-49e9-bc27-d02580025d19 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:40.276985 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203e5ca-0f38-49e9-bc27-d02580025d19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:40.277303 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203e5ca-0f38-49e9-bc27-d02580025d19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:40.278981 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203e5ca-0f38-49e9-bc27-d02580025d19 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:40.291969 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 475/949] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:40.297643 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ab9fd-b80d-40da-ab90-b4d2305f640b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:40.308044 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ab9fd-b80d-40da-ab90-b4d2305f640b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:40.312733 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d53c62-5881-485a-9cef-fef144725906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:40.313634 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d53c62-5881-485a-9cef-fef144725906 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:40.313916 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d53c62-5881-485a-9cef-fef144725906 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:40.314291 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d53c62-5881-485a-9cef-fef144725906 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:40.322128 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d53c62-5881-485a-9cef-fef144725906 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:40.324222 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d53c62-5881-485a-9cef-fef144725906 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:40.339137 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-01d53c62-5881-485a-9cef-fef144725906 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 10 17:38:40.340654 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 475/950] 10.222.0.31 () {56 vars in 1138 bytes} [Mon Jan 10 17:38:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:40.346469 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203e5ca-0f38-49e9-bc27-d02580025d19 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:40.356600 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203e5ca-0f38-49e9-bc27-d02580025d19 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:40.361326 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf0cbe-a991-4059-92ee-ad81e043e1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:40.362051 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf0cbe-a991-4059-92ee-ad81e043e1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:40.362333 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf0cbe-a991-4059-92ee-ad81e043e1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:40.362657 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf0cbe-a991-4059-92ee-ad81e043e1e1 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:40.363516 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf0cbe-a991-4059-92ee-ad81e043e1e1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:40.363870 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf0cbe-a991-4059-92ee-ad81e043e1e1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:40.365813 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf0cbe-a991-4059-92ee-ad81e043e1e1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:40.384281 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 476/951] 10.222.0.31 () {56 vars in 1170 bytes} [Mon Jan 10 17:38:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:40.389990 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d53c62-5881-485a-9cef-fef144725906 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:40.393434 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66d41e-c311-48e8-b475-55bd7426f31e None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:40.393729 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66d41e-c311-48e8-b475-55bd7426f31e None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:40.394007 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66d41e-c311-48e8-b475-55bd7426f31e None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:40.396102 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 477/952] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:38:40.400408 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d53c62-5881-485a-9cef-fef144725906 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:40.403218 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f371b9-1523-477a-afad-1b69c24cb63b None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:40.403644 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f371b9-1523-477a-afad-1b69c24cb63b None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:40.403928 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f371b9-1523-477a-afad-1b69c24cb63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:40.405243 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b630abf-f9cb-425b-8d27-e6ce7912b260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:40.405978 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b630abf-f9cb-425b-8d27-e6ce7912b260 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:40.406260 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b630abf-f9cb-425b-8d27-e6ce7912b260 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:40.406630 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b630abf-f9cb-425b-8d27-e6ce7912b260 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:40.417908 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b630abf-f9cb-425b-8d27-e6ce7912b260 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:40.420470 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b630abf-f9cb-425b-8d27-e6ce7912b260 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:40.423822 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-56f371b9-1523-477a-afad-1b69c24cb63b None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:40.425013 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-56f371b9-1523-477a-afad-1b69c24cb63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:40.432935 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 476/953] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:40 2022] GET /identity/v3/auth/tokens => generated 2138 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:38:40.435853 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b630abf-f9cb-425b-8d27-e6ce7912b260 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:40.438922 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 478/954] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:40 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:38:40.445830 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b630abf-f9cb-425b-8d27-e6ce7912b260 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:40.450488 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e63c6f-bf31-4bf8-ae61-ab8ee176d6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:40.451299 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e63c6f-bf31-4bf8-ae61-ab8ee176d6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:40.451578 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e63c6f-bf31-4bf8-ae61-ab8ee176d6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:40.451898 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e63c6f-bf31-4bf8-ae61-ab8ee176d6c1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:40.462879 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e63c6f-bf31-4bf8-ae61-ab8ee176d6c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:40.463409 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f371b9-1523-477a-afad-1b69c24cb63b None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:40.464998 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e63c6f-bf31-4bf8-ae61-ab8ee176d6c1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:40.473249 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f371b9-1523-477a-afad-1b69c24cb63b None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:40.478374 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab25dfe-09f5-49d2-8ff8-55d165e95704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:40.479411 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab25dfe-09f5-49d2-8ff8-55d165e95704 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:40.479888 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab25dfe-09f5-49d2-8ff8-55d165e95704 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:40.480356 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab25dfe-09f5-49d2-8ff8-55d165e95704 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:40.481248 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab25dfe-09f5-49d2-8ff8-55d165e95704 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:40.482433 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-d1e63c6f-bf31-4bf8-ae61-ab8ee176d6c1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:40.483299 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab25dfe-09f5-49d2-8ff8-55d165e95704 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:40.488298 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 477/955] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:40.489305 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e63c6f-bf31-4bf8-ae61-ab8ee176d6c1 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:40.498905 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e63c6f-bf31-4bf8-ae61-ab8ee176d6c1 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:40.503646 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a900f-6e48-48c5-9ebe-9c5646e84f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:40.504402 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a900f-6e48-48c5-9ebe-9c5646e84f96 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:40.504817 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a900f-6e48-48c5-9ebe-9c5646e84f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:40.505122 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-4ab25dfe-09f5-49d2-8ff8-55d165e95704 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 10 17:38:40.505278 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a900f-6e48-48c5-9ebe-9c5646e84f96 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:40.506153 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a900f-6e48-48c5-9ebe-9c5646e84f96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:40.506542 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a900f-6e48-48c5-9ebe-9c5646e84f96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:40.512894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a900f-6e48-48c5-9ebe-9c5646e84f96 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:40.513183 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 479/956] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:40.517087 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab25dfe-09f5-49d2-8ff8-55d165e95704 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:40.525652 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 478/957] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:40.533177 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab25dfe-09f5-49d2-8ff8-55d165e95704 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:40.534346 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a900f-6e48-48c5-9ebe-9c5646e84f96 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:40.542397 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790eab43-5d4b-4d58-a00e-11bf3f777a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:40.543970 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790eab43-5d4b-4d58-a00e-11bf3f777a68 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:40.544477 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790eab43-5d4b-4d58-a00e-11bf3f777a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:40.544978 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790eab43-5d4b-4d58-a00e-11bf3f777a68 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:40.545080 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a900f-6e48-48c5-9ebe-9c5646e84f96 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:40.546096 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790eab43-5d4b-4d58-a00e-11bf3f777a68 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:40.546703 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790eab43-5d4b-4d58-a00e-11bf3f777a68 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:40.549031 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790eab43-5d4b-4d58-a00e-11bf3f777a68 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:40.550030 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33765057-74a8-42e2-9e4f-3e467282f809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:40.551125 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33765057-74a8-42e2-9e4f-3e467282f809 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:40.551466 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33765057-74a8-42e2-9e4f-3e467282f809 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:40.552109 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33765057-74a8-42e2-9e4f-3e467282f809 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:40.560643 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 480/958] 10.222.0.31 () {56 vars in 1133 bytes} [Mon Jan 10 17:38:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:40.561608 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33765057-74a8-42e2-9e4f-3e467282f809 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:40.561973 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790eab43-5d4b-4d58-a00e-11bf3f777a68 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:40.565265 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33765057-74a8-42e2-9e4f-3e467282f809 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:40.574210 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790eab43-5d4b-4d58-a00e-11bf3f777a68 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:40.579210 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91c8f9-adc9-45d2-9373-4818a7b43cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:40.580362 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91c8f9-adc9-45d2-9373-4818a7b43cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:40.580505 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-33765057-74a8-42e2-9e4f-3e467282f809 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:40.581053 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91c8f9-adc9-45d2-9373-4818a7b43cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:40.581498 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91c8f9-adc9-45d2-9373-4818a7b43cd9 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:40.582108 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 479/959] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:40.582859 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91c8f9-adc9-45d2-9373-4818a7b43cd9 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:40.583560 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91c8f9-adc9-45d2-9373-4818a7b43cd9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:40.585479 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91c8f9-adc9-45d2-9373-4818a7b43cd9 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:40.587900 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33765057-74a8-42e2-9e4f-3e467282f809 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:40.591506 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 481/960] 10.222.0.31 () {56 vars in 1133 bytes} [Mon Jan 10 17:38:40 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:40.602447 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33765057-74a8-42e2-9e4f-3e467282f809 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:40.607436 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce6451-afe7-45cc-8165-d3d9bcd582ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:40.608097 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce6451-afe7-45cc-8165-d3d9bcd582ce admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:40.608378 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce6451-afe7-45cc-8165-d3d9bcd582ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:40.608649 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce6451-afe7-45cc-8165-d3d9bcd582ce admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:40.609643 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce6451-afe7-45cc-8165-d3d9bcd582ce admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:40.609952 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce6451-afe7-45cc-8165-d3d9bcd582ce admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:40.611991 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce6451-afe7-45cc-8165-d3d9bcd582ce admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:40.630772 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 480/961] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:40.632201 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91c8f9-adc9-45d2-9373-4818a7b43cd9 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:40.646887 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91c8f9-adc9-45d2-9373-4818a7b43cd9 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:40.652240 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105de1f6-6fbc-42c0-8a86-044bec76e36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:40.653194 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105de1f6-6fbc-42c0-8a86-044bec76e36c admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:40.653647 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105de1f6-6fbc-42c0-8a86-044bec76e36c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:40.654160 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105de1f6-6fbc-42c0-8a86-044bec76e36c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:40.655182 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105de1f6-6fbc-42c0-8a86-044bec76e36c admin admin] RBAC: Adding query filter params (role.id=154bb7abbd4e4872b138a1ce5d451348, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=3b3dbe4735a54de1825abc28ecf00b84) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:40.655694 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105de1f6-6fbc-42c0-8a86-044bec76e36c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:40.657835 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105de1f6-6fbc-42c0-8a86-044bec76e36c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:40.673028 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 482/962] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:38:40 2022] GET /identity/v3/role_assignments?user.id=3b3dbe4735a54de1825abc28ecf00b84&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=154bb7abbd4e4872b138a1ce5d451348 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:42.406023 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa24cd4-6258-4d92-857b-b3974102aad1 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:42.406543 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa24cd4-6258-4d92-857b-b3974102aad1 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:42.406543 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa24cd4-6258-4d92-857b-b3974102aad1 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:42.408660 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 481/963] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:42.414131 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f79c67-7362-4297-9856-c132f1697ca8 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:42.414552 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f79c67-7362-4297-9856-c132f1697ca8 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:42.414728 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f79c67-7362-4297-9856-c132f1697ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:42.432842 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-88f79c67-7362-4297-9856-c132f1697ca8 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:42.434047 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-88f79c67-7362-4297-9856-c132f1697ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:42.442135 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 483/964] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:42 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:42.459776 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6f8ea-492b-4cbd-b09e-58c6d5bed04b None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:42.460061 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6f8ea-492b-4cbd-b09e-58c6d5bed04b None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:42.460332 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6f8ea-492b-4cbd-b09e-58c6d5bed04b None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:42.462252 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 482/965] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:42.467659 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac2d92-bc4f-40f0-bfbe-1f8dd923dcb6 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:42.467953 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac2d92-bc4f-40f0-bfbe-1f8dd923dcb6 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:42.468235 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac2d92-bc4f-40f0-bfbe-1f8dd923dcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:42.473148 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6f8ea-492b-4cbd-b09e-58c6d5bed04b None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:42.486258 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6f8ea-492b-4cbd-b09e-58c6d5bed04b None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:42.490026 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-8cac2d92-bc4f-40f0-bfbe-1f8dd923dcb6 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:42.490767 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf96244-9653-417b-b1dd-666ebab64a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:42.491632 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf96244-9653-417b-b1dd-666ebab64a97 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:42.491855 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-8cac2d92-bc4f-40f0-bfbe-1f8dd923dcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:42.491972 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf96244-9653-417b-b1dd-666ebab64a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:42.492300 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf96244-9653-417b-b1dd-666ebab64a97 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:42.493091 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf96244-9653-417b-b1dd-666ebab64a97 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:42.494849 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf96244-9653-417b-b1dd-666ebab64a97 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:42.505088 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 484/966] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:42 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:42.507258 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-abf96244-9653-417b-b1dd-666ebab64a97 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 10 17:38:42.508802 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 483/967] 10.222.0.31 () {56 vars in 1147 bytes} [Mon Jan 10 17:38:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:42.518124 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac2d92-bc4f-40f0-bfbe-1f8dd923dcb6 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:42.528023 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac2d92-bc4f-40f0-bfbe-1f8dd923dcb6 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:42.532936 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ca8ff-0d2c-4987-a443-9721f3386cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:42.533181 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf96244-9653-417b-b1dd-666ebab64a97 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:42.533943 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ca8ff-0d2c-4987-a443-9721f3386cbf admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:42.534468 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ca8ff-0d2c-4987-a443-9721f3386cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:42.534886 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ca8ff-0d2c-4987-a443-9721f3386cbf admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:42.535751 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ca8ff-0d2c-4987-a443-9721f3386cbf admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:42.536207 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ca8ff-0d2c-4987-a443-9721f3386cbf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:42.537978 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ca8ff-0d2c-4987-a443-9721f3386cbf admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:42.543391 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 485/968] 10.222.0.31 () {56 vars in 1143 bytes} [Mon Jan 10 17:38:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:42.547940 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf96244-9653-417b-b1dd-666ebab64a97 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:42.549215 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ca8ff-0d2c-4987-a443-9721f3386cbf admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:42.551534 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9cc27-64d4-452c-bf67-ddc3a8ab36a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:42.552502 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9cc27-64d4-452c-bf67-ddc3a8ab36a9 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:42.553035 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9cc27-64d4-452c-bf67-ddc3a8ab36a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:42.553494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9cc27-64d4-452c-bf67-ddc3a8ab36a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:42.554692 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9cc27-64d4-452c-bf67-ddc3a8ab36a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:42.557846 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9cc27-64d4-452c-bf67-ddc3a8ab36a9 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:42.559234 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ca8ff-0d2c-4987-a443-9721f3386cbf admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:42.560465 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.common [None req-61f9cc27-64d4-452c-bf67-ddc3a8ab36a9 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 10 17:38:42.564233 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bc8de-5cd7-45a7-a0f0-6dbc54d2ada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:42.564999 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bc8de-5cd7-45a7-a0f0-6dbc54d2ada3 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:42.565533 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bc8de-5cd7-45a7-a0f0-6dbc54d2ada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:42.565637 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bc8de-5cd7-45a7-a0f0-6dbc54d2ada3 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:42.566322 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bc8de-5cd7-45a7-a0f0-6dbc54d2ada3 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:42.566678 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bc8de-5cd7-45a7-a0f0-6dbc54d2ada3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:42.568455 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bc8de-5cd7-45a7-a0f0-6dbc54d2ada3 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:42.574346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 486/969] 10.222.0.31 () {56 vars in 1143 bytes} [Mon Jan 10 17:38:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:42.580176 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bc8de-5cd7-45a7-a0f0-6dbc54d2ada3 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:42.588774 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.sql.core [None req-61f9cc27-64d4-452c-bf67-ddc3a8ab36a9 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jan 10 17:38:42.588774 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jan 10 17:38:42.588774 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [parameters: {'id': '6cb24a9407cb46f682a33277a393afb5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jan 10 17:38:42.588774 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=90762) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 10 17:38:42.596273 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bc8de-5cd7-45a7-a0f0-6dbc54d2ada3 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:42.601185 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c8751-8b06-4385-bff6-3299704a0bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:42.602222 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c8751-8b06-4385-bff6-3299704a0bce admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:42.602713 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c8751-8b06-4385-bff6-3299704a0bce admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:42.603258 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c8751-8b06-4385-bff6-3299704a0bce admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:42.603774 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-61f9cc27-64d4-452c-bf67-ddc3a8ab36a9 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6cb24a9407cb46f682a33277a393afb5.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6cb24a9407cb46f682a33277a393afb5. Jan 10 17:38:42.604479 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c8751-8b06-4385-bff6-3299704a0bce admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:42.610154 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 484/970] 10.222.0.31 () {60 vars in 1161 bytes} [Mon Jan 10 17:38:42 2022] POST /identity/v3/projects => generated 262 bytes in 73 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:42.610294 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c8751-8b06-4385-bff6-3299704a0bce admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:42.612139 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9cc27-64d4-452c-bf67-ddc3a8ab36a9 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:42.624299 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9cc27-64d4-452c-bf67-ddc3a8ab36a9 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:42.629828 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05118456-323b-42c7-a6a5-d20828168c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:42.630724 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05118456-323b-42c7-a6a5-d20828168c3e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:42.631010 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05118456-323b-42c7-a6a5-d20828168c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:42.631329 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05118456-323b-42c7-a6a5-d20828168c3e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:42.634678 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 487/971] 10.222.0.31 () {60 vars in 1165 bytes} [Mon Jan 10 17:38:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:38:42.642043 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05118456-323b-42c7-a6a5-d20828168c3e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:42.644991 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05118456-323b-42c7-a6a5-d20828168c3e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:42.663452 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-05118456-323b-42c7-a6a5-d20828168c3e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:42.670763 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 485/972] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:42.672598 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c8751-8b06-4385-bff6-3299704a0bce admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:42.695115 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c8751-8b06-4385-bff6-3299704a0bce admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:42.700305 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699f4e8-eb1d-40b4-9650-e8d704762c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:42.701425 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699f4e8-eb1d-40b4-9650-e8d704762c09 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:42.701901 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699f4e8-eb1d-40b4-9650-e8d704762c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:42.702364 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699f4e8-eb1d-40b4-9650-e8d704762c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:42.703417 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699f4e8-eb1d-40b4-9650-e8d704762c09 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:42.703929 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699f4e8-eb1d-40b4-9650-e8d704762c09 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:42.706202 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699f4e8-eb1d-40b4-9650-e8d704762c09 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:42.731667 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 488/973] 10.222.0.31 () {56 vars in 1133 bytes} [Mon Jan 10 17:38:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:43.020676 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09f69b-9c99-44d8-9c41-26e859c696bd None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:43.020998 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09f69b-9c99-44d8-9c41-26e859c696bd None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:43.021184 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09f69b-9c99-44d8-9c41-26e859c696bd None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:43.026438 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 486/974] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:43.032033 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa4f94-3091-453d-86b3-02029b1cc300 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:43.032324 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa4f94-3091-453d-86b3-02029b1cc300 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:43.032602 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa4f94-3091-453d-86b3-02029b1cc300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:43.050939 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-dcfa4f94-3091-453d-86b3-02029b1cc300 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:43.052127 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-dcfa4f94-3091-453d-86b3-02029b1cc300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:43.060237 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 489/975] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:43 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:38:43.085322 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09f69b-9c99-44d8-9c41-26e859c696bd None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:43.097754 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09f69b-9c99-44d8-9c41-26e859c696bd None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:43.102120 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b7ef0-c2a4-4377-87c5-dba9de6236d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:43.102824 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b7ef0-c2a4-4377-87c5-dba9de6236d9 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:43.103108 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b7ef0-c2a4-4377-87c5-dba9de6236d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:43.103381 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b7ef0-c2a4-4377-87c5-dba9de6236d9 admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:43.104133 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b7ef0-c2a4-4377-87c5-dba9de6236d9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:43.105909 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b7ef0-c2a4-4377-87c5-dba9de6236d9 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:43.120011 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434b1c3-f875-4b7c-8618-9574b99a951e None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:43.120357 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434b1c3-f875-4b7c-8618-9574b99a951e None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:43.120623 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434b1c3-f875-4b7c-8618-9574b99a951e None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:43.122702 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 490/976] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:38:43.123572 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 487/977] 10.222.0.31 () {60 vars in 1162 bytes} [Mon Jan 10 17:38:43 2022] POST /identity/v3/services => generated 242 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:38:43.129786 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4bbf6-7e87-438e-8eca-c8d7b0bea3fa None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:43.130084 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4bbf6-7e87-438e-8eca-c8d7b0bea3fa None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:43.130340 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4bbf6-7e87-438e-8eca-c8d7b0bea3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:43.152523 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-7fc4bbf6-7e87-438e-8eca-c8d7b0bea3fa None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:43.153983 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-7fc4bbf6-7e87-438e-8eca-c8d7b0bea3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:43.175973 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 491/978] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:43 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:43.199515 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b7ef0-c2a4-4377-87c5-dba9de6236d9 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:43.210477 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b7ef0-c2a4-4377-87c5-dba9de6236d9 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:43.215338 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e124e-665f-4d7b-b63c-55d9a760ffbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:43.216218 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e124e-665f-4d7b-b63c-55d9a760ffbe admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:43.216555 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e124e-665f-4d7b-b63c-55d9a760ffbe admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:43.216920 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e124e-665f-4d7b-b63c-55d9a760ffbe admin admin] PATH_INFO: `/v3/services/image` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:43.217602 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e124e-665f-4d7b-b63c-55d9a760ffbe admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:43.219296 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e124e-665f-4d7b-b63c-55d9a760ffbe admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:43.231179 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-155e124e-665f-4d7b-b63c-55d9a760ffbe admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 10 17:38:43.232870 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 488/979] 10.222.0.31 () {56 vars in 1126 bytes} [Mon Jan 10 17:38:43 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:43.240317 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4bbf6-7e87-438e-8eca-c8d7b0bea3fa None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:43.249872 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4bbf6-7e87-438e-8eca-c8d7b0bea3fa None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:43.254761 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98902d-edc4-4638-b84f-5a9c6c946dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:43.255444 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98902d-edc4-4638-b84f-5a9c6c946dea admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:43.255723 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98902d-edc4-4638-b84f-5a9c6c946dea admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:43.255994 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98902d-edc4-4638-b84f-5a9c6c946dea admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:43.256833 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98902d-edc4-4638-b84f-5a9c6c946dea admin admin] RBAC: Adding query filter params (name=image) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:43.257172 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98902d-edc4-4638-b84f-5a9c6c946dea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:43.258932 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98902d-edc4-4638-b84f-5a9c6c946dea admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:43.268910 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 492/980] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:43.271128 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e124e-665f-4d7b-b63c-55d9a760ffbe admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:43.282191 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e124e-665f-4d7b-b63c-55d9a760ffbe admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:43.287193 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf005942-cc69-4b8b-b972-6b965180c874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:43.287875 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf005942-cc69-4b8b-b972-6b965180c874 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:43.288150 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf005942-cc69-4b8b-b972-6b965180c874 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:43.288427 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf005942-cc69-4b8b-b972-6b965180c874 admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:43.289289 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf005942-cc69-4b8b-b972-6b965180c874 admin admin] RBAC: Adding query filter params (type=image) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:43.289595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf005942-cc69-4b8b-b972-6b965180c874 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:43.291276 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf005942-cc69-4b8b-b972-6b965180c874 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:43.296891 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 489/981] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:43 2022] GET /identity/v3/services?type=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:45.084464 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f4b8d-56f8-4f68-a127-f941c6005b8f None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.085200 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f4b8d-56f8-4f68-a127-f941c6005b8f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.085200 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f4b8d-56f8-4f68-a127-f941c6005b8f None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.087109 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 493/982] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:45.093193 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0bd80-4b38-4bac-8e83-d52b3f69be77 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.093841 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0bd80-4b38-4bac-8e83-d52b3f69be77 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.093841 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0bd80-4b38-4bac-8e83-d52b3f69be77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.113653 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-9ce0bd80-4b38-4bac-8e83-d52b3f69be77 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:45.115186 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-9ce0bd80-4b38-4bac-8e83-d52b3f69be77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:45.123542 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 490/983] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:45 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:38:45.151515 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f4b8d-56f8-4f68-a127-f941c6005b8f None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:45.163920 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f4b8d-56f8-4f68-a127-f941c6005b8f None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:45.168365 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b687331-6d79-41a2-b1ec-0a0b9dcfb2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:45.169198 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b687331-6d79-41a2-b1ec-0a0b9dcfb2bc admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.169476 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b687331-6d79-41a2-b1ec-0a0b9dcfb2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.169746 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b687331-6d79-41a2-b1ec-0a0b9dcfb2bc admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.170414 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b687331-6d79-41a2-b1ec-0a0b9dcfb2bc admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:45.172003 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b687331-6d79-41a2-b1ec-0a0b9dcfb2bc admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:45.183614 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-7b687331-6d79-41a2-b1ec-0a0b9dcfb2bc admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 10 17:38:45.185267 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 494/984] 10.222.0.31 () {56 vars in 1147 bytes} [Mon Jan 10 17:38:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:45.191503 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0bd80-4b38-4bac-8e83-d52b3f69be77 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:45.200579 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0bd80-4b38-4bac-8e83-d52b3f69be77 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:45.205533 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95988897-874f-412a-94ec-e88f3aac4c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:45.206205 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95988897-874f-412a-94ec-e88f3aac4c90 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.206482 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95988897-874f-412a-94ec-e88f3aac4c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.206757 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95988897-874f-412a-94ec-e88f3aac4c90 admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.207482 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95988897-874f-412a-94ec-e88f3aac4c90 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:45.207786 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95988897-874f-412a-94ec-e88f3aac4c90 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:45.209425 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95988897-874f-412a-94ec-e88f3aac4c90 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:45.214632 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 491/985] 10.222.0.31 () {56 vars in 1143 bytes} [Mon Jan 10 17:38:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:45.220419 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b687331-6d79-41a2-b1ec-0a0b9dcfb2bc admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:45.227190 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ab949-4869-4ef3-a048-8b8f44648a8e None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.227190 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ab949-4869-4ef3-a048-8b8f44648a8e None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.227190 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ab949-4869-4ef3-a048-8b8f44648a8e None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.227190 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 492/986] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:45.233532 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b687331-6d79-41a2-b1ec-0a0b9dcfb2bc admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:45.233666 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaed3dd-0765-4b59-995b-b009228965b7 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.233666 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaed3dd-0765-4b59-995b-b009228965b7 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.233666 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaed3dd-0765-4b59-995b-b009228965b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.238258 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2535b-71b4-49dd-9077-d0149fd7b271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:45.239135 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2535b-71b4-49dd-9077-d0149fd7b271 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.239552 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2535b-71b4-49dd-9077-d0149fd7b271 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.239978 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2535b-71b4-49dd-9077-d0149fd7b271 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.240844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2535b-71b4-49dd-9077-d0149fd7b271 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:45.241427 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2535b-71b4-49dd-9077-d0149fd7b271 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:45.243059 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2535b-71b4-49dd-9077-d0149fd7b271 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:45.248906 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 495/987] 10.222.0.31 () {56 vars in 1143 bytes} [Mon Jan 10 17:38:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:45.257441 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2535b-71b4-49dd-9077-d0149fd7b271 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:45.258731 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-bbaed3dd-0765-4b59-995b-b009228965b7 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:45.259905 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-bbaed3dd-0765-4b59-995b-b009228965b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:45.269774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2535b-71b4-49dd-9077-d0149fd7b271 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:45.277094 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 493/988] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:45 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:38:45.282057 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434230fa-3a12-45ff-aca1-2f24fb36d9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:45.282705 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434230fa-3a12-45ff-aca1-2f24fb36d9af admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.283054 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434230fa-3a12-45ff-aca1-2f24fb36d9af admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.283330 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434230fa-3a12-45ff-aca1-2f24fb36d9af admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.284128 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434230fa-3a12-45ff-aca1-2f24fb36d9af admin admin] RBAC: Adding query filter params (interface=admin, service_id=d44143a1fbd54d289ec1cec38439b3b3, region_id=RegionOne) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:45.284430 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434230fa-3a12-45ff-aca1-2f24fb36d9af admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:45.286148 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434230fa-3a12-45ff-aca1-2f24fb36d9af admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:45.291494 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 496/989] 10.222.0.31 () {56 vars in 1270 bytes} [Mon Jan 10 17:38:45 2022] GET /identity/v3/endpoints?service_id=d44143a1fbd54d289ec1cec38439b3b3&interface=admin®ion_id=RegionOne => generated 193 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:45.298063 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaed3dd-0765-4b59-995b-b009228965b7 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:45.305749 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434230fa-3a12-45ff-aca1-2f24fb36d9af admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:45.309767 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaed3dd-0765-4b59-995b-b009228965b7 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:45.316174 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10fc5e-5eab-428e-9c1e-a335c939f8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:45.316388 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434230fa-3a12-45ff-aca1-2f24fb36d9af admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:45.317467 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10fc5e-5eab-428e-9c1e-a335c939f8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.318037 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10fc5e-5eab-428e-9c1e-a335c939f8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.318535 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10fc5e-5eab-428e-9c1e-a335c939f8d9 admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.319536 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10fc5e-5eab-428e-9c1e-a335c939f8d9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:45.321223 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f13cf4-797b-4c4b-8b27-843b0ce0cedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:45.321906 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f13cf4-797b-4c4b-8b27-843b0ce0cedb admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.322139 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10fc5e-5eab-428e-9c1e-a335c939f8d9 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:45.322237 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f13cf4-797b-4c4b-8b27-843b0ce0cedb admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.322432 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f13cf4-797b-4c4b-8b27-843b0ce0cedb admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.323169 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f13cf4-797b-4c4b-8b27-843b0ce0cedb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:45.325072 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f13cf4-797b-4c4b-8b27-843b0ce0cedb admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:45.326443 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.common [None req-53f13cf4-797b-4c4b-8b27-843b0ce0cedb admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 10 17:38:45.330811 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 494/990] 10.222.0.31 () {56 vars in 1108 bytes} [Mon Jan 10 17:38:45 2022] GET /identity/v3/services => generated 1727 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:38:45.343907 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.sql.core [None req-53f13cf4-797b-4c4b-8b27-843b0ce0cedb admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jan 10 17:38:45.343907 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jan 10 17:38:45.343907 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [parameters: {'user_id': 'd20f70e5359b4b7385db70352aece25b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jan 10 17:38:45.343907 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=90763) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 10 17:38:45.350155 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-53f13cf4-797b-4c4b-8b27-843b0ce0cedb admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jan 10 17:38:45.357032 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 497/991] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:38:45 2022] POST /identity/v3/users => generated 160 bytes in 47 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:45.358526 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10fc5e-5eab-428e-9c1e-a335c939f8d9 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:45.371548 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10fc5e-5eab-428e-9c1e-a335c939f8d9 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:45.376935 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1cd28-d198-49ad-be67-a656a457d4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:45.378148 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1cd28-d198-49ad-be67-a656a457d4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.378658 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1cd28-d198-49ad-be67-a656a457d4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.379136 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1cd28-d198-49ad-be67-a656a457d4b4 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.387984 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1cd28-d198-49ad-be67-a656a457d4b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:45.390428 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1cd28-d198-49ad-be67-a656a457d4b4 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:45.406264 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-e5c1cd28-d198-49ad-be67-a656a457d4b4 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 10 17:38:45.413062 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 495/992] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:38:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:45.415867 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f13cf4-797b-4c4b-8b27-843b0ce0cedb admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:45.432507 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f13cf4-797b-4c4b-8b27-843b0ce0cedb admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:45.437791 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce06d4-ba5e-4d9b-8d36-9f327364fcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:45.438926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce06d4-ba5e-4d9b-8d36-9f327364fcb8 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.439517 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce06d4-ba5e-4d9b-8d36-9f327364fcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.440074 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce06d4-ba5e-4d9b-8d36-9f327364fcb8 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.441130 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce06d4-ba5e-4d9b-8d36-9f327364fcb8 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:45.441628 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce06d4-ba5e-4d9b-8d36-9f327364fcb8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:45.443997 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce06d4-ba5e-4d9b-8d36-9f327364fcb8 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:45.493053 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 498/993] 10.222.0.31 () {56 vars in 1122 bytes} [Mon Jan 10 17:38:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:45.548144 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abfc22-f890-4e2f-a83b-183c0eb33cc6 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.548505 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abfc22-f890-4e2f-a83b-183c0eb33cc6 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.548741 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abfc22-f890-4e2f-a83b-183c0eb33cc6 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.551070 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 496/994] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:45.557173 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc00aa2-ebf3-4926-aeaa-9fa2d6e1c931 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.557497 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc00aa2-ebf3-4926-aeaa-9fa2d6e1c931 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.557733 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc00aa2-ebf3-4926-aeaa-9fa2d6e1c931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.577741 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-4fc00aa2-ebf3-4926-aeaa-9fa2d6e1c931 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:45.579343 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-4fc00aa2-ebf3-4926-aeaa-9fa2d6e1c931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:45.587757 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 499/995] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:45 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:45.612382 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abfc22-f890-4e2f-a83b-183c0eb33cc6 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:45.624831 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abfc22-f890-4e2f-a83b-183c0eb33cc6 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:45.629378 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c95408-667b-42a8-a9fb-fd6da35d96a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:45.630241 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c95408-667b-42a8-a9fb-fd6da35d96a9 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.630519 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c95408-667b-42a8-a9fb-fd6da35d96a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.630877 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c95408-667b-42a8-a9fb-fd6da35d96a9 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.631556 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c95408-667b-42a8-a9fb-fd6da35d96a9 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:45.633206 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c95408-667b-42a8-a9fb-fd6da35d96a9 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:45.645226 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-a1c95408-667b-42a8-a9fb-fd6da35d96a9 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 10 17:38:45.646841 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 497/996] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:45.653543 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc00aa2-ebf3-4926-aeaa-9fa2d6e1c931 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:45.662821 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc00aa2-ebf3-4926-aeaa-9fa2d6e1c931 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:45.667424 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d16c8-8de5-4cb7-8fd1-7c88be6d7604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:45.668097 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d16c8-8de5-4cb7-8fd1-7c88be6d7604 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.668375 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d16c8-8de5-4cb7-8fd1-7c88be6d7604 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.668646 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d16c8-8de5-4cb7-8fd1-7c88be6d7604 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.669408 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d16c8-8de5-4cb7-8fd1-7c88be6d7604 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:45.669708 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d16c8-8de5-4cb7-8fd1-7c88be6d7604 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:45.671340 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d16c8-8de5-4cb7-8fd1-7c88be6d7604 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:45.677288 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 500/997] 10.222.0.31 () {56 vars in 1133 bytes} [Mon Jan 10 17:38:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:45.683139 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c95408-667b-42a8-a9fb-fd6da35d96a9 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:45.693561 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c95408-667b-42a8-a9fb-fd6da35d96a9 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:45.698254 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d83dc0-8c13-4745-816a-9b6cbbf7ff5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:45.698926 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d83dc0-8c13-4745-816a-9b6cbbf7ff5a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.699252 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d83dc0-8c13-4745-816a-9b6cbbf7ff5a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.699523 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d83dc0-8c13-4745-816a-9b6cbbf7ff5a admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.700250 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d83dc0-8c13-4745-816a-9b6cbbf7ff5a admin admin] RBAC: Adding query filter params (type=compute) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:45.700589 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d83dc0-8c13-4745-816a-9b6cbbf7ff5a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:45.702310 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d83dc0-8c13-4745-816a-9b6cbbf7ff5a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:45.708625 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 498/998] 10.222.0.31 () {56 vars in 1133 bytes} [Mon Jan 10 17:38:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:45.714706 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d16c8-8de5-4cb7-8fd1-7c88be6d7604 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:45.725089 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d16c8-8de5-4cb7-8fd1-7c88be6d7604 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:45.730419 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23903383-7eae-4031-80a2-7a70324884a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:45.731136 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23903383-7eae-4031-80a2-7a70324884a5 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.731473 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23903383-7eae-4031-80a2-7a70324884a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.731745 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23903383-7eae-4031-80a2-7a70324884a5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.732608 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23903383-7eae-4031-80a2-7a70324884a5 admin admin] RBAC: Adding query filter params (interface=public, service_id=7566aaafb8a0482cad2a2a93feddea09, region_id=RegionOne) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:45.732943 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23903383-7eae-4031-80a2-7a70324884a5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:45.734606 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23903383-7eae-4031-80a2-7a70324884a5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:45.740925 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 501/999] 10.222.0.31 () {56 vars in 1272 bytes} [Mon Jan 10 17:38:45 2022] GET /identity/v3/endpoints?service_id=7566aaafb8a0482cad2a2a93feddea09&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:45.746953 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d83dc0-8c13-4745-816a-9b6cbbf7ff5a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:45.756929 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d83dc0-8c13-4745-816a-9b6cbbf7ff5a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:45.761666 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542a3cf-a51f-44f5-86d5-a4c2a7921649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:45.762376 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542a3cf-a51f-44f5-86d5-a4c2a7921649 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.762655 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542a3cf-a51f-44f5-86d5-a4c2a7921649 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.762927 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542a3cf-a51f-44f5-86d5-a4c2a7921649 admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.763722 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542a3cf-a51f-44f5-86d5-a4c2a7921649 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:45.765365 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542a3cf-a51f-44f5-86d5-a4c2a7921649 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:45.772311 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 499/1000] 10.222.0.31 () {56 vars in 1108 bytes} [Mon Jan 10 17:38:45 2022] GET /identity/v3/services => generated 1727 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:38:45.786392 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a5097-98c8-416f-b0da-98a614dbd609 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.786708 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a5097-98c8-416f-b0da-98a614dbd609 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.786931 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a5097-98c8-416f-b0da-98a614dbd609 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.788999 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 502/1001] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:45.796076 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a142dc1-8d6f-43b6-8625-33602c190ee7 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.796076 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a142dc1-8d6f-43b6-8625-33602c190ee7 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.796076 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a142dc1-8d6f-43b6-8625-33602c190ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.816810 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-4a142dc1-8d6f-43b6-8625-33602c190ee7 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:45.818436 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-4a142dc1-8d6f-43b6-8625-33602c190ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:45.831477 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 500/1002] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:45 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:45.851807 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a5097-98c8-416f-b0da-98a614dbd609 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:45.865252 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a5097-98c8-416f-b0da-98a614dbd609 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:45.871725 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0bb6b-c6ee-4818-83a3-e5857c979ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:45.872414 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0bb6b-c6ee-4818-83a3-e5857c979ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:45.872693 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0bb6b-c6ee-4818-83a3-e5857c979ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:45.873009 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0bb6b-c6ee-4818-83a3-e5857c979ef1 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:45.873762 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0bb6b-c6ee-4818-83a3-e5857c979ef1 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:45.875381 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0bb6b-c6ee-4818-83a3-e5857c979ef1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:45.890121 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 503/1003] 10.222.0.31 () {60 vars in 1162 bytes} [Mon Jan 10 17:38:45 2022] POST /identity/v3/services => generated 242 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:38:47.746817 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5e0f1-1bf5-4b8a-82ce-934d0b686bf5 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:47.747393 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5e0f1-1bf5-4b8a-82ce-934d0b686bf5 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:47.747393 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5e0f1-1bf5-4b8a-82ce-934d0b686bf5 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:47.749470 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 501/1004] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:47.755024 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c84d8-c9d8-4e34-9c84-b8213f9e303d None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:47.755492 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c84d8-c9d8-4e34-9c84-b8213f9e303d None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:47.755568 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c84d8-c9d8-4e34-9c84-b8213f9e303d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:47.774217 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-659c84d8-c9d8-4e34-9c84-b8213f9e303d None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:47.775389 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-659c84d8-c9d8-4e34-9c84-b8213f9e303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:47.793996 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 504/1005] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:47 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:47.818811 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5e0f1-1bf5-4b8a-82ce-934d0b686bf5 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:47.832336 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5e0f1-1bf5-4b8a-82ce-934d0b686bf5 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:47.837347 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3064971-86df-4904-aca9-10c98557a0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:47.838195 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3064971-86df-4904-aca9-10c98557a0be admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:47.838476 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3064971-86df-4904-aca9-10c98557a0be admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:47.838751 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3064971-86df-4904-aca9-10c98557a0be admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:47.839442 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3064971-86df-4904-aca9-10c98557a0be admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:47.841148 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3064971-86df-4904-aca9-10c98557a0be admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:47.853462 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-d3064971-86df-4904-aca9-10c98557a0be admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 10 17:38:47.854925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 502/1006] 10.222.0.31 () {56 vars in 1147 bytes} [Mon Jan 10 17:38:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:47.861250 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c84d8-c9d8-4e34-9c84-b8213f9e303d None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:47.870788 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c84d8-c9d8-4e34-9c84-b8213f9e303d None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:47.876670 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f70519-9d9c-4ce6-959f-0c87d1169815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:47.877471 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f70519-9d9c-4ce6-959f-0c87d1169815 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:47.877807 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f70519-9d9c-4ce6-959f-0c87d1169815 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:47.878138 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f70519-9d9c-4ce6-959f-0c87d1169815 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:47.878925 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f70519-9d9c-4ce6-959f-0c87d1169815 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:47.879286 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f70519-9d9c-4ce6-959f-0c87d1169815 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:47.880981 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f70519-9d9c-4ce6-959f-0c87d1169815 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:47.886879 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 505/1007] 10.222.0.31 () {56 vars in 1143 bytes} [Mon Jan 10 17:38:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:47.892826 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3064971-86df-4904-aca9-10c98557a0be admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:47.903540 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3064971-86df-4904-aca9-10c98557a0be admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:47.909424 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9bbdd9-1188-4d2c-baf9-ca7862be36a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:47.910087 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bbdd9-1188-4d2c-baf9-ca7862be36a1 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:47.910365 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bbdd9-1188-4d2c-baf9-ca7862be36a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:47.910638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bbdd9-1188-4d2c-baf9-ca7862be36a1 admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:47.911364 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9bbdd9-1188-4d2c-baf9-ca7862be36a1 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:47.911671 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9bbdd9-1188-4d2c-baf9-ca7862be36a1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:47.913322 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9bbdd9-1188-4d2c-baf9-ca7862be36a1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:47.918925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 503/1008] 10.222.0.31 () {56 vars in 1143 bytes} [Mon Jan 10 17:38:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:47.924584 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f70519-9d9c-4ce6-959f-0c87d1169815 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:47.935109 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f70519-9d9c-4ce6-959f-0c87d1169815 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:47.940493 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257a96f-f088-4f5e-816b-e956883404e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:47.941175 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257a96f-f088-4f5e-816b-e956883404e6 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:47.941454 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257a96f-f088-4f5e-816b-e956883404e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:47.941713 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257a96f-f088-4f5e-816b-e956883404e6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:47.942465 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257a96f-f088-4f5e-816b-e956883404e6 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:47.944056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257a96f-f088-4f5e-816b-e956883404e6 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:47.960652 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 506/1009] 10.222.0.31 () {60 vars in 1165 bytes} [Mon Jan 10 17:38:47 2022] POST /identity/v3/endpoints => generated 325 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:38:48.174913 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f7ed0-cbe3-49ef-9fba-350ec925ca21 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:48.175327 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f7ed0-cbe3-49ef-9fba-350ec925ca21 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:48.175503 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f7ed0-cbe3-49ef-9fba-350ec925ca21 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:48.177293 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 504/1010] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:48.182676 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f11d6-4480-4a82-b0b5-a96dcc0a7c38 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:48.182939 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f11d6-4480-4a82-b0b5-a96dcc0a7c38 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:48.183220 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f11d6-4480-4a82-b0b5-a96dcc0a7c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:48.201488 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-0d2f11d6-4480-4a82-b0b5-a96dcc0a7c38 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:48.202647 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-0d2f11d6-4480-4a82-b0b5-a96dcc0a7c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:48.220410 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 507/1011] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:48 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:38:48.244706 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f7ed0-cbe3-49ef-9fba-350ec925ca21 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:48.257837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f7ed0-cbe3-49ef-9fba-350ec925ca21 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:48.262304 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10682d6e-432e-487d-bd72-7ebab520c094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:48.263549 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10682d6e-432e-487d-bd72-7ebab520c094 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:48.263837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10682d6e-432e-487d-bd72-7ebab520c094 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:48.264117 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10682d6e-432e-487d-bd72-7ebab520c094 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:48.264596 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc8b04-c3f1-4bc8-a818-7a2e46ed6369 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:48.264788 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10682d6e-432e-487d-bd72-7ebab520c094 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:48.264924 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc8b04-c3f1-4bc8-a818-7a2e46ed6369 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:48.265183 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc8b04-c3f1-4bc8-a818-7a2e46ed6369 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:48.266522 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10682d6e-432e-487d-bd72-7ebab520c094 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:48.266957 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 508/1012] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:38:48.271758 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8567a-59dc-4dcf-a84d-3b69811627d1 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:48.272037 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8567a-59dc-4dcf-a84d-3b69811627d1 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:48.272312 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8567a-59dc-4dcf-a84d-3b69811627d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:48.278796 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-10682d6e-432e-487d-bd72-7ebab520c094 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 10 17:38:48.280292 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 505/1013] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:48.285862 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10682d6e-432e-487d-bd72-7ebab520c094 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:48.291108 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-eeb8567a-59dc-4dcf-a84d-3b69811627d1 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:48.292258 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-eeb8567a-59dc-4dcf-a84d-3b69811627d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:48.295697 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10682d6e-432e-487d-bd72-7ebab520c094 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:48.299940 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 509/1014] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:48 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:38:48.300048 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f85d16-33fc-4f41-b950-ebb72ca76f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:48.300651 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f85d16-33fc-4f41-b950-ebb72ca76f64 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:48.301111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f85d16-33fc-4f41-b950-ebb72ca76f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:48.301394 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f85d16-33fc-4f41-b950-ebb72ca76f64 admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:48.302107 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f85d16-33fc-4f41-b950-ebb72ca76f64 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:48.302409 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f85d16-33fc-4f41-b950-ebb72ca76f64 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:48.303986 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f85d16-33fc-4f41-b950-ebb72ca76f64 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:48.313047 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 506/1015] 10.222.0.31 () {56 vars in 1133 bytes} [Mon Jan 10 17:38:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:48.314764 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8567a-59dc-4dcf-a84d-3b69811627d1 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:48.323499 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f85d16-33fc-4f41-b950-ebb72ca76f64 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:48.324270 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8567a-59dc-4dcf-a84d-3b69811627d1 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:48.328698 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292331b4-aeb0-4d9f-9928-64b138c00780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:48.329824 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292331b4-aeb0-4d9f-9928-64b138c00780 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:48.329824 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292331b4-aeb0-4d9f-9928-64b138c00780 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:48.330110 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292331b4-aeb0-4d9f-9928-64b138c00780 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:48.330870 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292331b4-aeb0-4d9f-9928-64b138c00780 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:48.331093 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292331b4-aeb0-4d9f-9928-64b138c00780 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:48.332678 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292331b4-aeb0-4d9f-9928-64b138c00780 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:48.333205 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f85d16-33fc-4f41-b950-ebb72ca76f64 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:48.337546 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef14fb-4def-4ca3-92ca-171e2c75bec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:48.340912 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 510/1016] 10.222.0.31 () {56 vars in 1133 bytes} [Mon Jan 10 17:38:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:48.341055 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef14fb-4def-4ca3-92ca-171e2c75bec2 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:48.341055 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef14fb-4def-4ca3-92ca-171e2c75bec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:48.341055 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef14fb-4def-4ca3-92ca-171e2c75bec2 admin admin] PATH_INFO: `/v3/services/image` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:48.341055 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef14fb-4def-4ca3-92ca-171e2c75bec2 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:48.341055 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef14fb-4def-4ca3-92ca-171e2c75bec2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:48.343941 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292331b4-aeb0-4d9f-9928-64b138c00780 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:48.351842 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-07ef14fb-4def-4ca3-92ca-171e2c75bec2 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 10 17:38:48.353146 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 507/1017] 10.222.0.31 () {56 vars in 1126 bytes} [Mon Jan 10 17:38:48 2022] GET /identity/v3/services/image => generated 86 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:48.353376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292331b4-aeb0-4d9f-9928-64b138c00780 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:48.357819 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7326c-ef7c-4cd5-8902-4030e7b4cecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:48.358518 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7326c-ef7c-4cd5-8902-4030e7b4cecd admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:48.358859 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7326c-ef7c-4cd5-8902-4030e7b4cecd admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:48.358961 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef14fb-4def-4ca3-92ca-171e2c75bec2 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:48.359130 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7326c-ef7c-4cd5-8902-4030e7b4cecd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:48.359867 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7326c-ef7c-4cd5-8902-4030e7b4cecd admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:48.361512 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7326c-ef7c-4cd5-8902-4030e7b4cecd admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:48.368207 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef14fb-4def-4ca3-92ca-171e2c75bec2 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:48.372728 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bef5c-1cf8-4da9-8340-50e69bb2504e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:48.373431 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bef5c-1cf8-4da9-8340-50e69bb2504e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:48.373695 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bef5c-1cf8-4da9-8340-50e69bb2504e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:48.373973 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bef5c-1cf8-4da9-8340-50e69bb2504e admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:48.374681 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bef5c-1cf8-4da9-8340-50e69bb2504e admin admin] RBAC: Adding query filter params (name=image) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:48.375084 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bef5c-1cf8-4da9-8340-50e69bb2504e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:48.376656 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bef5c-1cf8-4da9-8340-50e69bb2504e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:48.385783 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 511/1018] 10.222.0.31 () {60 vars in 1165 bytes} [Mon Jan 10 17:38:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:38:48.386062 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 508/1019] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:48.387606 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7326c-ef7c-4cd5-8902-4030e7b4cecd admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:48.408320 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7326c-ef7c-4cd5-8902-4030e7b4cecd admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:48.413062 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5271d-7b8f-4def-957f-81f97a84843b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:48.413801 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5271d-7b8f-4def-957f-81f97a84843b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:48.414082 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5271d-7b8f-4def-957f-81f97a84843b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:48.414375 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5271d-7b8f-4def-957f-81f97a84843b admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:48.415117 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5271d-7b8f-4def-957f-81f97a84843b admin admin] RBAC: Adding query filter params (type=image) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:48.415425 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5271d-7b8f-4def-957f-81f97a84843b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:48.417120 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5271d-7b8f-4def-957f-81f97a84843b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:48.422839 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 512/1020] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:48.429114 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bef5c-1cf8-4da9-8340-50e69bb2504e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:48.439196 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bef5c-1cf8-4da9-8340-50e69bb2504e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:48.443942 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e00034-162f-45d6-a86f-84284d320a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:48.444624 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e00034-162f-45d6-a86f-84284d320a58 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:48.444926 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e00034-162f-45d6-a86f-84284d320a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:48.445199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e00034-162f-45d6-a86f-84284d320a58 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:48.446021 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e00034-162f-45d6-a86f-84284d320a58 admin admin] RBAC: Adding query filter params (interface=public, service_id=e57c27b72090416388733b76d7f2d908, region_id=RegionOne) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:48.446327 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e00034-162f-45d6-a86f-84284d320a58 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:48.447958 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e00034-162f-45d6-a86f-84284d320a58 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:48.456936 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 509/1021] 10.222.0.31 () {56 vars in 1272 bytes} [Mon Jan 10 17:38:48 2022] GET /identity/v3/endpoints?service_id=e57c27b72090416388733b76d7f2d908&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:48.460032 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5271d-7b8f-4def-957f-81f97a84843b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:48.470487 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5271d-7b8f-4def-957f-81f97a84843b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:48.475676 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf5c20-4455-4865-a35e-b65bbc85e387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:48.476352 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf5c20-4455-4865-a35e-b65bbc85e387 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:48.476632 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf5c20-4455-4865-a35e-b65bbc85e387 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:48.476929 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf5c20-4455-4865-a35e-b65bbc85e387 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:48.477631 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf5c20-4455-4865-a35e-b65bbc85e387 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:48.479246 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf5c20-4455-4865-a35e-b65bbc85e387 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:48.493370 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 513/1022] 10.222.0.31 () {56 vars in 1108 bytes} [Mon Jan 10 17:38:48 2022] GET /identity/v3/services => generated 1957 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:38:50.339030 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1851065-b689-4df3-9757-0c26e6c495db None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:50.339581 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1851065-b689-4df3-9757-0c26e6c495db None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:50.339581 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1851065-b689-4df3-9757-0c26e6c495db None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:50.341395 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 510/1023] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:50.346829 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351beb9f-a2ed-4dbf-a4c4-af873e5b7a42 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:50.347261 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351beb9f-a2ed-4dbf-a4c4-af873e5b7a42 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:50.347400 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351beb9f-a2ed-4dbf-a4c4-af873e5b7a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:50.366027 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-351beb9f-a2ed-4dbf-a4c4-af873e5b7a42 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:50.367224 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-351beb9f-a2ed-4dbf-a4c4-af873e5b7a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:50.375388 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 514/1024] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:50 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:50.401044 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1851065-b689-4df3-9757-0c26e6c495db None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:50.414230 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1851065-b689-4df3-9757-0c26e6c495db None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:50.419143 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a0b1a-1f99-47b3-9b41-b4744627fb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:50.419972 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a0b1a-1f99-47b3-9b41-b4744627fb6b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:50.420248 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a0b1a-1f99-47b3-9b41-b4744627fb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:50.420516 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a0b1a-1f99-47b3-9b41-b4744627fb6b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:50.421913 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a0b1a-1f99-47b3-9b41-b4744627fb6b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:50.423793 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a0b1a-1f99-47b3-9b41-b4744627fb6b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:50.425744 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 511/1025] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:50.431654 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351beb9f-a2ed-4dbf-a4c4-af873e5b7a42 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:50.441567 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351beb9f-a2ed-4dbf-a4c4-af873e5b7a42 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:50.446146 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fbc1e-4d1d-40c0-9ec8-3f20214306c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:50.446883 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fbc1e-4d1d-40c0-9ec8-3f20214306c2 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:50.447237 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fbc1e-4d1d-40c0-9ec8-3f20214306c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:50.447580 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fbc1e-4d1d-40c0-9ec8-3f20214306c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:50.448405 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fbc1e-4d1d-40c0-9ec8-3f20214306c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:50.450342 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fbc1e-4d1d-40c0-9ec8-3f20214306c2 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:50.479210 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 515/1026] 10.222.0.31 () {60 vars in 1162 bytes} [Mon Jan 10 17:38:50 2022] POST /identity/v3/projects => generated 311 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:38:50.860865 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1f16d-cf53-404f-ba4e-932fc23f858b None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:50.861301 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1f16d-cf53-404f-ba4e-932fc23f858b None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:50.861435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1f16d-cf53-404f-ba4e-932fc23f858b None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:50.863221 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 512/1027] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:50.868884 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71a0c7-1550-49c0-ac3a-77cc2fef6bc4 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:50.869152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71a0c7-1550-49c0-ac3a-77cc2fef6bc4 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:50.869458 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71a0c7-1550-49c0-ac3a-77cc2fef6bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:50.887447 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-3b71a0c7-1550-49c0-ac3a-77cc2fef6bc4 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:50.888609 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-3b71a0c7-1550-49c0-ac3a-77cc2fef6bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:50.946819 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 516/1028] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:50 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:50.971971 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1f16d-cf53-404f-ba4e-932fc23f858b None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:50.984818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1f16d-cf53-404f-ba4e-932fc23f858b None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:50.989434 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b4d03-70e5-45d0-b22a-32dd0a89d4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:50.990249 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b4d03-70e5-45d0-b22a-32dd0a89d4db admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:50.990534 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b4d03-70e5-45d0-b22a-32dd0a89d4db admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:50.990994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b4d03-70e5-45d0-b22a-32dd0a89d4db admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:51.002495 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b4d03-70e5-45d0-b22a-32dd0a89d4db admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:51.002721 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a015b-1903-4774-9840-5211f8cdb67b None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:51.002967 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a015b-1903-4774-9840-5211f8cdb67b None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:51.003246 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a015b-1903-4774-9840-5211f8cdb67b None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:51.005234 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 517/1029] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:38:51.009741 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a62513-e9af-433c-babd-40b3bfe6aae6 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:51.009871 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-bf2b4d03-70e5-45d0-b22a-32dd0a89d4db admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 10 17:38:51.010067 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a62513-e9af-433c-babd-40b3bfe6aae6 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:51.010290 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a62513-e9af-433c-babd-40b3bfe6aae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:51.011113 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 513/1030] 10.222.0.31 () {56 vars in 1141 bytes} [Mon Jan 10 17:38:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:51.016966 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b4d03-70e5-45d0-b22a-32dd0a89d4db admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:51.026736 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b4d03-70e5-45d0-b22a-32dd0a89d4db admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:51.031660 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bd196-9e5c-4492-b563-2c20c71bcf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:51.032289 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bd196-9e5c-4492-b563-2c20c71bcf13 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:51.032549 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bd196-9e5c-4492-b563-2c20c71bcf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:51.032877 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bd196-9e5c-4492-b563-2c20c71bcf13 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:51.033631 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49bd196-9e5c-4492-b563-2c20c71bcf13 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:51.033732 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-11a62513-e9af-433c-babd-40b3bfe6aae6 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:51.033927 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49bd196-9e5c-4492-b563-2c20c71bcf13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:51.034821 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-11a62513-e9af-433c-babd-40b3bfe6aae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:51.035514 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49bd196-9e5c-4492-b563-2c20c71bcf13 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:51.043906 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 514/1031] 10.222.0.31 () {56 vars in 1136 bytes} [Mon Jan 10 17:38:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:51.044177 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 518/1032] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:51 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:51.049456 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bd196-9e5c-4492-b563-2c20c71bcf13 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:51.058547 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bd196-9e5c-4492-b563-2c20c71bcf13 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:51.063118 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db22be-f52f-43b3-b302-022448248d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:51.063902 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db22be-f52f-43b3-b302-022448248d56 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:51.064229 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db22be-f52f-43b3-b302-022448248d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:51.064509 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db22be-f52f-43b3-b302-022448248d56 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:51.069576 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a62513-e9af-433c-babd-40b3bfe6aae6 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:51.075467 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db22be-f52f-43b3-b302-022448248d56 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:51.077387 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db22be-f52f-43b3-b302-022448248d56 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:51.078353 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a62513-e9af-433c-babd-40b3bfe6aae6 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:51.082980 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653827f-2660-4a4c-9d9e-0cbd12784204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:51.083766 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653827f-2660-4a4c-9d9e-0cbd12784204 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:51.084043 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653827f-2660-4a4c-9d9e-0cbd12784204 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:51.084311 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653827f-2660-4a4c-9d9e-0cbd12784204 admin admin] PATH_INFO: `/v3/services/image` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:51.085002 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653827f-2660-4a4c-9d9e-0cbd12784204 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:51.086575 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653827f-2660-4a4c-9d9e-0cbd12784204 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:51.094237 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-32db22be-f52f-43b3-b302-022448248d56 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:51.100118 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 515/1033] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:51.100235 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-8653827f-2660-4a4c-9d9e-0cbd12784204 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 10 17:38:51.100235 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 519/1034] 10.222.0.31 () {56 vars in 1126 bytes} [Mon Jan 10 17:38:51 2022] GET /identity/v3/services/image => generated 86 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:51.101771 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db22be-f52f-43b3-b302-022448248d56 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:51.103966 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653827f-2660-4a4c-9d9e-0cbd12784204 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:51.110947 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db22be-f52f-43b3-b302-022448248d56 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:51.113313 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653827f-2660-4a4c-9d9e-0cbd12784204 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:51.115419 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ce3b2-2f02-45c8-a7dc-755f7593aebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:51.116041 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ce3b2-2f02-45c8-a7dc-755f7593aebe admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:51.116322 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ce3b2-2f02-45c8-a7dc-755f7593aebe admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:51.116601 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ce3b2-2f02-45c8-a7dc-755f7593aebe admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:51.117358 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ce3b2-2f02-45c8-a7dc-755f7593aebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:51.117663 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ce3b2-2f02-45c8-a7dc-755f7593aebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:51.117755 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba6749-14b7-44d1-83c2-6102277e8241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:51.118314 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba6749-14b7-44d1-83c2-6102277e8241 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:51.118595 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba6749-14b7-44d1-83c2-6102277e8241 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:51.118872 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba6749-14b7-44d1-83c2-6102277e8241 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:51.119228 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ce3b2-2f02-45c8-a7dc-755f7593aebe admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:51.119608 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba6749-14b7-44d1-83c2-6102277e8241 admin admin] RBAC: Adding query filter params (name=image) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:51.119911 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba6749-14b7-44d1-83c2-6102277e8241 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:51.121676 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba6749-14b7-44d1-83c2-6102277e8241 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:51.126339 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 520/1035] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:51.131061 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 516/1036] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:51.131635 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba6749-14b7-44d1-83c2-6102277e8241 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:51.136190 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ce3b2-2f02-45c8-a7dc-755f7593aebe admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:51.141354 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba6749-14b7-44d1-83c2-6102277e8241 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:51.146410 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee94e7-a7ef-4b67-824b-6e549eb235a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:51.146642 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ce3b2-2f02-45c8-a7dc-755f7593aebe admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:51.147476 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee94e7-a7ef-4b67-824b-6e549eb235a6 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:51.147973 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee94e7-a7ef-4b67-824b-6e549eb235a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:51.148751 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee94e7-a7ef-4b67-824b-6e549eb235a6 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:51.149705 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee94e7-a7ef-4b67-824b-6e549eb235a6 admin admin] RBAC: Adding query filter params (type=image) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:51.150178 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee94e7-a7ef-4b67-824b-6e549eb235a6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:51.151715 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e828e7-a666-4a85-aac3-dd75de547ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:51.152149 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee94e7-a7ef-4b67-824b-6e549eb235a6 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:51.152480 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e828e7-a666-4a85-aac3-dd75de547ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:51.152760 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e828e7-a666-4a85-aac3-dd75de547ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:51.153060 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e828e7-a666-4a85-aac3-dd75de547ba4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:51.158493 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 521/1037] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:51.160546 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e828e7-a666-4a85-aac3-dd75de547ba4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:51.163013 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e828e7-a666-4a85-aac3-dd75de547ba4 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:51.163821 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee94e7-a7ef-4b67-824b-6e549eb235a6 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:51.173681 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee94e7-a7ef-4b67-824b-6e549eb235a6 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:51.176514 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-38e828e7-a666-4a85-aac3-dd75de547ba4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 17:38:51.182301 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 517/1038] 10.222.0.31 () {56 vars in 1114 bytes} [Mon Jan 10 17:38:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:38:51.182414 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bc9f6-981f-4cfa-bbfc-00edd7f92473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:51.182414 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bc9f6-981f-4cfa-bbfc-00edd7f92473 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:51.182414 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bc9f6-981f-4cfa-bbfc-00edd7f92473 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:51.182414 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bc9f6-981f-4cfa-bbfc-00edd7f92473 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:51.182726 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bc9f6-981f-4cfa-bbfc-00edd7f92473 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:51.182726 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bc9f6-981f-4cfa-bbfc-00edd7f92473 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:51.183168 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e828e7-a666-4a85-aac3-dd75de547ba4 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:51.192360 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e828e7-a666-4a85-aac3-dd75de547ba4 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:51.197124 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfe5d3-d392-408d-9af7-412cb07109ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:51.197752 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfe5d3-d392-408d-9af7-412cb07109ed admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:51.198036 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfe5d3-d392-408d-9af7-412cb07109ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:51.198319 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfe5d3-d392-408d-9af7-412cb07109ed admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:51.199151 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfe5d3-d392-408d-9af7-412cb07109ed admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:51.199461 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfe5d3-d392-408d-9af7-412cb07109ed admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:51.201341 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfe5d3-d392-408d-9af7-412cb07109ed admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:51.202769 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 522/1039] 10.222.0.31 () {60 vars in 1165 bytes} [Mon Jan 10 17:38:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:38:51.224255 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 518/1040] 10.222.0.31 () {56 vars in 1154 bytes} [Mon Jan 10 17:38:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:51.229791 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bc9f6-981f-4cfa-bbfc-00edd7f92473 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:51.253743 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bc9f6-981f-4cfa-bbfc-00edd7f92473 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:51.258468 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aded4dd-dec5-4167-869e-e477b03881bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:51.259141 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aded4dd-dec5-4167-869e-e477b03881bc admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:51.259428 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aded4dd-dec5-4167-869e-e477b03881bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:51.259708 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aded4dd-dec5-4167-869e-e477b03881bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:51.269357 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aded4dd-dec5-4167-869e-e477b03881bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:51.271178 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aded4dd-dec5-4167-869e-e477b03881bc admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:51.282262 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 523/1041] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:51 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:38:51.288160 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfe5d3-d392-408d-9af7-412cb07109ed admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:51.300452 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfe5d3-d392-408d-9af7-412cb07109ed admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:51.305265 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407f93b-0fb6-4472-b747-ec10e04c6df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:51.306095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f93b-0fb6-4472-b747-ec10e04c6df2 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:51.306377 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f93b-0fb6-4472-b747-ec10e04c6df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:51.306654 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f93b-0fb6-4472-b747-ec10e04c6df2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:51.318225 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407f93b-0fb6-4472-b747-ec10e04c6df2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:51.320136 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407f93b-0fb6-4472-b747-ec10e04c6df2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:51.339499 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-3407f93b-0fb6-4472-b747-ec10e04c6df2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:51.341066 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 519/1042] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:51.347278 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aded4dd-dec5-4167-869e-e477b03881bc admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:51.357145 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aded4dd-dec5-4167-869e-e477b03881bc admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:51.362070 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dd484-014e-4d3e-a079-f3c54ab17fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:51.362989 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dd484-014e-4d3e-a079-f3c54ab17fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:51.363517 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dd484-014e-4d3e-a079-f3c54ab17fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:51.363862 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dd484-014e-4d3e-a079-f3c54ab17fd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:51.364689 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dd484-014e-4d3e-a079-f3c54ab17fd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:51.365099 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dd484-014e-4d3e-a079-f3c54ab17fd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:51.366794 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dd484-014e-4d3e-a079-f3c54ab17fd7 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:51.380184 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 524/1043] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:51.386227 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407f93b-0fb6-4472-b747-ec10e04c6df2 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:51.396305 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407f93b-0fb6-4472-b747-ec10e04c6df2 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:51.401449 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81f115-27af-4a10-aeb9-3bb4d300c20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:51.402270 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81f115-27af-4a10-aeb9-3bb4d300c20b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:51.402544 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81f115-27af-4a10-aeb9-3bb4d300c20b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:51.402806 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81f115-27af-4a10-aeb9-3bb4d300c20b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:51.410382 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81f115-27af-4a10-aeb9-3bb4d300c20b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:51.412390 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81f115-27af-4a10-aeb9-3bb4d300c20b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:51.425982 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-bd81f115-27af-4a10-aeb9-3bb4d300c20b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:51.427470 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 520/1044] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:51.433398 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dd484-014e-4d3e-a079-f3c54ab17fd7 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:51.444588 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dd484-014e-4d3e-a079-f3c54ab17fd7 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:51.449222 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dd6fa-258a-4b32-a1c6-c79d4a1fd304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:51.449871 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dd6fa-258a-4b32-a1c6-c79d4a1fd304 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:51.450147 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dd6fa-258a-4b32-a1c6-c79d4a1fd304 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:51.450416 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dd6fa-258a-4b32-a1c6-c79d4a1fd304 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:51.451207 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dd6fa-258a-4b32-a1c6-c79d4a1fd304 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:51.451509 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dd6fa-258a-4b32-a1c6-c79d4a1fd304 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:51.453375 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dd6fa-258a-4b32-a1c6-c79d4a1fd304 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:51.466350 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 525/1045] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:38:51.472478 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81f115-27af-4a10-aeb9-3bb4d300c20b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:51.483196 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81f115-27af-4a10-aeb9-3bb4d300c20b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:51.488434 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648856d0-4ca5-4935-9287-39ebbd47c221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:51.489095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648856d0-4ca5-4935-9287-39ebbd47c221 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:51.489371 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648856d0-4ca5-4935-9287-39ebbd47c221 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:51.489635 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648856d0-4ca5-4935-9287-39ebbd47c221 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:51.490474 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648856d0-4ca5-4935-9287-39ebbd47c221 admin admin] RBAC: Adding query filter params (role.id=154bb7abbd4e4872b138a1ce5d451348, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=877acd6448214ef893d119e3b1043402) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:51.490776 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648856d0-4ca5-4935-9287-39ebbd47c221 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:51.492659 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648856d0-4ca5-4935-9287-39ebbd47c221 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:51.498548 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 521/1046] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:38:51 2022] GET /identity/v3/role_assignments?user.id=877acd6448214ef893d119e3b1043402&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=154bb7abbd4e4872b138a1ce5d451348 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:52.908173 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d73b52-6075-453a-b399-0d1c3886d8a7 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:52.908744 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d73b52-6075-453a-b399-0d1c3886d8a7 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:52.908744 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d73b52-6075-453a-b399-0d1c3886d8a7 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:52.910622 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 526/1047] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:52.915897 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc6b23-ff53-4a2f-81c5-ca8fd4704fd3 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:52.916349 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc6b23-ff53-4a2f-81c5-ca8fd4704fd3 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:52.916435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc6b23-ff53-4a2f-81c5-ca8fd4704fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:52.934400 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-cabc6b23-ff53-4a2f-81c5-ca8fd4704fd3 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:52.935567 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-cabc6b23-ff53-4a2f-81c5-ca8fd4704fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:52.943922 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 522/1048] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:52 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:52.969868 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d73b52-6075-453a-b399-0d1c3886d8a7 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:52.982743 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d73b52-6075-453a-b399-0d1c3886d8a7 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:52.987644 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2490e-ba18-4ad4-a0eb-f59e0b7b1d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:52.988361 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2490e-ba18-4ad4-a0eb-f59e0b7b1d4c admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:52.988644 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2490e-ba18-4ad4-a0eb-f59e0b7b1d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:52.988945 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2490e-ba18-4ad4-a0eb-f59e0b7b1d4c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:52.990139 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2490e-ba18-4ad4-a0eb-f59e0b7b1d4c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:52.991814 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2490e-ba18-4ad4-a0eb-f59e0b7b1d4c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:52.993570 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 527/1049] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:52.999005 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc6b23-ff53-4a2f-81c5-ca8fd4704fd3 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:53.008379 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc6b23-ff53-4a2f-81c5-ca8fd4704fd3 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:53.012869 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038df1d-4015-48dc-acf8-a49371f9b2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:53.013538 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038df1d-4015-48dc-acf8-a49371f9b2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:53.013818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038df1d-4015-48dc-acf8-a49371f9b2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:53.014086 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038df1d-4015-48dc-acf8-a49371f9b2f2 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:53.014818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038df1d-4015-48dc-acf8-a49371f9b2f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:53.016727 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038df1d-4015-48dc-acf8-a49371f9b2f2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:53.040703 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 523/1050] 10.222.0.31 () {60 vars in 1153 bytes} [Mon Jan 10 17:38:52 2022] POST /identity/v3/users => generated 285 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:38:53.660784 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845f41f-b552-4758-9282-9bf787f7778d None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:53.661069 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845f41f-b552-4758-9282-9bf787f7778d None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:53.661365 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845f41f-b552-4758-9282-9bf787f7778d None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:53.663341 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 528/1051] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:53.669773 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a62a5-aa2d-4d29-b8db-d47632d13ab8 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:53.670162 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a62a5-aa2d-4d29-b8db-d47632d13ab8 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:53.670515 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a62a5-aa2d-4d29-b8db-d47632d13ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:53.688688 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-141a62a5-aa2d-4d29-b8db-d47632d13ab8 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:53.689991 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-141a62a5-aa2d-4d29-b8db-d47632d13ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:53.698576 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 524/1052] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:53 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:53.720898 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845f41f-b552-4758-9282-9bf787f7778d None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:53.733432 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845f41f-b552-4758-9282-9bf787f7778d None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:53.738467 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f354f-0107-4a07-b0aa-901ab73b981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:53.739286 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f354f-0107-4a07-b0aa-901ab73b981c admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:53.739638 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f354f-0107-4a07-b0aa-901ab73b981c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:53.739980 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f354f-0107-4a07-b0aa-901ab73b981c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:53.748018 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f354f-0107-4a07-b0aa-901ab73b981c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:53.749902 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f354f-0107-4a07-b0aa-901ab73b981c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:53.758785 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 529/1053] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:53 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:38:53.764633 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a62a5-aa2d-4d29-b8db-d47632d13ab8 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:53.774150 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a62a5-aa2d-4d29-b8db-d47632d13ab8 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:53.778936 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74355620-8369-4dec-a15e-31d7fa272ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:53.779880 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74355620-8369-4dec-a15e-31d7fa272ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:53.780228 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74355620-8369-4dec-a15e-31d7fa272ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:53.780568 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74355620-8369-4dec-a15e-31d7fa272ef1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:53.781926 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74355620-8369-4dec-a15e-31d7fa272ef1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:53.783715 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74355620-8369-4dec-a15e-31d7fa272ef1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:53.785483 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 525/1054] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:53.852886 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1742d-f190-4c20-a2ba-d7b58a313b3c None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:53.853255 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1742d-f190-4c20-a2ba-d7b58a313b3c None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:53.853447 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1742d-f190-4c20-a2ba-d7b58a313b3c None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:53.855559 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 530/1055] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:53.861443 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7593f6-25b8-4245-b93a-d556676d4ba0 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:53.861780 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7593f6-25b8-4245-b93a-d556676d4ba0 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:53.861953 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7593f6-25b8-4245-b93a-d556676d4ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:53.880904 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-5b7593f6-25b8-4245-b93a-d556676d4ba0 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:53.882115 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-5b7593f6-25b8-4245-b93a-d556676d4ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:53.890636 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 526/1056] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:53 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:53.915513 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1742d-f190-4c20-a2ba-d7b58a313b3c None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:53.929288 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1742d-f190-4c20-a2ba-d7b58a313b3c None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:53.934436 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da633c45-00a5-461a-89ba-c50cdc54fd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:53.935260 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da633c45-00a5-461a-89ba-c50cdc54fd17 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:53.935541 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da633c45-00a5-461a-89ba-c50cdc54fd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:53.935805 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da633c45-00a5-461a-89ba-c50cdc54fd17 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:53.947492 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da633c45-00a5-461a-89ba-c50cdc54fd17 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:53.954984 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-da633c45-00a5-461a-89ba-c50cdc54fd17 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 10 17:38:53.956631 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 531/1057] 10.222.0.31 () {56 vars in 1141 bytes} [Mon Jan 10 17:38:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:53.963306 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7593f6-25b8-4245-b93a-d556676d4ba0 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:53.973117 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7593f6-25b8-4245-b93a-d556676d4ba0 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:53.978053 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda44bbd-465e-4ec1-8110-a535843afe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:53.978756 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda44bbd-465e-4ec1-8110-a535843afe88 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:53.979037 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda44bbd-465e-4ec1-8110-a535843afe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:53.979310 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda44bbd-465e-4ec1-8110-a535843afe88 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:53.980150 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda44bbd-465e-4ec1-8110-a535843afe88 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:53.980459 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda44bbd-465e-4ec1-8110-a535843afe88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:53.982123 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda44bbd-465e-4ec1-8110-a535843afe88 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:53.992756 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 527/1058] 10.222.0.31 () {56 vars in 1136 bytes} [Mon Jan 10 17:38:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:53.997983 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da633c45-00a5-461a-89ba-c50cdc54fd17 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:54.008884 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da633c45-00a5-461a-89ba-c50cdc54fd17 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:54.013495 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cbcd3-f36e-48b8-81e6-432a8fb53926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:54.014355 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cbcd3-f36e-48b8-81e6-432a8fb53926 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:54.014636 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cbcd3-f36e-48b8-81e6-432a8fb53926 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:54.014914 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cbcd3-f36e-48b8-81e6-432a8fb53926 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:54.026699 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cbcd3-f36e-48b8-81e6-432a8fb53926 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:54.028579 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cbcd3-f36e-48b8-81e6-432a8fb53926 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:54.045753 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-a14cbcd3-f36e-48b8-81e6-432a8fb53926 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:54.047161 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 532/1059] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:54.052946 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda44bbd-465e-4ec1-8110-a535843afe88 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:54.063023 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda44bbd-465e-4ec1-8110-a535843afe88 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:54.067911 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982ff82-6fd7-46c5-b2d3-92cd42d8be2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:54.068598 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982ff82-6fd7-46c5-b2d3-92cd42d8be2e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:54.068917 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982ff82-6fd7-46c5-b2d3-92cd42d8be2e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:54.069204 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982ff82-6fd7-46c5-b2d3-92cd42d8be2e admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:54.069926 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982ff82-6fd7-46c5-b2d3-92cd42d8be2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:54.070234 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982ff82-6fd7-46c5-b2d3-92cd42d8be2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:54.071848 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982ff82-6fd7-46c5-b2d3-92cd42d8be2e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:54.085172 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 528/1060] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:54.090933 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cbcd3-f36e-48b8-81e6-432a8fb53926 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:54.101079 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cbcd3-f36e-48b8-81e6-432a8fb53926 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:54.105794 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771df571-b6a0-4b1a-bce7-64eef338b95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:54.106588 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771df571-b6a0-4b1a-bce7-64eef338b95b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:54.106869 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771df571-b6a0-4b1a-bce7-64eef338b95b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:54.107132 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771df571-b6a0-4b1a-bce7-64eef338b95b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:54.115099 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771df571-b6a0-4b1a-bce7-64eef338b95b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:54.117184 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771df571-b6a0-4b1a-bce7-64eef338b95b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:54.131432 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-771df571-b6a0-4b1a-bce7-64eef338b95b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 17:38:54.132621 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 533/1061] 10.222.0.31 () {56 vars in 1114 bytes} [Mon Jan 10 17:38:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:54.138651 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982ff82-6fd7-46c5-b2d3-92cd42d8be2e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:54.149354 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982ff82-6fd7-46c5-b2d3-92cd42d8be2e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:54.154034 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fa47e-bf29-495e-9cf0-d7afdc5b2cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:54.154905 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fa47e-bf29-495e-9cf0-d7afdc5b2cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:54.155095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fa47e-bf29-495e-9cf0-d7afdc5b2cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:54.155352 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fa47e-bf29-495e-9cf0-d7afdc5b2cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:54.156208 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fa47e-bf29-495e-9cf0-d7afdc5b2cd0 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:54.156516 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fa47e-bf29-495e-9cf0-d7afdc5b2cd0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:54.158432 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fa47e-bf29-495e-9cf0-d7afdc5b2cd0 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:54.175714 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 529/1062] 10.222.0.31 () {56 vars in 1154 bytes} [Mon Jan 10 17:38:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:54.181486 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771df571-b6a0-4b1a-bce7-64eef338b95b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:54.191216 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771df571-b6a0-4b1a-bce7-64eef338b95b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:54.195717 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4438c-37a2-45eb-b3e8-be8f6c425338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:54.196593 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4438c-37a2-45eb-b3e8-be8f6c425338 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:54.196907 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4438c-37a2-45eb-b3e8-be8f6c425338 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:54.197187 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4438c-37a2-45eb-b3e8-be8f6c425338 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:54.207321 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4438c-37a2-45eb-b3e8-be8f6c425338 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:54.209190 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4438c-37a2-45eb-b3e8-be8f6c425338 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:54.225667 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-f7d4438c-37a2-45eb-b3e8-be8f6c425338 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:54.227033 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 534/1063] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:54.232665 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fa47e-bf29-495e-9cf0-d7afdc5b2cd0 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:54.242931 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fa47e-bf29-495e-9cf0-d7afdc5b2cd0 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:54.248639 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35274eb0-4bd1-43a0-8f58-a4f3c81d92c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:54.249361 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35274eb0-4bd1-43a0-8f58-a4f3c81d92c3 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:54.249644 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35274eb0-4bd1-43a0-8f58-a4f3c81d92c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:54.249918 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35274eb0-4bd1-43a0-8f58-a4f3c81d92c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:54.250691 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35274eb0-4bd1-43a0-8f58-a4f3c81d92c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:54.250993 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35274eb0-4bd1-43a0-8f58-a4f3c81d92c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:54.252718 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35274eb0-4bd1-43a0-8f58-a4f3c81d92c3 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:54.264873 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 530/1064] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:54.270621 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4438c-37a2-45eb-b3e8-be8f6c425338 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:54.280686 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4438c-37a2-45eb-b3e8-be8f6c425338 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:54.285588 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dd65c-e9b6-4d6b-9b32-ec95da805f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:54.286368 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dd65c-e9b6-4d6b-9b32-ec95da805f23 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:54.286647 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dd65c-e9b6-4d6b-9b32-ec95da805f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:54.286938 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dd65c-e9b6-4d6b-9b32-ec95da805f23 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:54.293719 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4dd65c-e9b6-4d6b-9b32-ec95da805f23 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:54.295669 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4dd65c-e9b6-4d6b-9b32-ec95da805f23 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:54.308526 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-ad4dd65c-e9b6-4d6b-9b32-ec95da805f23 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:54.309701 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 535/1065] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:54.315858 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35274eb0-4bd1-43a0-8f58-a4f3c81d92c3 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:54.325642 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35274eb0-4bd1-43a0-8f58-a4f3c81d92c3 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:54.330589 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6899f8-68e5-4056-a85b-fd56fc9745c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:54.331242 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6899f8-68e5-4056-a85b-fd56fc9745c6 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:54.331527 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6899f8-68e5-4056-a85b-fd56fc9745c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:54.331803 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6899f8-68e5-4056-a85b-fd56fc9745c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:54.332598 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6899f8-68e5-4056-a85b-fd56fc9745c6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:54.332905 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6899f8-68e5-4056-a85b-fd56fc9745c6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:54.334784 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6899f8-68e5-4056-a85b-fd56fc9745c6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:54.347196 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 531/1066] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:54.353263 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dd65c-e9b6-4d6b-9b32-ec95da805f23 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:54.364151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dd65c-e9b6-4d6b-9b32-ec95da805f23 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:54.369863 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7503e0-9676-4de9-be93-5db5e6e80368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:54.370808 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7503e0-9676-4de9-be93-5db5e6e80368 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:54.371083 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7503e0-9676-4de9-be93-5db5e6e80368 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:54.371352 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7503e0-9676-4de9-be93-5db5e6e80368 admin admin] PATH_INFO: `/v3/projects/1415eea0335a49bf800e8215498af679/users/877acd6448214ef893d119e3b1043402/roles/154bb7abbd4e4872b138a1ce5d451348` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:54.373755 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7503e0-9676-4de9-be93-5db5e6e80368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1415eea0335a49bf800e8215498af679, user_id=877acd6448214ef893d119e3b1043402, role_id=154bb7abbd4e4872b138a1ce5d451348)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:54.376536 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7503e0-9676-4de9-be93-5db5e6e80368 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:54.391690 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 536/1067] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:38:54 2022] PUT /identity/v3/projects/1415eea0335a49bf800e8215498af679/users/877acd6448214ef893d119e3b1043402/roles/154bb7abbd4e4872b138a1ce5d451348 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:38:55.495407 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae13e4-7310-4f3e-b167-af1448b3d829 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:55.496047 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae13e4-7310-4f3e-b167-af1448b3d829 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:55.496047 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae13e4-7310-4f3e-b167-af1448b3d829 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:55.497781 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 532/1068] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:55.503377 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb042e-7e7a-4cf4-8483-16918cc12399 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:55.503814 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb042e-7e7a-4cf4-8483-16918cc12399 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:55.503900 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb042e-7e7a-4cf4-8483-16918cc12399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:55.521606 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-eadb042e-7e7a-4cf4-8483-16918cc12399 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:55.522776 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-eadb042e-7e7a-4cf4-8483-16918cc12399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:55.580596 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 537/1069] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:55 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:55.605831 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae13e4-7310-4f3e-b167-af1448b3d829 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:55.620042 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae13e4-7310-4f3e-b167-af1448b3d829 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:55.625155 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91ef4a-db03-4937-ad83-7ebd42f356b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:55.625956 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91ef4a-db03-4937-ad83-7ebd42f356b1 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:55.626239 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91ef4a-db03-4937-ad83-7ebd42f356b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:55.626517 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91ef4a-db03-4937-ad83-7ebd42f356b1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:55.637031 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91ef4a-db03-4937-ad83-7ebd42f356b1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:55.643830 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-2c91ef4a-db03-4937-ad83-7ebd42f356b1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:38:55.645058 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 533/1070] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:38:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:55.651403 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb042e-7e7a-4cf4-8483-16918cc12399 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:55.660478 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb042e-7e7a-4cf4-8483-16918cc12399 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:55.665276 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4cf90-7b57-406f-9ca9-df07b05bd983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:55.665933 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4cf90-7b57-406f-9ca9-df07b05bd983 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:55.666217 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4cf90-7b57-406f-9ca9-df07b05bd983 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:55.666494 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4cf90-7b57-406f-9ca9-df07b05bd983 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:55.667252 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4cf90-7b57-406f-9ca9-df07b05bd983 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:55.667560 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4cf90-7b57-406f-9ca9-df07b05bd983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:55.669189 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4cf90-7b57-406f-9ca9-df07b05bd983 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:55.678299 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 538/1071] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:38:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:55.683927 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91ef4a-db03-4937-ad83-7ebd42f356b1 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:55.694500 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91ef4a-db03-4937-ad83-7ebd42f356b1 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:55.699704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf53cdc-04fd-4467-8ebd-5724d525a22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:55.700562 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf53cdc-04fd-4467-8ebd-5724d525a22f admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:55.700841 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf53cdc-04fd-4467-8ebd-5724d525a22f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:55.701157 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf53cdc-04fd-4467-8ebd-5724d525a22f admin admin] PATH_INFO: `/v3/users/ee09ec0356fe41dfa9f8e0878fe0cd0a` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:55.718081 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf53cdc-04fd-4467-8ebd-5724d525a22f admin admin] RBAC: Authorizing `identity:get_user(user_id=ee09ec0356fe41dfa9f8e0878fe0cd0a)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:55.718081 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf53cdc-04fd-4467-8ebd-5724d525a22f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:55.724179 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 534/1072] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:38:55 2022] GET /identity/v3/users/ee09ec0356fe41dfa9f8e0878fe0cd0a => generated 285 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:55.725319 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4cf90-7b57-406f-9ca9-df07b05bd983 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:55.736479 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4cf90-7b57-406f-9ca9-df07b05bd983 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:55.742440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6722f-11e3-44cb-b004-a5ca362ce2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:55.743086 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6722f-11e3-44cb-b004-a5ca362ce2ae admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:55.743366 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6722f-11e3-44cb-b004-a5ca362ce2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:55.743646 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6722f-11e3-44cb-b004-a5ca362ce2ae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:55.752372 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6722f-11e3-44cb-b004-a5ca362ce2ae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:55.754103 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6722f-11e3-44cb-b004-a5ca362ce2ae admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:55.768367 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 539/1073] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:55 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:38:55.769677 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf53cdc-04fd-4467-8ebd-5724d525a22f admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:55.780609 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf53cdc-04fd-4467-8ebd-5724d525a22f admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:55.785692 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e4347-e755-4d2d-9885-3c00c9977609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:55.786545 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e4347-e755-4d2d-9885-3c00c9977609 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:55.786827 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e4347-e755-4d2d-9885-3c00c9977609 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:55.787103 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e4347-e755-4d2d-9885-3c00c9977609 admin admin] PATH_INFO: `/v3/projects/8ccd23a46376495da10da3a48805bd42` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:55.788324 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e4347-e755-4d2d-9885-3c00c9977609 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ccd23a46376495da10da3a48805bd42)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:55.790437 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e4347-e755-4d2d-9885-3c00c9977609 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:55.792084 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 535/1074] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:38:55 2022] GET /identity/v3/projects/8ccd23a46376495da10da3a48805bd42 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:55.798022 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6722f-11e3-44cb-b004-a5ca362ce2ae admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:55.807153 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6722f-11e3-44cb-b004-a5ca362ce2ae admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:55.812120 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047e020-cdec-4ab0-8b03-bcff2cb723de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:55.812757 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047e020-cdec-4ab0-8b03-bcff2cb723de admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:55.813077 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047e020-cdec-4ab0-8b03-bcff2cb723de admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:55.813354 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047e020-cdec-4ab0-8b03-bcff2cb723de admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:55.814244 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047e020-cdec-4ab0-8b03-bcff2cb723de admin admin] RBAC: Adding query filter params (role.id=3c05bedf79e04eb38d2ae66736030bfe, scope.project.id=8ccd23a46376495da10da3a48805bd42, user.id=ee09ec0356fe41dfa9f8e0878fe0cd0a) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:55.814553 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047e020-cdec-4ab0-8b03-bcff2cb723de admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:55.816414 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047e020-cdec-4ab0-8b03-bcff2cb723de admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:55.821761 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 540/1075] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:38:55 2022] GET /identity/v3/role_assignments?user.id=ee09ec0356fe41dfa9f8e0878fe0cd0a&scope.project.id=8ccd23a46376495da10da3a48805bd42&role.id=3c05bedf79e04eb38d2ae66736030bfe => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:56.726400 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5429e09-2674-4c2e-9361-93faeffa0001 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:56.726992 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5429e09-2674-4c2e-9361-93faeffa0001 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:56.726992 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5429e09-2674-4c2e-9361-93faeffa0001 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:56.728914 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 536/1076] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:56.734253 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028eeb8-d330-4dcf-968b-4ed13a43a80f None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:56.734708 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028eeb8-d330-4dcf-968b-4ed13a43a80f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:56.734799 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028eeb8-d330-4dcf-968b-4ed13a43a80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:56.754124 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-1028eeb8-d330-4dcf-968b-4ed13a43a80f None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:56.755316 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-1028eeb8-d330-4dcf-968b-4ed13a43a80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:56.764757 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 541/1077] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:56 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:56.790547 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5429e09-2674-4c2e-9361-93faeffa0001 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:56.804359 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5429e09-2674-4c2e-9361-93faeffa0001 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:56.809270 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747587fc-6637-4da1-9663-71d66aff67ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:56.810071 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747587fc-6637-4da1-9663-71d66aff67ea admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:56.810344 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747587fc-6637-4da1-9663-71d66aff67ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:56.810612 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747587fc-6637-4da1-9663-71d66aff67ea admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:56.821116 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747587fc-6637-4da1-9663-71d66aff67ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:56.828162 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-747587fc-6637-4da1-9663-71d66aff67ea admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 10 17:38:56.829358 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 537/1078] 10.222.0.31 () {56 vars in 1141 bytes} [Mon Jan 10 17:38:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:56.835509 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028eeb8-d330-4dcf-968b-4ed13a43a80f None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:56.845060 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028eeb8-d330-4dcf-968b-4ed13a43a80f None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:56.851073 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36210d8d-d475-4cfc-83bd-591fd3de9641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:56.851845 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36210d8d-d475-4cfc-83bd-591fd3de9641 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:56.852196 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36210d8d-d475-4cfc-83bd-591fd3de9641 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:56.852542 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36210d8d-d475-4cfc-83bd-591fd3de9641 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:56.853355 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36210d8d-d475-4cfc-83bd-591fd3de9641 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:56.853662 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36210d8d-d475-4cfc-83bd-591fd3de9641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:56.855265 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36210d8d-d475-4cfc-83bd-591fd3de9641 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:56.864244 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 542/1079] 10.222.0.31 () {56 vars in 1136 bytes} [Mon Jan 10 17:38:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:56.870086 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747587fc-6637-4da1-9663-71d66aff67ea admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:56.880890 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747587fc-6637-4da1-9663-71d66aff67ea admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:56.886627 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35863feb-c7a3-45c0-93f3-0e7ef7d00c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:56.887407 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35863feb-c7a3-45c0-93f3-0e7ef7d00c17 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:56.887686 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35863feb-c7a3-45c0-93f3-0e7ef7d00c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:56.887954 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35863feb-c7a3-45c0-93f3-0e7ef7d00c17 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:56.899499 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35863feb-c7a3-45c0-93f3-0e7ef7d00c17 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:56.901435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35863feb-c7a3-45c0-93f3-0e7ef7d00c17 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:56.918243 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-35863feb-c7a3-45c0-93f3-0e7ef7d00c17 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:56.919425 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 538/1080] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:56.925453 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36210d8d-d475-4cfc-83bd-591fd3de9641 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:56.935718 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36210d8d-d475-4cfc-83bd-591fd3de9641 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:56.941237 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305fce5-c1d6-4af1-84ac-f3073ce29448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:56.941894 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305fce5-c1d6-4af1-84ac-f3073ce29448 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:56.942174 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305fce5-c1d6-4af1-84ac-f3073ce29448 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:56.942444 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305fce5-c1d6-4af1-84ac-f3073ce29448 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:56.943172 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305fce5-c1d6-4af1-84ac-f3073ce29448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:56.943475 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305fce5-c1d6-4af1-84ac-f3073ce29448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:56.945102 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305fce5-c1d6-4af1-84ac-f3073ce29448 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:56.962655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 543/1081] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:56.964229 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35863feb-c7a3-45c0-93f3-0e7ef7d00c17 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:56.974462 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35863feb-c7a3-45c0-93f3-0e7ef7d00c17 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:56.979605 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360a706-d52a-4c53-a08f-870ee0423bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:56.980334 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360a706-d52a-4c53-a08f-870ee0423bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:56.980609 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360a706-d52a-4c53-a08f-870ee0423bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:56.980880 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360a706-d52a-4c53-a08f-870ee0423bc5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:56.989019 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360a706-d52a-4c53-a08f-870ee0423bc5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:56.991033 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360a706-d52a-4c53-a08f-870ee0423bc5 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:57.005040 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-9360a706-d52a-4c53-a08f-870ee0423bc5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 17:38:57.006200 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 539/1082] 10.222.0.31 () {56 vars in 1114 bytes} [Mon Jan 10 17:38:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:57.012149 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305fce5-c1d6-4af1-84ac-f3073ce29448 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:57.022608 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305fce5-c1d6-4af1-84ac-f3073ce29448 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:57.028821 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdecda-96ba-4748-80bd-036c7f04ee20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:57.029480 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdecda-96ba-4748-80bd-036c7f04ee20 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:57.029759 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdecda-96ba-4748-80bd-036c7f04ee20 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:57.030025 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdecda-96ba-4748-80bd-036c7f04ee20 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:57.030876 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdecda-96ba-4748-80bd-036c7f04ee20 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:57.031184 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdecda-96ba-4748-80bd-036c7f04ee20 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:57.033054 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdecda-96ba-4748-80bd-036c7f04ee20 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:57.050712 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 544/1083] 10.222.0.31 () {56 vars in 1154 bytes} [Mon Jan 10 17:38:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:57.056512 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360a706-d52a-4c53-a08f-870ee0423bc5 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:57.066304 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360a706-d52a-4c53-a08f-870ee0423bc5 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:57.071205 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2f372-056e-4759-8840-fa40f27261c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:57.071828 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2f372-056e-4759-8840-fa40f27261c4 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:57.072101 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2f372-056e-4759-8840-fa40f27261c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:57.072371 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2f372-056e-4759-8840-fa40f27261c4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:57.080035 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2f372-056e-4759-8840-fa40f27261c4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:57.081786 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2f372-056e-4759-8840-fa40f27261c4 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:57.090315 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 540/1084] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:38:57 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:38:57.095889 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdecda-96ba-4748-80bd-036c7f04ee20 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:57.105492 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdecda-96ba-4748-80bd-036c7f04ee20 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:57.111337 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e859a31-d545-4968-8e5a-b4386129b045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:57.112127 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e859a31-d545-4968-8e5a-b4386129b045 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:57.112438 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e859a31-d545-4968-8e5a-b4386129b045 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:57.112710 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e859a31-d545-4968-8e5a-b4386129b045 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:57.124425 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e859a31-d545-4968-8e5a-b4386129b045 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:57.126287 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e859a31-d545-4968-8e5a-b4386129b045 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:57.143916 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-1e859a31-d545-4968-8e5a-b4386129b045 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:38:57.145197 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 545/1085] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:38:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:57.151640 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2f372-056e-4759-8840-fa40f27261c4 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:57.160913 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2f372-056e-4759-8840-fa40f27261c4 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:57.166411 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ee71f-8b8e-495f-ad89-9b5d266f2ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:57.167095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ee71f-8b8e-495f-ad89-9b5d266f2ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:57.167383 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ee71f-8b8e-495f-ad89-9b5d266f2ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:57.167695 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ee71f-8b8e-495f-ad89-9b5d266f2ff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:57.168434 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ee71f-8b8e-495f-ad89-9b5d266f2ff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:57.168778 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ee71f-8b8e-495f-ad89-9b5d266f2ff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:57.170456 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ee71f-8b8e-495f-ad89-9b5d266f2ff8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:57.182296 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 541/1086] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:57.187947 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e859a31-d545-4968-8e5a-b4386129b045 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:57.197883 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e859a31-d545-4968-8e5a-b4386129b045 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:57.202609 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604522b-0b6c-4db5-b0f6-bd310ae18dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:57.203385 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604522b-0b6c-4db5-b0f6-bd310ae18dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:57.203669 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604522b-0b6c-4db5-b0f6-bd310ae18dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:57.203943 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604522b-0b6c-4db5-b0f6-bd310ae18dc4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:57.210751 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604522b-0b6c-4db5-b0f6-bd310ae18dc4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:57.212678 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604522b-0b6c-4db5-b0f6-bd310ae18dc4 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:57.225401 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-f604522b-0b6c-4db5-b0f6-bd310ae18dc4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:38:57.226532 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 546/1087] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:38:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:57.232586 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ee71f-8b8e-495f-ad89-9b5d266f2ff8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:57.242214 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ee71f-8b8e-495f-ad89-9b5d266f2ff8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:57.247108 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8efc22-5644-412f-9cbb-e593001a1739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:57.247764 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8efc22-5644-412f-9cbb-e593001a1739 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:57.248047 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8efc22-5644-412f-9cbb-e593001a1739 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:57.248317 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8efc22-5644-412f-9cbb-e593001a1739 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:57.249176 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8efc22-5644-412f-9cbb-e593001a1739 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:57.249487 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8efc22-5644-412f-9cbb-e593001a1739 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:57.251411 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8efc22-5644-412f-9cbb-e593001a1739 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:57.264978 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 542/1088] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:38:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:57.271431 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604522b-0b6c-4db5-b0f6-bd310ae18dc4 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:57.283545 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604522b-0b6c-4db5-b0f6-bd310ae18dc4 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:57.288542 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d05547-0355-453e-a728-23380ef64ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:57.289290 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d05547-0355-453e-a728-23380ef64ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:57.289567 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d05547-0355-453e-a728-23380ef64ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:57.289840 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d05547-0355-453e-a728-23380ef64ec8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:57.290700 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d05547-0355-453e-a728-23380ef64ec8 admin admin] RBAC: Adding query filter params (role.id=154bb7abbd4e4872b138a1ce5d451348, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=877acd6448214ef893d119e3b1043402) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:57.290981 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d05547-0355-453e-a728-23380ef64ec8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:57.292815 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d05547-0355-453e-a728-23380ef64ec8 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:57.298677 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 547/1089] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:38:57 2022] GET /identity/v3/role_assignments?user.id=877acd6448214ef893d119e3b1043402&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=154bb7abbd4e4872b138a1ce5d451348 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:58.302891 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05688b1-1fcf-4087-86ea-ddc2d1d3944d None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:58.303679 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05688b1-1fcf-4087-86ea-ddc2d1d3944d None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:58.303771 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05688b1-1fcf-4087-86ea-ddc2d1d3944d None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:58.306709 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 543/1090] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:38:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:38:58.313068 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dd88d-16bb-4b22-a54e-8d9fa98aa244 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:58.313526 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dd88d-16bb-4b22-a54e-8d9fa98aa244 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:58.313628 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dd88d-16bb-4b22-a54e-8d9fa98aa244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:58.342465 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-149dd88d-16bb-4b22-a54e-8d9fa98aa244 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:38:58.344345 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-149dd88d-16bb-4b22-a54e-8d9fa98aa244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:38:58.353295 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 548/1091] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:38:58 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:38:58.378161 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05688b1-1fcf-4087-86ea-ddc2d1d3944d None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:58.398008 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05688b1-1fcf-4087-86ea-ddc2d1d3944d None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:58.404556 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d4209-f22a-4faf-8c5c-98be61e7527b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:58.405359 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d4209-f22a-4faf-8c5c-98be61e7527b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:58.405640 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d4209-f22a-4faf-8c5c-98be61e7527b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:58.405911 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d4209-f22a-4faf-8c5c-98be61e7527b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:58.417707 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d4209-f22a-4faf-8c5c-98be61e7527b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:38:58.424426 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-202d4209-f22a-4faf-8c5c-98be61e7527b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:38:58.425576 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 544/1092] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:38:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:38:58.432759 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dd88d-16bb-4b22-a54e-8d9fa98aa244 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:58.446073 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dd88d-16bb-4b22-a54e-8d9fa98aa244 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:58.453892 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac04ddd-93ed-4ae4-8904-9abc7ec8e91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:58.454853 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac04ddd-93ed-4ae4-8904-9abc7ec8e91b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:58.455140 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac04ddd-93ed-4ae4-8904-9abc7ec8e91b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:58.455418 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac04ddd-93ed-4ae4-8904-9abc7ec8e91b admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:58.456176 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac04ddd-93ed-4ae4-8904-9abc7ec8e91b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:38:58.456486 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac04ddd-93ed-4ae4-8904-9abc7ec8e91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:58.458116 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac04ddd-93ed-4ae4-8904-9abc7ec8e91b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:58.466192 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 549/1093] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:38:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:58.471989 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d4209-f22a-4faf-8c5c-98be61e7527b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:58.482518 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d4209-f22a-4faf-8c5c-98be61e7527b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:58.488806 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65dee8-ae23-496b-b721-95c492914ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:58.489671 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65dee8-ae23-496b-b721-95c492914ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:58.489948 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65dee8-ae23-496b-b721-95c492914ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:58.490217 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65dee8-ae23-496b-b721-95c492914ad3 admin admin] PATH_INFO: `/v3/users/ee09ec0356fe41dfa9f8e0878fe0cd0a` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:58.491645 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65dee8-ae23-496b-b721-95c492914ad3 admin admin] RBAC: Authorizing `identity:get_user(user_id=ee09ec0356fe41dfa9f8e0878fe0cd0a)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:58.493814 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65dee8-ae23-496b-b721-95c492914ad3 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:58.495354 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 545/1094] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:38:58 2022] GET /identity/v3/users/ee09ec0356fe41dfa9f8e0878fe0cd0a => generated 285 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:58.500440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac04ddd-93ed-4ae4-8904-9abc7ec8e91b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:58.509937 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac04ddd-93ed-4ae4-8904-9abc7ec8e91b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:58.515162 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7224f2-ebff-4dcd-8698-373366809972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:58.515974 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7224f2-ebff-4dcd-8698-373366809972 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:58.516257 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7224f2-ebff-4dcd-8698-373366809972 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:58.516531 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7224f2-ebff-4dcd-8698-373366809972 admin admin] PATH_INFO: `/v3/projects/8ccd23a46376495da10da3a48805bd42` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:58.518176 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7224f2-ebff-4dcd-8698-373366809972 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ccd23a46376495da10da3a48805bd42)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:58.520175 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7224f2-ebff-4dcd-8698-373366809972 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:58.521807 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 550/1095] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:38:58 2022] GET /identity/v3/projects/8ccd23a46376495da10da3a48805bd42 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:38:58.527632 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65dee8-ae23-496b-b721-95c492914ad3 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:38:58.538531 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65dee8-ae23-496b-b721-95c492914ad3 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:38:58.544647 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c51c1-69cc-4c1b-8cdf-723b5e2686cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:38:58.545505 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c51c1-69cc-4c1b-8cdf-723b5e2686cb admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:38:58.545782 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c51c1-69cc-4c1b-8cdf-723b5e2686cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:38:58.546048 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c51c1-69cc-4c1b-8cdf-723b5e2686cb admin admin] PATH_INFO: `/v3/projects/8ccd23a46376495da10da3a48805bd42/users/ee09ec0356fe41dfa9f8e0878fe0cd0a/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:38:58.548908 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c51c1-69cc-4c1b-8cdf-723b5e2686cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ccd23a46376495da10da3a48805bd42, user_id=ee09ec0356fe41dfa9f8e0878fe0cd0a, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:38:58.551554 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c51c1-69cc-4c1b-8cdf-723b5e2686cb admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:38:58.567061 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 546/1096] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:38:58 2022] PUT /identity/v3/projects/8ccd23a46376495da10da3a48805bd42/users/ee09ec0356fe41dfa9f8e0878fe0cd0a/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:39:00.871159 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6f8e3-4ba1-4517-b50f-538b9de65762 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:00.872049 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6f8e3-4ba1-4517-b50f-538b9de65762 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:00.872049 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6f8e3-4ba1-4517-b50f-538b9de65762 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:00.874985 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 551/1097] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:39:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:39:00.880445 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf30ae-13d3-4ce6-8776-4e05e2eb6554 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:00.880883 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf30ae-13d3-4ce6-8776-4e05e2eb6554 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:00.880994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf30ae-13d3-4ce6-8776-4e05e2eb6554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:00.900219 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-7bdf30ae-13d3-4ce6-8776-4e05e2eb6554 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:39:00.901422 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-7bdf30ae-13d3-4ce6-8776-4e05e2eb6554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:39:00.958236 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 547/1098] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:39:00 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:39:00.984270 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6f8e3-4ba1-4517-b50f-538b9de65762 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:01.004883 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6f8e3-4ba1-4517-b50f-538b9de65762 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:01.010105 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e2f53-89c6-4f6a-a84b-a5ae2458f5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:01.010876 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e2f53-89c6-4f6a-a84b-a5ae2458f5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:01.011153 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e2f53-89c6-4f6a-a84b-a5ae2458f5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:01.011416 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e2f53-89c6-4f6a-a84b-a5ae2458f5b5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:01.023986 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e2f53-89c6-4f6a-a84b-a5ae2458f5b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:39:01.030617 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-e31e2f53-89c6-4f6a-a84b-a5ae2458f5b5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:39:01.031745 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 552/1099] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:39:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:39:01.041300 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf30ae-13d3-4ce6-8776-4e05e2eb6554 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:01.056066 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf30ae-13d3-4ce6-8776-4e05e2eb6554 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:01.064994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999d847-4174-49d8-a593-1054b0f57443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:01.065652 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999d847-4174-49d8-a593-1054b0f57443 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:01.065929 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999d847-4174-49d8-a593-1054b0f57443 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:01.066199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999d847-4174-49d8-a593-1054b0f57443 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:01.066957 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999d847-4174-49d8-a593-1054b0f57443 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:39:01.067259 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999d847-4174-49d8-a593-1054b0f57443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:01.068887 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999d847-4174-49d8-a593-1054b0f57443 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:01.078087 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 548/1100] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:39:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:01.084145 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e2f53-89c6-4f6a-a84b-a5ae2458f5b5 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:01.098190 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e2f53-89c6-4f6a-a84b-a5ae2458f5b5 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:01.104407 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3108ee-bdd2-4235-989c-4da25c3b978f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:01.105269 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3108ee-bdd2-4235-989c-4da25c3b978f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:01.105543 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3108ee-bdd2-4235-989c-4da25c3b978f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:01.105805 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3108ee-bdd2-4235-989c-4da25c3b978f admin admin] PATH_INFO: `/v3/users/ee09ec0356fe41dfa9f8e0878fe0cd0a` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:01.107212 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3108ee-bdd2-4235-989c-4da25c3b978f admin admin] RBAC: Authorizing `identity:get_user(user_id=ee09ec0356fe41dfa9f8e0878fe0cd0a)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:01.109417 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3108ee-bdd2-4235-989c-4da25c3b978f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:01.110954 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 553/1101] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:39:01 2022] GET /identity/v3/users/ee09ec0356fe41dfa9f8e0878fe0cd0a => generated 285 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:39:01.116329 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999d847-4174-49d8-a593-1054b0f57443 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:01.125896 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999d847-4174-49d8-a593-1054b0f57443 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:01.131191 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad6dc1-3026-4277-932b-f87b225374bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:01.131791 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad6dc1-3026-4277-932b-f87b225374bc admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:01.132069 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad6dc1-3026-4277-932b-f87b225374bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:01.132349 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad6dc1-3026-4277-932b-f87b225374bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:01.140228 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad6dc1-3026-4277-932b-f87b225374bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:01.142151 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad6dc1-3026-4277-932b-f87b225374bc admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:01.152359 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 549/1102] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:39:01 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:39:01.158844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3108ee-bdd2-4235-989c-4da25c3b978f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:01.174003 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3108ee-bdd2-4235-989c-4da25c3b978f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:01.181904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cac92-c166-4b5c-8102-f2b9a11de8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:01.183099 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cac92-c166-4b5c-8102-f2b9a11de8cf admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:01.183466 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cac92-c166-4b5c-8102-f2b9a11de8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:01.183798 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cac92-c166-4b5c-8102-f2b9a11de8cf admin admin] PATH_INFO: `/v3/projects/8ccd23a46376495da10da3a48805bd42` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:01.185734 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cac92-c166-4b5c-8102-f2b9a11de8cf admin admin] RBAC: Authorizing `identity:get_project(project_id=8ccd23a46376495da10da3a48805bd42)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:01.188993 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cac92-c166-4b5c-8102-f2b9a11de8cf admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:01.190558 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 554/1103] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:39:01 2022] GET /identity/v3/projects/8ccd23a46376495da10da3a48805bd42 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:01.196251 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad6dc1-3026-4277-932b-f87b225374bc admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:01.205386 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad6dc1-3026-4277-932b-f87b225374bc admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:01.210576 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993436b-f39a-41aa-87ba-a1e73d71b2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:01.211190 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993436b-f39a-41aa-87ba-a1e73d71b2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:01.211470 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993436b-f39a-41aa-87ba-a1e73d71b2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:01.211740 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993436b-f39a-41aa-87ba-a1e73d71b2a4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:01.212568 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993436b-f39a-41aa-87ba-a1e73d71b2a4 admin admin] RBAC: Adding query filter params (role.id=3c05bedf79e04eb38d2ae66736030bfe, scope.project.id=8ccd23a46376495da10da3a48805bd42, user.id=ee09ec0356fe41dfa9f8e0878fe0cd0a) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:39:01.212898 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993436b-f39a-41aa-87ba-a1e73d71b2a4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:01.214694 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993436b-f39a-41aa-87ba-a1e73d71b2a4 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:01.221155 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 550/1104] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:39:01 2022] GET /identity/v3/role_assignments?user.id=ee09ec0356fe41dfa9f8e0878fe0cd0a&scope.project.id=8ccd23a46376495da10da3a48805bd42&role.id=3c05bedf79e04eb38d2ae66736030bfe => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:03.594700 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393ddd7-1349-4092-9ed9-f0799feeb3b4 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:03.595282 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393ddd7-1349-4092-9ed9-f0799feeb3b4 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:03.595282 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393ddd7-1349-4092-9ed9-f0799feeb3b4 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:03.597142 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 555/1105] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:39:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:39:03.602520 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f697e1-877f-4846-b214-9453747c4270 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:03.602934 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f697e1-877f-4846-b214-9453747c4270 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:03.603022 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f697e1-877f-4846-b214-9453747c4270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:03.621551 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-66f697e1-877f-4846-b214-9453747c4270 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:39:03.622726 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-66f697e1-877f-4846-b214-9453747c4270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:39:03.630915 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 551/1106] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:39:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:39:03.657706 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393ddd7-1349-4092-9ed9-f0799feeb3b4 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:03.672286 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393ddd7-1349-4092-9ed9-f0799feeb3b4 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:03.677822 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208ffae-889b-4a47-ade5-8fb7ace434bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:03.678601 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208ffae-889b-4a47-ade5-8fb7ace434bf admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:03.678881 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208ffae-889b-4a47-ade5-8fb7ace434bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:03.679152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208ffae-889b-4a47-ade5-8fb7ace434bf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:03.680474 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208ffae-889b-4a47-ade5-8fb7ace434bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:03.682202 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208ffae-889b-4a47-ade5-8fb7ace434bf admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:03.683776 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 556/1107] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:39:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:03.689111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f697e1-877f-4846-b214-9453747c4270 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:03.697994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f697e1-877f-4846-b214-9453747c4270 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:03.702906 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a474d-a71e-4357-92a1-2ab61249c317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:03.703546 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a474d-a71e-4357-92a1-2ab61249c317 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:03.703826 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a474d-a71e-4357-92a1-2ab61249c317 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:03.704099 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a474d-a71e-4357-92a1-2ab61249c317 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:03.704944 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a474d-a71e-4357-92a1-2ab61249c317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:03.706837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a474d-a71e-4357-92a1-2ab61249c317 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:03.729412 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 552/1108] 10.222.0.31 () {60 vars in 1153 bytes} [Mon Jan 10 17:39:03 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:39:06.099360 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781211d-6844-4a7d-9412-21a12b4ec9f0 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:06.100190 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781211d-6844-4a7d-9412-21a12b4ec9f0 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:06.100190 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781211d-6844-4a7d-9412-21a12b4ec9f0 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:06.103029 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 557/1109] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:39:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:39:06.109335 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe0b11-15bc-4a5e-848b-dcb4aef70020 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:06.110004 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe0b11-15bc-4a5e-848b-dcb4aef70020 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:06.110218 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe0b11-15bc-4a5e-848b-dcb4aef70020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:06.130131 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-e8fe0b11-15bc-4a5e-848b-dcb4aef70020 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:39:06.131312 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-e8fe0b11-15bc-4a5e-848b-dcb4aef70020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:39:06.140430 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 553/1110] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:39:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:39:06.166245 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781211d-6844-4a7d-9412-21a12b4ec9f0 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:06.181677 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781211d-6844-4a7d-9412-21a12b4ec9f0 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:06.187735 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c2da7-18c1-4322-be83-f9083d31d01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:06.188569 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c2da7-18c1-4322-be83-f9083d31d01e admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:06.188894 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c2da7-18c1-4322-be83-f9083d31d01e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:06.189179 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c2da7-18c1-4322-be83-f9083d31d01e admin admin] PATH_INFO: `/v3/roles/112bab30f846403ea40d96a74a04af2c` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:06.190775 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c2da7-18c1-4322-be83-f9083d31d01e admin admin] RBAC: Authorizing `identity:get_role(role_id=112bab30f846403ea40d96a74a04af2c)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:06.191797 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING py.warnings [None req-962c2da7-18c1-4322-be83-f9083d31d01e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:39:06.191797 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: warnings.warn(msg) Jan 10 17:39:06.191797 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: Jan 10 17:39:06.192665 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c2da7-18c1-4322-be83-f9083d31d01e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:06.193997 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 558/1111] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:39:06 2022] GET /identity/v3/roles/112bab30f846403ea40d96a74a04af2c => generated 223 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:06.199514 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe0b11-15bc-4a5e-848b-dcb4aef70020 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:06.208313 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe0b11-15bc-4a5e-848b-dcb4aef70020 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:06.213321 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52a1ee-d101-49b5-bdcd-c6008f828b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:06.214174 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52a1ee-d101-49b5-bdcd-c6008f828b51 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:06.214451 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52a1ee-d101-49b5-bdcd-c6008f828b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:06.214722 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52a1ee-d101-49b5-bdcd-c6008f828b51 admin admin] PATH_INFO: `/v3/users/68614095b6b7474f96cf8e2caa20833e` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:06.228305 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52a1ee-d101-49b5-bdcd-c6008f828b51 admin admin] RBAC: Authorizing `identity:get_user(user_id=68614095b6b7474f96cf8e2caa20833e)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:06.230472 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52a1ee-d101-49b5-bdcd-c6008f828b51 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:06.232056 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 554/1112] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:39:06 2022] GET /identity/v3/users/68614095b6b7474f96cf8e2caa20833e => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:06.237565 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c2da7-18c1-4322-be83-f9083d31d01e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:06.248341 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c2da7-18c1-4322-be83-f9083d31d01e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:06.254483 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b2cee-1d93-4517-b1dd-878965ea28ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:06.255087 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b2cee-1d93-4517-b1dd-878965ea28ca admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:06.255364 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b2cee-1d93-4517-b1dd-878965ea28ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:06.255635 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b2cee-1d93-4517-b1dd-878965ea28ca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:06.264491 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b2cee-1d93-4517-b1dd-878965ea28ca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:06.266224 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b2cee-1d93-4517-b1dd-878965ea28ca admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:06.276007 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 559/1113] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:39:06 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:39:06.281650 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52a1ee-d101-49b5-bdcd-c6008f828b51 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:06.291611 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52a1ee-d101-49b5-bdcd-c6008f828b51 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:06.297688 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ede1a-5af1-43a6-a3a6-8747764e1628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:06.298535 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ede1a-5af1-43a6-a3a6-8747764e1628 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:06.298812 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ede1a-5af1-43a6-a3a6-8747764e1628 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:06.299085 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ede1a-5af1-43a6-a3a6-8747764e1628 admin admin] PATH_INFO: `/v3/projects/8ccd23a46376495da10da3a48805bd42` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:06.300481 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ede1a-5af1-43a6-a3a6-8747764e1628 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ccd23a46376495da10da3a48805bd42)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:06.302507 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ede1a-5af1-43a6-a3a6-8747764e1628 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:06.304119 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 555/1114] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:39:06 2022] GET /identity/v3/projects/8ccd23a46376495da10da3a48805bd42 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:06.310308 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b2cee-1d93-4517-b1dd-878965ea28ca admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:06.321138 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b2cee-1d93-4517-b1dd-878965ea28ca admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:06.326984 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b1316-a790-4c9d-b249-cec1ce26cf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:06.327591 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b1316-a790-4c9d-b249-cec1ce26cf1f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:06.327871 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b1316-a790-4c9d-b249-cec1ce26cf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:06.328142 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b1316-a790-4c9d-b249-cec1ce26cf1f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:06.328997 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b1316-a790-4c9d-b249-cec1ce26cf1f admin admin] RBAC: Adding query filter params (role.id=112bab30f846403ea40d96a74a04af2c, scope.project.id=8ccd23a46376495da10da3a48805bd42, user.id=68614095b6b7474f96cf8e2caa20833e) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:39:06.329316 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b1316-a790-4c9d-b249-cec1ce26cf1f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:06.331087 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b1316-a790-4c9d-b249-cec1ce26cf1f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:06.337326 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 560/1115] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:39:06 2022] GET /identity/v3/role_assignments?user.id=68614095b6b7474f96cf8e2caa20833e&scope.project.id=8ccd23a46376495da10da3a48805bd42&role.id=112bab30f846403ea40d96a74a04af2c => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:08.680295 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9296423-93af-4305-87cd-b634fe89f05a None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:08.680900 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9296423-93af-4305-87cd-b634fe89f05a None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:08.680900 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9296423-93af-4305-87cd-b634fe89f05a None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:08.682664 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 556/1116] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:39:08.689159 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeb94a-93b0-4dcf-8b5f-b955d27554fc None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:08.689843 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeb94a-93b0-4dcf-8b5f-b955d27554fc None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:08.690089 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeb94a-93b0-4dcf-8b5f-b955d27554fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:08.719031 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-5feeb94a-93b0-4dcf-8b5f-b955d27554fc None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:39:08.720726 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-5feeb94a-93b0-4dcf-8b5f-b955d27554fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:39:08.729565 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 561/1117] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:39:08 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:39:08.755005 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9296423-93af-4305-87cd-b634fe89f05a None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:08.768195 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9296423-93af-4305-87cd-b634fe89f05a None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:08.773631 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422f3ac-2ad7-433d-8dc6-4f235d0f3b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:08.774472 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422f3ac-2ad7-433d-8dc6-4f235d0f3b73 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:08.774754 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422f3ac-2ad7-433d-8dc6-4f235d0f3b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:08.775022 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422f3ac-2ad7-433d-8dc6-4f235d0f3b73 admin admin] PATH_INFO: `/v3/roles/112bab30f846403ea40d96a74a04af2c` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:08.776552 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422f3ac-2ad7-433d-8dc6-4f235d0f3b73 admin admin] RBAC: Authorizing `identity:get_role(role_id=112bab30f846403ea40d96a74a04af2c)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:08.777625 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING py.warnings [None req-6422f3ac-2ad7-433d-8dc6-4f235d0f3b73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:39:08.777625 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: warnings.warn(msg) Jan 10 17:39:08.777625 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: Jan 10 17:39:08.778498 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422f3ac-2ad7-433d-8dc6-4f235d0f3b73 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:08.779824 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 557/1118] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:39:08 2022] GET /identity/v3/roles/112bab30f846403ea40d96a74a04af2c => generated 223 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:08.785522 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeb94a-93b0-4dcf-8b5f-b955d27554fc None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:08.794525 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeb94a-93b0-4dcf-8b5f-b955d27554fc None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:08.800181 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08db4ef-99fb-424c-abd1-06b1a8163038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:08.801084 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08db4ef-99fb-424c-abd1-06b1a8163038 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:08.801360 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08db4ef-99fb-424c-abd1-06b1a8163038 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:08.801642 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08db4ef-99fb-424c-abd1-06b1a8163038 admin admin] PATH_INFO: `/v3/users/68614095b6b7474f96cf8e2caa20833e` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:08.802973 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08db4ef-99fb-424c-abd1-06b1a8163038 admin admin] RBAC: Authorizing `identity:get_user(user_id=68614095b6b7474f96cf8e2caa20833e)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:08.805106 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08db4ef-99fb-424c-abd1-06b1a8163038 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:08.806665 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 562/1119] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:39:08 2022] GET /identity/v3/users/68614095b6b7474f96cf8e2caa20833e => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:08.812448 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422f3ac-2ad7-433d-8dc6-4f235d0f3b73 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:08.823512 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422f3ac-2ad7-433d-8dc6-4f235d0f3b73 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:08.832321 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950aeba9-87f6-4dff-9690-093ee93d6ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:08.833699 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950aeba9-87f6-4dff-9690-093ee93d6ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:08.834077 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950aeba9-87f6-4dff-9690-093ee93d6ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:08.834481 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950aeba9-87f6-4dff-9690-093ee93d6ba5 admin admin] PATH_INFO: `/v3/projects/8ccd23a46376495da10da3a48805bd42` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:08.836531 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950aeba9-87f6-4dff-9690-093ee93d6ba5 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ccd23a46376495da10da3a48805bd42)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:08.839824 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950aeba9-87f6-4dff-9690-093ee93d6ba5 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:08.842414 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 558/1120] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:39:08 2022] GET /identity/v3/projects/8ccd23a46376495da10da3a48805bd42 => generated 311 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:08.848087 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08db4ef-99fb-424c-abd1-06b1a8163038 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:08.857917 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08db4ef-99fb-424c-abd1-06b1a8163038 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:08.863301 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341cfbf-4123-434b-873f-689bbb5311be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:08.864136 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341cfbf-4123-434b-873f-689bbb5311be admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:08.864413 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341cfbf-4123-434b-873f-689bbb5311be admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:08.864688 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341cfbf-4123-434b-873f-689bbb5311be admin admin] PATH_INFO: `/v3/projects/8ccd23a46376495da10da3a48805bd42/users/68614095b6b7474f96cf8e2caa20833e/roles/112bab30f846403ea40d96a74a04af2c` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:08.867359 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341cfbf-4123-434b-873f-689bbb5311be admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ccd23a46376495da10da3a48805bd42, user_id=68614095b6b7474f96cf8e2caa20833e, role_id=112bab30f846403ea40d96a74a04af2c)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:08.869997 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341cfbf-4123-434b-873f-689bbb5311be admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:08.887577 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 563/1121] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:39:08 2022] PUT /identity/v3/projects/8ccd23a46376495da10da3a48805bd42/users/68614095b6b7474f96cf8e2caa20833e/roles/112bab30f846403ea40d96a74a04af2c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:39:11.187494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb17a2-899b-4ca2-bcc5-403033c6e47b None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:11.188389 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb17a2-899b-4ca2-bcc5-403033c6e47b None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:11.188389 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb17a2-899b-4ca2-bcc5-403033c6e47b None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:11.191280 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 559/1122] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:39:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:39:11.197549 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bbd5c-ef4a-42d8-9a0f-1b47b7197b8b None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:11.198281 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bbd5c-ef4a-42d8-9a0f-1b47b7197b8b None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:11.198402 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bbd5c-ef4a-42d8-9a0f-1b47b7197b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:11.219540 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-c50bbd5c-ef4a-42d8-9a0f-1b47b7197b8b None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:39:11.220725 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-c50bbd5c-ef4a-42d8-9a0f-1b47b7197b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:39:11.279533 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 564/1123] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:39:11 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:39:11.304274 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb17a2-899b-4ca2-bcc5-403033c6e47b None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:11.319772 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb17a2-899b-4ca2-bcc5-403033c6e47b None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:11.325973 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db076d-4ff4-4e82-8ecf-ccd7e9dc67bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:11.326820 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db076d-4ff4-4e82-8ecf-ccd7e9dc67bb admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:11.327099 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db076d-4ff4-4e82-8ecf-ccd7e9dc67bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:11.327372 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db076d-4ff4-4e82-8ecf-ccd7e9dc67bb admin admin] PATH_INFO: `/v3/roles/112bab30f846403ea40d96a74a04af2c` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:11.329057 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db076d-4ff4-4e82-8ecf-ccd7e9dc67bb admin admin] RBAC: Authorizing `identity:get_role(role_id=112bab30f846403ea40d96a74a04af2c)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:11.330761 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db076d-4ff4-4e82-8ecf-ccd7e9dc67bb admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:11.332068 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 560/1124] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:39:11 2022] GET /identity/v3/roles/112bab30f846403ea40d96a74a04af2c => generated 223 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:11.340674 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bbd5c-ef4a-42d8-9a0f-1b47b7197b8b None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:11.354879 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bbd5c-ef4a-42d8-9a0f-1b47b7197b8b None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:11.362981 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb872ab3-3bed-4429-863c-9bb4197397a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:11.363841 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb872ab3-3bed-4429-863c-9bb4197397a1 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:11.364122 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb872ab3-3bed-4429-863c-9bb4197397a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:11.364392 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb872ab3-3bed-4429-863c-9bb4197397a1 admin admin] PATH_INFO: `/v3/users/68614095b6b7474f96cf8e2caa20833e` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:11.365750 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb872ab3-3bed-4429-863c-9bb4197397a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=68614095b6b7474f96cf8e2caa20833e)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:11.367862 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb872ab3-3bed-4429-863c-9bb4197397a1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:11.369470 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 565/1125] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:39:11 2022] GET /identity/v3/users/68614095b6b7474f96cf8e2caa20833e => generated 286 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:39:11.375309 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db076d-4ff4-4e82-8ecf-ccd7e9dc67bb admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:11.390652 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db076d-4ff4-4e82-8ecf-ccd7e9dc67bb admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:11.397108 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf5849-b334-429b-a2ff-d729a0714e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:11.397718 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf5849-b334-429b-a2ff-d729a0714e43 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:11.397996 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf5849-b334-429b-a2ff-d729a0714e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:11.398611 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf5849-b334-429b-a2ff-d729a0714e43 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:11.407035 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf5849-b334-429b-a2ff-d729a0714e43 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:11.408780 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf5849-b334-429b-a2ff-d729a0714e43 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:11.417815 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 561/1126] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:39:11 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:39:11.423856 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb872ab3-3bed-4429-863c-9bb4197397a1 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:11.438896 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb872ab3-3bed-4429-863c-9bb4197397a1 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:11.446603 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f2a7f-7b22-4601-af68-a1417256b50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:11.447412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f2a7f-7b22-4601-af68-a1417256b50d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:11.447696 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f2a7f-7b22-4601-af68-a1417256b50d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:11.447971 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f2a7f-7b22-4601-af68-a1417256b50d admin admin] PATH_INFO: `/v3/projects/8ccd23a46376495da10da3a48805bd42` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:11.449219 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f2a7f-7b22-4601-af68-a1417256b50d admin admin] RBAC: Authorizing `identity:get_project(project_id=8ccd23a46376495da10da3a48805bd42)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:11.451176 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f2a7f-7b22-4601-af68-a1417256b50d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:11.452759 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 566/1127] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:39:11 2022] GET /identity/v3/projects/8ccd23a46376495da10da3a48805bd42 => generated 311 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:11.461288 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf5849-b334-429b-a2ff-d729a0714e43 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:11.470631 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf5849-b334-429b-a2ff-d729a0714e43 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:11.475975 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ebf04-b6d0-4aa2-b60f-8dd8a44aeeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:11.476595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ebf04-b6d0-4aa2-b60f-8dd8a44aeeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:11.476876 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ebf04-b6d0-4aa2-b60f-8dd8a44aeeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:11.477184 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ebf04-b6d0-4aa2-b60f-8dd8a44aeeb8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:11.478026 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ebf04-b6d0-4aa2-b60f-8dd8a44aeeb8 admin admin] RBAC: Adding query filter params (role.id=112bab30f846403ea40d96a74a04af2c, scope.project.id=8ccd23a46376495da10da3a48805bd42, user.id=68614095b6b7474f96cf8e2caa20833e) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:39:11.478343 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ebf04-b6d0-4aa2-b60f-8dd8a44aeeb8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:11.480161 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ebf04-b6d0-4aa2-b60f-8dd8a44aeeb8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:11.486395 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 562/1128] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:39:11 2022] GET /identity/v3/role_assignments?user.id=68614095b6b7474f96cf8e2caa20833e&scope.project.id=8ccd23a46376495da10da3a48805bd42&role.id=112bab30f846403ea40d96a74a04af2c => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:13.850189 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d19707-88c4-410e-b54b-cc71acb343aa None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:13.850773 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d19707-88c4-410e-b54b-cc71acb343aa None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:13.850773 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d19707-88c4-410e-b54b-cc71acb343aa None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:13.852538 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 567/1129] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:39:13.859078 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897ee24-ba57-4b50-b783-69a2b347fd99 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:13.859786 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897ee24-ba57-4b50-b783-69a2b347fd99 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:13.859978 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897ee24-ba57-4b50-b783-69a2b347fd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:13.884434 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-6897ee24-ba57-4b50-b783-69a2b347fd99 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:39:13.885633 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-6897ee24-ba57-4b50-b783-69a2b347fd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:39:13.894117 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 563/1130] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:39:13 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:39:13.919343 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d19707-88c4-410e-b54b-cc71acb343aa None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:13.933210 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d19707-88c4-410e-b54b-cc71acb343aa None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:13.938740 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b209ff-1e72-4cfa-8f72-9192cf87e2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:13.939515 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b209ff-1e72-4cfa-8f72-9192cf87e2cb admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:13.939794 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b209ff-1e72-4cfa-8f72-9192cf87e2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:13.940068 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b209ff-1e72-4cfa-8f72-9192cf87e2cb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:13.941936 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b209ff-1e72-4cfa-8f72-9192cf87e2cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:13.944584 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b209ff-1e72-4cfa-8f72-9192cf87e2cb admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:13.947093 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 568/1131] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:39:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:13.955794 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897ee24-ba57-4b50-b783-69a2b347fd99 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:13.970145 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897ee24-ba57-4b50-b783-69a2b347fd99 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:13.976242 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994350d-8323-4621-a8ce-b1cbb323b1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:13.976883 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994350d-8323-4621-a8ce-b1cbb323b1df admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:13.977199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994350d-8323-4621-a8ce-b1cbb323b1df admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:13.977467 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994350d-8323-4621-a8ce-b1cbb323b1df admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:13.978192 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994350d-8323-4621-a8ce-b1cbb323b1df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:13.980066 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994350d-8323-4621-a8ce-b1cbb323b1df admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:14.009729 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 564/1132] 10.222.0.31 () {60 vars in 1162 bytes} [Mon Jan 10 17:39:13 2022] POST /identity/v3/projects => generated 311 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:39:16.378593 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0d494-4e4c-4589-a677-7a51a7606d75 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:16.379499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0d494-4e4c-4589-a677-7a51a7606d75 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:16.379499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0d494-4e4c-4589-a677-7a51a7606d75 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:16.382356 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 569/1133] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:39:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:39:16.388528 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8714de-063f-4fa5-942d-931a54d89cb6 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:16.388978 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8714de-063f-4fa5-942d-931a54d89cb6 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:16.389173 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8714de-063f-4fa5-942d-931a54d89cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:16.409895 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-fc8714de-063f-4fa5-942d-931a54d89cb6 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:39:16.411082 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-fc8714de-063f-4fa5-942d-931a54d89cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:39:16.473002 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 565/1134] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:39:16 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:39:16.504564 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0d494-4e4c-4589-a677-7a51a7606d75 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:16.519583 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0d494-4e4c-4589-a677-7a51a7606d75 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:16.526026 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef70ea-b7df-42d5-b062-d0df62f1e613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:16.526806 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef70ea-b7df-42d5-b062-d0df62f1e613 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:16.527093 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef70ea-b7df-42d5-b062-d0df62f1e613 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:16.527369 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef70ea-b7df-42d5-b062-d0df62f1e613 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:16.528703 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef70ea-b7df-42d5-b062-d0df62f1e613 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:16.530413 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef70ea-b7df-42d5-b062-d0df62f1e613 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:16.531966 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 570/1135] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:39:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:16.538265 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8714de-063f-4fa5-942d-931a54d89cb6 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:16.551440 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8714de-063f-4fa5-942d-931a54d89cb6 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:16.557271 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0f7f4-4688-4871-bf5a-0e962d0acdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:16.557937 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0f7f4-4688-4871-bf5a-0e962d0acdf5 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:16.558212 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0f7f4-4688-4871-bf5a-0e962d0acdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:16.558485 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0f7f4-4688-4871-bf5a-0e962d0acdf5 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:16.559211 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0f7f4-4688-4871-bf5a-0e962d0acdf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:16.561150 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0f7f4-4688-4871-bf5a-0e962d0acdf5 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:16.584808 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 566/1136] 10.222.0.31 () {60 vars in 1153 bytes} [Mon Jan 10 17:39:16 2022] POST /identity/v3/users => generated 286 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:39:18.973999 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fced9-a55e-43f1-af7c-12ed0992a0a0 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:18.974669 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fced9-a55e-43f1-af7c-12ed0992a0a0 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:18.974669 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fced9-a55e-43f1-af7c-12ed0992a0a0 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:18.976301 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 571/1137] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:39:18.982702 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca102d-fec0-4a71-a856-c600cc60c0f6 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:18.983458 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca102d-fec0-4a71-a856-c600cc60c0f6 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:18.983646 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca102d-fec0-4a71-a856-c600cc60c0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:19.009145 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-d7ca102d-fec0-4a71-a856-c600cc60c0f6 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:39:19.010330 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-d7ca102d-fec0-4a71-a856-c600cc60c0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:39:19.019286 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 567/1138] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:39:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:39:19.044188 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fced9-a55e-43f1-af7c-12ed0992a0a0 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:19.056883 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fced9-a55e-43f1-af7c-12ed0992a0a0 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:19.061741 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc76513-25c6-4a8e-8390-514f7d4b4f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:19.062505 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc76513-25c6-4a8e-8390-514f7d4b4f06 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:19.062781 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc76513-25c6-4a8e-8390-514f7d4b4f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:19.063049 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc76513-25c6-4a8e-8390-514f7d4b4f06 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:19.073656 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc76513-25c6-4a8e-8390-514f7d4b4f06 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:39:19.080329 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-cfc76513-25c6-4a8e-8390-514f7d4b4f06 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:39:19.081477 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 572/1139] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:39:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:39:19.087770 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca102d-fec0-4a71-a856-c600cc60c0f6 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:19.100088 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca102d-fec0-4a71-a856-c600cc60c0f6 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:19.106770 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ec924-f076-4370-8a8a-3af3330f7713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:19.107423 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ec924-f076-4370-8a8a-3af3330f7713 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:19.107700 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ec924-f076-4370-8a8a-3af3330f7713 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:19.107968 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ec924-f076-4370-8a8a-3af3330f7713 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:19.108730 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ec924-f076-4370-8a8a-3af3330f7713 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:39:19.109066 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ec924-f076-4370-8a8a-3af3330f7713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:19.110664 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ec924-f076-4370-8a8a-3af3330f7713 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:19.120107 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 568/1140] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:39:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:19.125655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc76513-25c6-4a8e-8390-514f7d4b4f06 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:19.135770 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc76513-25c6-4a8e-8390-514f7d4b4f06 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:19.140961 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cf87b-ada8-4b6a-b139-957b15c082bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:19.141797 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cf87b-ada8-4b6a-b139-957b15c082bb admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:19.142068 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cf87b-ada8-4b6a-b139-957b15c082bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:19.142318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cf87b-ada8-4b6a-b139-957b15c082bb admin admin] PATH_INFO: `/v3/users/4fa01394792d457a8077c51e99608386` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:19.156226 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cf87b-ada8-4b6a-b139-957b15c082bb admin admin] RBAC: Authorizing `identity:get_user(user_id=4fa01394792d457a8077c51e99608386)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:19.158399 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cf87b-ada8-4b6a-b139-957b15c082bb admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:19.159977 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 573/1141] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:39:19 2022] GET /identity/v3/users/4fa01394792d457a8077c51e99608386 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:19.165603 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ec924-f076-4370-8a8a-3af3330f7713 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:19.175735 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ec924-f076-4370-8a8a-3af3330f7713 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:19.181878 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c35cb9-2c67-4bd6-b508-87eaf08ec250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:19.182490 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c35cb9-2c67-4bd6-b508-87eaf08ec250 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:19.182785 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c35cb9-2c67-4bd6-b508-87eaf08ec250 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:19.183058 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c35cb9-2c67-4bd6-b508-87eaf08ec250 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:19.191463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c35cb9-2c67-4bd6-b508-87eaf08ec250 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:19.193232 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c35cb9-2c67-4bd6-b508-87eaf08ec250 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:19.202251 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 569/1142] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:39:19 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:39:19.207780 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cf87b-ada8-4b6a-b139-957b15c082bb admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:19.217571 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cf87b-ada8-4b6a-b139-957b15c082bb admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:19.223656 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c035eb-de04-4cbc-a65c-11bd2146c7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:19.224470 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c035eb-de04-4cbc-a65c-11bd2146c7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:19.224746 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c035eb-de04-4cbc-a65c-11bd2146c7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:19.225043 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c035eb-de04-4cbc-a65c-11bd2146c7d3 admin admin] PATH_INFO: `/v3/projects/af4e9fb2b6734e5e84e71493bd07a942` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:19.226412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c035eb-de04-4cbc-a65c-11bd2146c7d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=af4e9fb2b6734e5e84e71493bd07a942)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:19.228512 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c035eb-de04-4cbc-a65c-11bd2146c7d3 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:19.230141 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 574/1143] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:39:19 2022] GET /identity/v3/projects/af4e9fb2b6734e5e84e71493bd07a942 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:19.235891 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c35cb9-2c67-4bd6-b508-87eaf08ec250 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:19.244687 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c35cb9-2c67-4bd6-b508-87eaf08ec250 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:19.250799 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea2c87-2131-4c6a-b53c-2fd15e1fc160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:19.251444 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea2c87-2131-4c6a-b53c-2fd15e1fc160 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:19.251721 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea2c87-2131-4c6a-b53c-2fd15e1fc160 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:19.251988 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea2c87-2131-4c6a-b53c-2fd15e1fc160 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:19.252815 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea2c87-2131-4c6a-b53c-2fd15e1fc160 admin admin] RBAC: Adding query filter params (role.id=3c05bedf79e04eb38d2ae66736030bfe, scope.project.id=af4e9fb2b6734e5e84e71493bd07a942, user.id=4fa01394792d457a8077c51e99608386) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:39:19.253158 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea2c87-2131-4c6a-b53c-2fd15e1fc160 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:19.254946 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea2c87-2131-4c6a-b53c-2fd15e1fc160 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:19.260667 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 570/1144] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:39:19 2022] GET /identity/v3/role_assignments?user.id=4fa01394792d457a8077c51e99608386&scope.project.id=af4e9fb2b6734e5e84e71493bd07a942&role.id=3c05bedf79e04eb38d2ae66736030bfe => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:21.564524 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ad1e3-9e5a-4ba6-9dbd-26b32cb6f666 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:21.565494 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ad1e3-9e5a-4ba6-9dbd-26b32cb6f666 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:21.565494 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ad1e3-9e5a-4ba6-9dbd-26b32cb6f666 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:21.568292 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 575/1145] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:39:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:39:21.574764 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75164dbf-dd4f-424d-9a0d-cf5d6fa67b02 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:21.575192 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75164dbf-dd4f-424d-9a0d-cf5d6fa67b02 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:21.575356 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75164dbf-dd4f-424d-9a0d-cf5d6fa67b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:21.600509 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-75164dbf-dd4f-424d-9a0d-cf5d6fa67b02 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:39:21.601730 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-75164dbf-dd4f-424d-9a0d-cf5d6fa67b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:39:21.609689 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 571/1146] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:39:21 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:39:21.635344 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ad1e3-9e5a-4ba6-9dbd-26b32cb6f666 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:21.652329 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ad1e3-9e5a-4ba6-9dbd-26b32cb6f666 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:21.658394 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45541a9-226a-4949-b9bc-8d85136cef37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:21.659174 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45541a9-226a-4949-b9bc-8d85136cef37 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:21.659459 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45541a9-226a-4949-b9bc-8d85136cef37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:21.659742 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45541a9-226a-4949-b9bc-8d85136cef37 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:21.670437 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45541a9-226a-4949-b9bc-8d85136cef37 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:39:21.677266 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-d45541a9-226a-4949-b9bc-8d85136cef37 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:39:21.678406 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 576/1147] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:39:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:39:21.687497 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75164dbf-dd4f-424d-9a0d-cf5d6fa67b02 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:21.701961 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75164dbf-dd4f-424d-9a0d-cf5d6fa67b02 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:21.709284 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c2395-f7a4-4c9b-abfa-73af54c71fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:21.709946 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c2395-f7a4-4c9b-abfa-73af54c71fee admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:21.710223 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c2395-f7a4-4c9b-abfa-73af54c71fee admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:21.710494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c2395-f7a4-4c9b-abfa-73af54c71fee admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:21.711258 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c2395-f7a4-4c9b-abfa-73af54c71fee admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:39:21.711562 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c2395-f7a4-4c9b-abfa-73af54c71fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:21.713196 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c2395-f7a4-4c9b-abfa-73af54c71fee admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:21.722207 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 572/1148] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:39:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:21.728139 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45541a9-226a-4949-b9bc-8d85136cef37 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:21.738877 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45541a9-226a-4949-b9bc-8d85136cef37 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:21.744519 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c1120-8655-4311-a643-e2201ad158ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:21.745428 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c1120-8655-4311-a643-e2201ad158ed admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:21.745710 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c1120-8655-4311-a643-e2201ad158ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:21.745982 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c1120-8655-4311-a643-e2201ad158ed admin admin] PATH_INFO: `/v3/users/4fa01394792d457a8077c51e99608386` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:21.747434 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c1120-8655-4311-a643-e2201ad158ed admin admin] RBAC: Authorizing `identity:get_user(user_id=4fa01394792d457a8077c51e99608386)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:21.749603 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c1120-8655-4311-a643-e2201ad158ed admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:21.751164 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 577/1149] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:39:21 2022] GET /identity/v3/users/4fa01394792d457a8077c51e99608386 => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:39:21.757063 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c2395-f7a4-4c9b-abfa-73af54c71fee admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:21.766853 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c2395-f7a4-4c9b-abfa-73af54c71fee admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:21.771820 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b41ae-ce64-4049-b6d7-160cecbfa8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:21.772654 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b41ae-ce64-4049-b6d7-160cecbfa8ff admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:21.772972 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b41ae-ce64-4049-b6d7-160cecbfa8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:21.773611 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b41ae-ce64-4049-b6d7-160cecbfa8ff admin admin] PATH_INFO: `/v3/projects/af4e9fb2b6734e5e84e71493bd07a942` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:21.774839 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b41ae-ce64-4049-b6d7-160cecbfa8ff admin admin] RBAC: Authorizing `identity:get_project(project_id=af4e9fb2b6734e5e84e71493bd07a942)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:21.776884 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b41ae-ce64-4049-b6d7-160cecbfa8ff admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:21.778515 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 573/1150] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:39:21 2022] GET /identity/v3/projects/af4e9fb2b6734e5e84e71493bd07a942 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:39:21.783967 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c1120-8655-4311-a643-e2201ad158ed admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:21.793748 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c1120-8655-4311-a643-e2201ad158ed admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:21.799670 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4971a-4898-498f-b3cd-db62faf8c5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:21.800517 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4971a-4898-498f-b3cd-db62faf8c5db admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:21.800802 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4971a-4898-498f-b3cd-db62faf8c5db admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:21.801118 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4971a-4898-498f-b3cd-db62faf8c5db admin admin] PATH_INFO: `/v3/projects/af4e9fb2b6734e5e84e71493bd07a942/users/4fa01394792d457a8077c51e99608386/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:21.803521 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4971a-4898-498f-b3cd-db62faf8c5db admin admin] RBAC: Authorizing `identity:create_grant(project_id=af4e9fb2b6734e5e84e71493bd07a942, user_id=4fa01394792d457a8077c51e99608386, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:21.806156 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4971a-4898-498f-b3cd-db62faf8c5db admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:21.822080 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 578/1151] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:39:21 2022] PUT /identity/v3/projects/af4e9fb2b6734e5e84e71493bd07a942/users/4fa01394792d457a8077c51e99608386/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:39:24.155060 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91003b-a391-4f00-beb3-f3a6f44f0ef9 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:24.155959 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91003b-a391-4f00-beb3-f3a6f44f0ef9 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:24.155959 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91003b-a391-4f00-beb3-f3a6f44f0ef9 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:24.158960 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 574/1152] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:39:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:39:24.165289 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6e6b0-c851-49a0-b747-6574850f751f None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:24.165738 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6e6b0-c851-49a0-b747-6574850f751f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:24.165836 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6e6b0-c851-49a0-b747-6574850f751f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:24.187851 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-eed6e6b0-c851-49a0-b747-6574850f751f None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:39:24.189051 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-eed6e6b0-c851-49a0-b747-6574850f751f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:39:24.249034 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 579/1153] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:39:24 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:39:24.274720 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91003b-a391-4f00-beb3-f3a6f44f0ef9 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:24.289333 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91003b-a391-4f00-beb3-f3a6f44f0ef9 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:24.294923 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ad17b-8b79-4c18-8c57-ad343ad3ca7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:24.295710 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ad17b-8b79-4c18-8c57-ad343ad3ca7d admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:24.295991 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ad17b-8b79-4c18-8c57-ad343ad3ca7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:24.296267 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ad17b-8b79-4c18-8c57-ad343ad3ca7d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:24.307267 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ad17b-8b79-4c18-8c57-ad343ad3ca7d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:39:24.314068 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-847ad17b-8b79-4c18-8c57-ad343ad3ca7d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:39:24.315221 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 575/1154] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:39:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:39:24.321672 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6e6b0-c851-49a0-b747-6574850f751f None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:24.335820 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6e6b0-c851-49a0-b747-6574850f751f None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:24.345134 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd11825-8887-471f-a3dd-6e9f888c3d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:24.345782 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd11825-8887-471f-a3dd-6e9f888c3d23 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:24.346062 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd11825-8887-471f-a3dd-6e9f888c3d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:24.346332 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd11825-8887-471f-a3dd-6e9f888c3d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:24.347091 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd11825-8887-471f-a3dd-6e9f888c3d23 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:39:24.347394 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd11825-8887-471f-a3dd-6e9f888c3d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:24.349049 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd11825-8887-471f-a3dd-6e9f888c3d23 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:24.359584 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 580/1155] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:39:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:24.365520 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ad17b-8b79-4c18-8c57-ad343ad3ca7d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:24.377145 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ad17b-8b79-4c18-8c57-ad343ad3ca7d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:24.383269 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febd655-ed27-49fc-8dcc-c55e162401c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:24.384114 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febd655-ed27-49fc-8dcc-c55e162401c1 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:24.384348 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febd655-ed27-49fc-8dcc-c55e162401c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:24.384647 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febd655-ed27-49fc-8dcc-c55e162401c1 admin admin] PATH_INFO: `/v3/users/4fa01394792d457a8077c51e99608386` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:24.386122 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febd655-ed27-49fc-8dcc-c55e162401c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=4fa01394792d457a8077c51e99608386)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:24.388255 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febd655-ed27-49fc-8dcc-c55e162401c1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:24.389883 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 576/1156] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:39:24 2022] GET /identity/v3/users/4fa01394792d457a8077c51e99608386 => generated 286 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:24.396096 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd11825-8887-471f-a3dd-6e9f888c3d23 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:24.408949 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd11825-8887-471f-a3dd-6e9f888c3d23 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:24.415604 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba129c2d-1327-4394-8aac-4c4afb5cfc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:24.416501 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba129c2d-1327-4394-8aac-4c4afb5cfc03 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:24.416843 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba129c2d-1327-4394-8aac-4c4afb5cfc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:24.417238 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba129c2d-1327-4394-8aac-4c4afb5cfc03 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:24.430549 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba129c2d-1327-4394-8aac-4c4afb5cfc03 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:24.433299 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba129c2d-1327-4394-8aac-4c4afb5cfc03 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:24.445118 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 581/1157] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:39:24 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:39:24.451512 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febd655-ed27-49fc-8dcc-c55e162401c1 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:24.466910 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febd655-ed27-49fc-8dcc-c55e162401c1 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:24.473774 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f0700-28ca-442d-bf2c-275a809f055e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:24.474576 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f0700-28ca-442d-bf2c-275a809f055e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:24.474876 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f0700-28ca-442d-bf2c-275a809f055e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:24.475140 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f0700-28ca-442d-bf2c-275a809f055e admin admin] PATH_INFO: `/v3/projects/af4e9fb2b6734e5e84e71493bd07a942` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:24.476440 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f0700-28ca-442d-bf2c-275a809f055e admin admin] RBAC: Authorizing `identity:get_project(project_id=af4e9fb2b6734e5e84e71493bd07a942)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:24.478478 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f0700-28ca-442d-bf2c-275a809f055e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:24.480108 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 577/1158] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:39:24 2022] GET /identity/v3/projects/af4e9fb2b6734e5e84e71493bd07a942 => generated 311 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:24.485747 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba129c2d-1327-4394-8aac-4c4afb5cfc03 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:24.494614 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba129c2d-1327-4394-8aac-4c4afb5cfc03 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:24.500488 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80f51c-ea47-4b1f-9946-ee00560c4975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:24.501175 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80f51c-ea47-4b1f-9946-ee00560c4975 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:24.501457 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80f51c-ea47-4b1f-9946-ee00560c4975 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:24.501724 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80f51c-ea47-4b1f-9946-ee00560c4975 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:24.502546 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80f51c-ea47-4b1f-9946-ee00560c4975 admin admin] RBAC: Adding query filter params (role.id=3c05bedf79e04eb38d2ae66736030bfe, scope.project.id=af4e9fb2b6734e5e84e71493bd07a942, user.id=4fa01394792d457a8077c51e99608386) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:39:24.502857 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80f51c-ea47-4b1f-9946-ee00560c4975 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:24.504649 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80f51c-ea47-4b1f-9946-ee00560c4975 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:24.510771 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 582/1159] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:39:24 2022] GET /identity/v3/role_assignments?user.id=4fa01394792d457a8077c51e99608386&scope.project.id=af4e9fb2b6734e5e84e71493bd07a942&role.id=3c05bedf79e04eb38d2ae66736030bfe => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:26.882732 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c16c6b-0b71-441f-a4aa-2c13792c0d99 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:26.883592 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c16c6b-0b71-441f-a4aa-2c13792c0d99 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:26.883592 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c16c6b-0b71-441f-a4aa-2c13792c0d99 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:26.886519 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 578/1160] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:39:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:39:26.894094 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99ba0b-acdc-469d-8f1c-a668fe93532e None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:26.894542 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99ba0b-acdc-469d-8f1c-a668fe93532e None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:26.894664 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99ba0b-acdc-469d-8f1c-a668fe93532e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:26.923760 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-1a99ba0b-acdc-469d-8f1c-a668fe93532e None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:39:26.924979 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-1a99ba0b-acdc-469d-8f1c-a668fe93532e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:39:26.934842 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 583/1161] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:39:26 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:39:26.964820 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c16c6b-0b71-441f-a4aa-2c13792c0d99 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:26.979462 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c16c6b-0b71-441f-a4aa-2c13792c0d99 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:26.985566 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e54b1-3749-4c74-888f-eb7af23d6ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:26.986125 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e54b1-3749-4c74-888f-eb7af23d6ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:26.986404 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e54b1-3749-4c74-888f-eb7af23d6ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:26.986674 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e54b1-3749-4c74-888f-eb7af23d6ec5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:26.994689 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e54b1-3749-4c74-888f-eb7af23d6ec5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:26.996445 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e54b1-3749-4c74-888f-eb7af23d6ec5 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:27.005630 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 579/1162] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:39:26 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:39:27.011703 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99ba0b-acdc-469d-8f1c-a668fe93532e None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:27.023623 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99ba0b-acdc-469d-8f1c-a668fe93532e None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:27.030099 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f9cec-4f3b-44d7-92cd-72fdfc220c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:27.030894 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f9cec-4f3b-44d7-92cd-72fdfc220c15 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:27.031175 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f9cec-4f3b-44d7-92cd-72fdfc220c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:27.031445 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f9cec-4f3b-44d7-92cd-72fdfc220c15 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:27.039523 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f9cec-4f3b-44d7-92cd-72fdfc220c15 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:27.041385 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f9cec-4f3b-44d7-92cd-72fdfc220c15 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:27.056668 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-575f9cec-4f3b-44d7-92cd-72fdfc220c15 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jan 10 17:39:27.057953 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 584/1163] 10.222.0.31 () {56 vars in 1138 bytes} [Mon Jan 10 17:39:27 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:39:27.066423 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e54b1-3749-4c74-888f-eb7af23d6ec5 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:27.080290 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e54b1-3749-4c74-888f-eb7af23d6ec5 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:27.086573 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee139e-b1d9-4967-9224-dc0177a846ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:27.087200 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee139e-b1d9-4967-9224-dc0177a846ab admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:27.087476 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee139e-b1d9-4967-9224-dc0177a846ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:27.087742 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee139e-b1d9-4967-9224-dc0177a846ab admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:27.088463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee139e-b1d9-4967-9224-dc0177a846ab admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:39:27.088764 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee139e-b1d9-4967-9224-dc0177a846ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:27.090342 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee139e-b1d9-4967-9224-dc0177a846ab admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:27.099455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 580/1164] 10.222.0.31 () {56 vars in 1136 bytes} [Mon Jan 10 17:39:27 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:29.429642 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1411a4-fe81-4f7a-afa7-6f58de658bd8 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:29.430537 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1411a4-fe81-4f7a-afa7-6f58de658bd8 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:29.430537 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1411a4-fe81-4f7a-afa7-6f58de658bd8 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:29.433388 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 585/1165] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:39:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:39:29.439710 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927ddac-56ca-4c36-8063-b8152bcf068f None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:29.440468 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927ddac-56ca-4c36-8063-b8152bcf068f None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:29.440604 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927ddac-56ca-4c36-8063-b8152bcf068f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:29.464407 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-7927ddac-56ca-4c36-8063-b8152bcf068f None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:39:29.465621 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-7927ddac-56ca-4c36-8063-b8152bcf068f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:39:29.476201 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 581/1166] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:39:29 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:39:29.501822 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1411a4-fe81-4f7a-afa7-6f58de658bd8 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:29.520995 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1411a4-fe81-4f7a-afa7-6f58de658bd8 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:29.527150 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8553a-f864-45e3-b408-47422197dbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:29.527798 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8553a-f864-45e3-b408-47422197dbbf admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:29.528078 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8553a-f864-45e3-b408-47422197dbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:29.528349 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8553a-f864-45e3-b408-47422197dbbf admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:29.529137 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8553a-f864-45e3-b408-47422197dbbf admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:29.530151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING py.warnings [None req-23c8553a-f864-45e3-b408-47422197dbbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:39:29.530151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: warnings.warn(msg) Jan 10 17:39:29.530151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: Jan 10 17:39:29.531031 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8553a-f864-45e3-b408-47422197dbbf admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:29.548871 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 586/1167] 10.222.0.31 () {60 vars in 1159 bytes} [Mon Jan 10 17:39:29 2022] POST /identity/v3/domains => generated 267 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:39:31.945915 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e01ec5-d12a-4a06-80b9-685a54915a21 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:31.946837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e01ec5-d12a-4a06-80b9-685a54915a21 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:31.946837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e01ec5-d12a-4a06-80b9-685a54915a21 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:31.949756 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 582/1168] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:39:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:39:31.958588 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c1ccf-bfd6-46d0-a7e6-0120ee853229 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:31.959020 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c1ccf-bfd6-46d0-a7e6-0120ee853229 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:31.959160 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c1ccf-bfd6-46d0-a7e6-0120ee853229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:31.983411 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-6d1c1ccf-bfd6-46d0-a7e6-0120ee853229 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:39:31.984539 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-6d1c1ccf-bfd6-46d0-a7e6-0120ee853229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:39:32.047378 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 587/1169] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:39:31 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:39:32.079891 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e01ec5-d12a-4a06-80b9-685a54915a21 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:32.094103 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e01ec5-d12a-4a06-80b9-685a54915a21 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:32.099641 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1f0d4-7822-40b3-8742-ccfbced51dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:32.100489 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1f0d4-7822-40b3-8742-ccfbced51dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:32.100873 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1f0d4-7822-40b3-8742-ccfbced51dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:32.101164 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1f0d4-7822-40b3-8742-ccfbced51dc6 admin admin] PATH_INFO: `/v3/domains/3fc5360b346f491682ef2d94ca525cf7` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:32.112602 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1f0d4-7822-40b3-8742-ccfbced51dc6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=3fc5360b346f491682ef2d94ca525cf7)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:32.114585 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1f0d4-7822-40b3-8742-ccfbced51dc6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:32.116260 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 583/1170] 10.222.0.31 () {56 vars in 1204 bytes} [Mon Jan 10 17:39:32 2022] GET /identity/v3/domains/3fc5360b346f491682ef2d94ca525cf7 => generated 267 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:32.122487 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c1ccf-bfd6-46d0-a7e6-0120ee853229 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:32.137400 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c1ccf-bfd6-46d0-a7e6-0120ee853229 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:32.145349 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9213e-7739-45ff-a3aa-1af3204ff14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:32.145995 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9213e-7739-45ff-a3aa-1af3204ff14e admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:32.146276 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9213e-7739-45ff-a3aa-1af3204ff14e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:32.146551 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9213e-7739-45ff-a3aa-1af3204ff14e admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:32.147269 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9213e-7739-45ff-a3aa-1af3204ff14e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:32.149550 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9213e-7739-45ff-a3aa-1af3204ff14e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:32.179820 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 588/1171] 10.222.0.31 () {60 vars in 1162 bytes} [Mon Jan 10 17:39:32 2022] POST /identity/v3/projects => generated 361 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:39:34.569364 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae940f77-63c8-492e-9693-046ba5132726 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:34.570264 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae940f77-63c8-492e-9693-046ba5132726 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:34.570264 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae940f77-63c8-492e-9693-046ba5132726 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:34.573146 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 584/1172] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:39:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:39:34.581853 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149ba74-d4df-4fdc-829f-92b548bdbe97 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:34.582279 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149ba74-d4df-4fdc-829f-92b548bdbe97 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:34.582429 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149ba74-d4df-4fdc-829f-92b548bdbe97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:34.611463 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-3149ba74-d4df-4fdc-829f-92b548bdbe97 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:39:34.612650 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-3149ba74-d4df-4fdc-829f-92b548bdbe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:39:34.671873 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 589/1173] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:39:34 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:39:34.697759 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae940f77-63c8-492e-9693-046ba5132726 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:34.713537 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae940f77-63c8-492e-9693-046ba5132726 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:34.719058 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87705d-b128-417e-b99b-bfc9bb1d3355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:34.719954 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87705d-b128-417e-b99b-bfc9bb1d3355 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:34.720229 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87705d-b128-417e-b99b-bfc9bb1d3355 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:34.720500 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87705d-b128-417e-b99b-bfc9bb1d3355 admin admin] PATH_INFO: `/v3/domains/3fc5360b346f491682ef2d94ca525cf7` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:34.721752 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87705d-b128-417e-b99b-bfc9bb1d3355 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=3fc5360b346f491682ef2d94ca525cf7)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:34.723716 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87705d-b128-417e-b99b-bfc9bb1d3355 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:34.725304 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 585/1174] 10.222.0.31 () {56 vars in 1204 bytes} [Mon Jan 10 17:39:34 2022] GET /identity/v3/domains/3fc5360b346f491682ef2d94ca525cf7 => generated 267 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:34.732059 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149ba74-d4df-4fdc-829f-92b548bdbe97 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:34.745147 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149ba74-d4df-4fdc-829f-92b548bdbe97 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:34.753318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a36bc7-ae7e-4443-bb3f-4bb18989c387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:34.753972 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a36bc7-ae7e-4443-bb3f-4bb18989c387 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:34.754246 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a36bc7-ae7e-4443-bb3f-4bb18989c387 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:34.754514 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a36bc7-ae7e-4443-bb3f-4bb18989c387 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:34.755231 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a36bc7-ae7e-4443-bb3f-4bb18989c387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:34.757217 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a36bc7-ae7e-4443-bb3f-4bb18989c387 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:34.780227 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 590/1175] 10.222.0.31 () {60 vars in 1153 bytes} [Mon Jan 10 17:39:34 2022] POST /identity/v3/users => generated 311 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:39:37.179823 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0ba66-d0de-4b34-8196-acf973cb6a76 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:37.180395 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0ba66-d0de-4b34-8196-acf973cb6a76 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:37.180395 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0ba66-d0de-4b34-8196-acf973cb6a76 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:37.183189 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 586/1176] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:39:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:39:37.190687 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fc037-bf24-48b8-8004-53ff7d12808f None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:37.191073 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fc037-bf24-48b8-8004-53ff7d12808f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:37.191234 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fc037-bf24-48b8-8004-53ff7d12808f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:37.211500 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-579fc037-bf24-48b8-8004-53ff7d12808f None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:39:37.212674 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-579fc037-bf24-48b8-8004-53ff7d12808f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:39:37.222223 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 591/1177] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:39:37 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:39:37.246924 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0ba66-d0de-4b34-8196-acf973cb6a76 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:37.261717 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0ba66-d0de-4b34-8196-acf973cb6a76 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:37.267490 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb63c46-f273-497c-b2c5-d5ec9fcb9e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:37.268267 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb63c46-f273-497c-b2c5-d5ec9fcb9e6a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:37.268555 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb63c46-f273-497c-b2c5-d5ec9fcb9e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:37.268825 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb63c46-f273-497c-b2c5-d5ec9fcb9e6a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:37.282718 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb63c46-f273-497c-b2c5-d5ec9fcb9e6a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:39:37.289340 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-afb63c46-f273-497c-b2c5-d5ec9fcb9e6a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:39:37.290473 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 587/1178] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:39:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:39:37.296816 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fc037-bf24-48b8-8004-53ff7d12808f None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:37.311494 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fc037-bf24-48b8-8004-53ff7d12808f None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:37.318052 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d20a5-b02f-4705-8210-504c5d559c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:37.318702 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d20a5-b02f-4705-8210-504c5d559c4f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:37.318983 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d20a5-b02f-4705-8210-504c5d559c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:37.319255 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d20a5-b02f-4705-8210-504c5d559c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:37.320016 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d20a5-b02f-4705-8210-504c5d559c4f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:39:37.320323 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d20a5-b02f-4705-8210-504c5d559c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:37.321960 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d20a5-b02f-4705-8210-504c5d559c4f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:37.330711 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 592/1179] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:39:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:37.336391 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb63c46-f273-497c-b2c5-d5ec9fcb9e6a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:37.347025 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb63c46-f273-497c-b2c5-d5ec9fcb9e6a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:37.353339 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e7007-0c64-4e6c-9b4d-6db7680d1af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:37.354171 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e7007-0c64-4e6c-9b4d-6db7680d1af3 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:37.354452 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e7007-0c64-4e6c-9b4d-6db7680d1af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:37.354719 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e7007-0c64-4e6c-9b4d-6db7680d1af3 admin admin] PATH_INFO: `/v3/users/67ca3c65ae5947d9ba9f5abd1872d29f` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:37.369841 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e7007-0c64-4e6c-9b4d-6db7680d1af3 admin admin] RBAC: Authorizing `identity:get_user(user_id=67ca3c65ae5947d9ba9f5abd1872d29f)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:37.371974 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e7007-0c64-4e6c-9b4d-6db7680d1af3 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:37.373588 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 588/1180] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:39:37 2022] GET /identity/v3/users/67ca3c65ae5947d9ba9f5abd1872d29f => generated 311 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:37.382620 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d20a5-b02f-4705-8210-504c5d559c4f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:37.395781 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d20a5-b02f-4705-8210-504c5d559c4f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:37.401904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7b8d4-2fba-4240-85bc-4c2677dffe1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:37.402519 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7b8d4-2fba-4240-85bc-4c2677dffe1f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:37.402798 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7b8d4-2fba-4240-85bc-4c2677dffe1f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:37.403067 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7b8d4-2fba-4240-85bc-4c2677dffe1f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:37.411052 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7b8d4-2fba-4240-85bc-4c2677dffe1f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:37.412772 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7b8d4-2fba-4240-85bc-4c2677dffe1f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:37.421498 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 593/1181] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:39:37 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:39:37.427995 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e7007-0c64-4e6c-9b4d-6db7680d1af3 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:37.443745 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e7007-0c64-4e6c-9b4d-6db7680d1af3 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:37.453128 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a413215-3ac6-41d7-a830-21608cc3a78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:37.454274 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a413215-3ac6-41d7-a830-21608cc3a78b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:37.454547 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a413215-3ac6-41d7-a830-21608cc3a78b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:37.454815 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a413215-3ac6-41d7-a830-21608cc3a78b admin admin] PATH_INFO: `/v3/projects/ba4e7e226fb9434c8e8ef62cae347a95` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:37.456121 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a413215-3ac6-41d7-a830-21608cc3a78b admin admin] RBAC: Authorizing `identity:get_project(project_id=ba4e7e226fb9434c8e8ef62cae347a95)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:37.458169 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a413215-3ac6-41d7-a830-21608cc3a78b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:37.459774 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 589/1182] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:39:37 2022] GET /identity/v3/projects/ba4e7e226fb9434c8e8ef62cae347a95 => generated 361 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:39:37.465625 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7b8d4-2fba-4240-85bc-4c2677dffe1f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:37.474458 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7b8d4-2fba-4240-85bc-4c2677dffe1f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:37.480302 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd517a1-ce50-4ba8-b341-402a89ad59a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:37.480940 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd517a1-ce50-4ba8-b341-402a89ad59a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:37.481221 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd517a1-ce50-4ba8-b341-402a89ad59a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:37.481483 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd517a1-ce50-4ba8-b341-402a89ad59a8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:37.482306 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd517a1-ce50-4ba8-b341-402a89ad59a8 admin admin] RBAC: Adding query filter params (role.id=3c05bedf79e04eb38d2ae66736030bfe, scope.project.id=ba4e7e226fb9434c8e8ef62cae347a95, user.id=67ca3c65ae5947d9ba9f5abd1872d29f) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:39:37.482613 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd517a1-ce50-4ba8-b341-402a89ad59a8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:37.484405 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd517a1-ce50-4ba8-b341-402a89ad59a8 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:37.490180 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 594/1183] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:39:37 2022] GET /identity/v3/role_assignments?user.id=67ca3c65ae5947d9ba9f5abd1872d29f&scope.project.id=ba4e7e226fb9434c8e8ef62cae347a95&role.id=3c05bedf79e04eb38d2ae66736030bfe => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:39.824661 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2dc26-7083-4f19-8e17-7693c244c9a8 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:39.825587 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2dc26-7083-4f19-8e17-7693c244c9a8 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:39.825587 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2dc26-7083-4f19-8e17-7693c244c9a8 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:39.828501 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 590/1184] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:39:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:39:39.837774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d7030-779b-49ed-9e0e-407dca4be9e6 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:39.838454 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d7030-779b-49ed-9e0e-407dca4be9e6 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:39.838623 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d7030-779b-49ed-9e0e-407dca4be9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:39.865210 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-230d7030-779b-49ed-9e0e-407dca4be9e6 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:39:39.866389 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-230d7030-779b-49ed-9e0e-407dca4be9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:39:39.881624 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 595/1185] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:39:39 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:39:39.907728 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2dc26-7083-4f19-8e17-7693c244c9a8 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:39.927562 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2dc26-7083-4f19-8e17-7693c244c9a8 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:39.932997 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db34f9-00f4-4532-ba29-fae51f4b2120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:39.933787 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db34f9-00f4-4532-ba29-fae51f4b2120 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:39.934069 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db34f9-00f4-4532-ba29-fae51f4b2120 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:39.934344 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db34f9-00f4-4532-ba29-fae51f4b2120 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:39.944864 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db34f9-00f4-4532-ba29-fae51f4b2120 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:39:39.951494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-39db34f9-00f4-4532-ba29-fae51f4b2120 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:39:39.952621 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 591/1186] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:39:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:39:39.961445 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d7030-779b-49ed-9e0e-407dca4be9e6 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:39.973745 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d7030-779b-49ed-9e0e-407dca4be9e6 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:39.979558 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfb0a3-bf40-4bcd-ad75-ed7a29b8830d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:39.980215 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfb0a3-bf40-4bcd-ad75-ed7a29b8830d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:39.980489 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfb0a3-bf40-4bcd-ad75-ed7a29b8830d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:39.980755 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfb0a3-bf40-4bcd-ad75-ed7a29b8830d admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:39.981542 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfb0a3-bf40-4bcd-ad75-ed7a29b8830d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:39:39.981838 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfb0a3-bf40-4bcd-ad75-ed7a29b8830d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:39.983490 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfb0a3-bf40-4bcd-ad75-ed7a29b8830d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:39.992886 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 596/1187] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:39:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:39.999631 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db34f9-00f4-4532-ba29-fae51f4b2120 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:40.011106 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db34f9-00f4-4532-ba29-fae51f4b2120 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:40.017195 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9378a15-a195-4fdd-9683-3ae1dbe37c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:40.018041 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9378a15-a195-4fdd-9683-3ae1dbe37c93 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:40.018320 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9378a15-a195-4fdd-9683-3ae1dbe37c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:40.018593 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9378a15-a195-4fdd-9683-3ae1dbe37c93 admin admin] PATH_INFO: `/v3/users/67ca3c65ae5947d9ba9f5abd1872d29f` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:40.019994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9378a15-a195-4fdd-9683-3ae1dbe37c93 admin admin] RBAC: Authorizing `identity:get_user(user_id=67ca3c65ae5947d9ba9f5abd1872d29f)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:40.022169 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9378a15-a195-4fdd-9683-3ae1dbe37c93 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:40.024078 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 592/1188] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:39:39 2022] GET /identity/v3/users/67ca3c65ae5947d9ba9f5abd1872d29f => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:40.029871 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfb0a3-bf40-4bcd-ad75-ed7a29b8830d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:40.040235 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfb0a3-bf40-4bcd-ad75-ed7a29b8830d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:40.045984 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18deba7-c653-4022-bfc4-7207ed192506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:40.046833 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18deba7-c653-4022-bfc4-7207ed192506 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:40.047114 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18deba7-c653-4022-bfc4-7207ed192506 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:40.047386 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18deba7-c653-4022-bfc4-7207ed192506 admin admin] PATH_INFO: `/v3/projects/ba4e7e226fb9434c8e8ef62cae347a95` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:40.048886 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18deba7-c653-4022-bfc4-7207ed192506 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba4e7e226fb9434c8e8ef62cae347a95)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:40.050944 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18deba7-c653-4022-bfc4-7207ed192506 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:40.052587 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 597/1189] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:39:40 2022] GET /identity/v3/projects/ba4e7e226fb9434c8e8ef62cae347a95 => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:40.058316 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9378a15-a195-4fdd-9683-3ae1dbe37c93 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:40.071238 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9378a15-a195-4fdd-9683-3ae1dbe37c93 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:40.080307 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64a475-efd5-4dff-924c-9066eb74a202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:40.081611 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64a475-efd5-4dff-924c-9066eb74a202 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:40.081923 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64a475-efd5-4dff-924c-9066eb74a202 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:40.082279 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64a475-efd5-4dff-924c-9066eb74a202 admin admin] PATH_INFO: `/v3/projects/ba4e7e226fb9434c8e8ef62cae347a95/users/67ca3c65ae5947d9ba9f5abd1872d29f/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:40.085800 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64a475-efd5-4dff-924c-9066eb74a202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba4e7e226fb9434c8e8ef62cae347a95, user_id=67ca3c65ae5947d9ba9f5abd1872d29f, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:40.090046 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64a475-efd5-4dff-924c-9066eb74a202 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:40.112538 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 593/1190] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:39:40 2022] PUT /identity/v3/projects/ba4e7e226fb9434c8e8ef62cae347a95/users/67ca3c65ae5947d9ba9f5abd1872d29f/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:39:42.452925 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf10f9-8df1-4921-9d78-3fbaedc9f49f None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:42.453501 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf10f9-8df1-4921-9d78-3fbaedc9f49f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:42.453501 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf10f9-8df1-4921-9d78-3fbaedc9f49f None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:42.456210 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 598/1191] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:39:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:39:42.465134 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482ea0a-36f4-498c-a6e4-7ac5398a1700 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:42.465527 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482ea0a-36f4-498c-a6e4-7ac5398a1700 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:42.465805 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482ea0a-36f4-498c-a6e4-7ac5398a1700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:42.485713 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-8482ea0a-36f4-498c-a6e4-7ac5398a1700 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:39:42.486893 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-8482ea0a-36f4-498c-a6e4-7ac5398a1700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:39:42.545732 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 594/1192] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:39:42 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:39:42.577555 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf10f9-8df1-4921-9d78-3fbaedc9f49f None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:42.590369 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf10f9-8df1-4921-9d78-3fbaedc9f49f None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:42.595391 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5765bd4-23eb-4e5d-b8ca-237f0a1b8a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:42.596165 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5765bd4-23eb-4e5d-b8ca-237f0a1b8a21 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:42.596440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5765bd4-23eb-4e5d-b8ca-237f0a1b8a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:42.596712 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5765bd4-23eb-4e5d-b8ca-237f0a1b8a21 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:42.608520 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5765bd4-23eb-4e5d-b8ca-237f0a1b8a21 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:39:42.615427 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-d5765bd4-23eb-4e5d-b8ca-237f0a1b8a21 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:39:42.616571 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 599/1193] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:39:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:39:42.622471 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482ea0a-36f4-498c-a6e4-7ac5398a1700 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:42.632170 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482ea0a-36f4-498c-a6e4-7ac5398a1700 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:42.638350 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978b202-f57c-4504-bac6-bf981532fd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:42.639004 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978b202-f57c-4504-bac6-bf981532fd9b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:42.639279 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978b202-f57c-4504-bac6-bf981532fd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:42.639547 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978b202-f57c-4504-bac6-bf981532fd9b admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:42.640302 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978b202-f57c-4504-bac6-bf981532fd9b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:39:42.640605 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978b202-f57c-4504-bac6-bf981532fd9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:42.642287 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978b202-f57c-4504-bac6-bf981532fd9b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:42.651457 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 595/1194] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:39:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:42.657090 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5765bd4-23eb-4e5d-b8ca-237f0a1b8a21 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:42.667175 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5765bd4-23eb-4e5d-b8ca-237f0a1b8a21 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:42.672151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc93ec-4c13-447b-9ddd-f6ea3af943da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:42.673057 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc93ec-4c13-447b-9ddd-f6ea3af943da admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:42.673337 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc93ec-4c13-447b-9ddd-f6ea3af943da admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:42.673611 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc93ec-4c13-447b-9ddd-f6ea3af943da admin admin] PATH_INFO: `/v3/users/67ca3c65ae5947d9ba9f5abd1872d29f` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:42.674815 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc93ec-4c13-447b-9ddd-f6ea3af943da admin admin] RBAC: Authorizing `identity:get_user(user_id=67ca3c65ae5947d9ba9f5abd1872d29f)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:42.676948 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc93ec-4c13-447b-9ddd-f6ea3af943da admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:42.678494 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 600/1195] 10.222.0.31 () {56 vars in 1198 bytes} [Mon Jan 10 17:39:42 2022] GET /identity/v3/users/67ca3c65ae5947d9ba9f5abd1872d29f => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:39:42.683757 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978b202-f57c-4504-bac6-bf981532fd9b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:42.693585 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978b202-f57c-4504-bac6-bf981532fd9b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:42.699254 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe669d-fc59-4ba1-b402-c89819c26235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:42.699863 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe669d-fc59-4ba1-b402-c89819c26235 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:42.700137 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe669d-fc59-4ba1-b402-c89819c26235 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:42.700409 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe669d-fc59-4ba1-b402-c89819c26235 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:42.708720 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe669d-fc59-4ba1-b402-c89819c26235 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:42.710434 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe669d-fc59-4ba1-b402-c89819c26235 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:42.719586 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 596/1196] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:39:42 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:39:42.725332 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc93ec-4c13-447b-9ddd-f6ea3af943da admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:42.735344 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc93ec-4c13-447b-9ddd-f6ea3af943da admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:42.741151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea664357-43c9-4466-a4db-b616a77b2951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:42.741989 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea664357-43c9-4466-a4db-b616a77b2951 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:42.742267 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea664357-43c9-4466-a4db-b616a77b2951 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:42.742537 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea664357-43c9-4466-a4db-b616a77b2951 admin admin] PATH_INFO: `/v3/projects/ba4e7e226fb9434c8e8ef62cae347a95` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:42.743858 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea664357-43c9-4466-a4db-b616a77b2951 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba4e7e226fb9434c8e8ef62cae347a95)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:42.745926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea664357-43c9-4466-a4db-b616a77b2951 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:42.747582 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 601/1197] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:39:42 2022] GET /identity/v3/projects/ba4e7e226fb9434c8e8ef62cae347a95 => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:39:42.753324 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe669d-fc59-4ba1-b402-c89819c26235 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:39:42.762069 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe669d-fc59-4ba1-b402-c89819c26235 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:39:42.767143 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6426099-e71a-44ee-b66b-24532c4d42c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:39:42.767764 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6426099-e71a-44ee-b66b-24532c4d42c4 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:39:42.768040 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6426099-e71a-44ee-b66b-24532c4d42c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:39:42.768309 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6426099-e71a-44ee-b66b-24532c4d42c4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:39:42.769151 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6426099-e71a-44ee-b66b-24532c4d42c4 admin admin] RBAC: Adding query filter params (role.id=3c05bedf79e04eb38d2ae66736030bfe, scope.project.id=ba4e7e226fb9434c8e8ef62cae347a95, user.id=67ca3c65ae5947d9ba9f5abd1872d29f) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:39:42.769454 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6426099-e71a-44ee-b66b-24532c4d42c4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:39:42.771262 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6426099-e71a-44ee-b66b-24532c4d42c4 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:39:42.777393 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 597/1198] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:39:42 2022] GET /identity/v3/role_assignments?user.id=67ca3c65ae5947d9ba9f5abd1872d29f&scope.project.id=ba4e7e226fb9434c8e8ef62cae347a95&role.id=3c05bedf79e04eb38d2ae66736030bfe => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:42.114691 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed92a52-eb95-4062-89ee-c3fd43a8dfb7 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:42.115254 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed92a52-eb95-4062-89ee-c3fd43a8dfb7 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:42.115254 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed92a52-eb95-4062-89ee-c3fd43a8dfb7 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:42.117828 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 602/1199] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:40:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:40:42.124092 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75729fb5-ea1b-4cd7-9e61-887867380788 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:42.124581 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75729fb5-ea1b-4cd7-9e61-887867380788 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:42.124698 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75729fb5-ea1b-4cd7-9e61-887867380788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:42.154213 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-75729fb5-ea1b-4cd7-9e61-887867380788 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:40:42.155416 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-75729fb5-ea1b-4cd7-9e61-887867380788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:40:42.166779 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 598/1200] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:40:42 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:40:42.194454 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed92a52-eb95-4062-89ee-c3fd43a8dfb7 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:42.212694 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed92a52-eb95-4062-89ee-c3fd43a8dfb7 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:42.218237 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa252e8f-2f82-44fd-bfde-49ec01a83827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:42.219195 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa252e8f-2f82-44fd-bfde-49ec01a83827 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:42.219515 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa252e8f-2f82-44fd-bfde-49ec01a83827 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:42.219824 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa252e8f-2f82-44fd-bfde-49ec01a83827 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:42.232428 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa252e8f-2f82-44fd-bfde-49ec01a83827 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:42.234631 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa252e8f-2f82-44fd-bfde-49ec01a83827 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:42.257335 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-fa252e8f-2f82-44fd-bfde-49ec01a83827 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:40:42.258952 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 603/1201] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:40:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:40:42.265893 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75729fb5-ea1b-4cd7-9e61-887867380788 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:42.276062 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75729fb5-ea1b-4cd7-9e61-887867380788 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:42.282028 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c5b43-108c-47cd-8abb-0ce633159af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:42.282964 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c5b43-108c-47cd-8abb-0ce633159af2 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:42.283427 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c5b43-108c-47cd-8abb-0ce633159af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:42.283908 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c5b43-108c-47cd-8abb-0ce633159af2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:42.284965 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c5b43-108c-47cd-8abb-0ce633159af2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:42.288012 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c5b43-108c-47cd-8abb-0ce633159af2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:42.289979 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c5b43-108c-47cd-8abb-0ce633159af2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:42.302839 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 599/1202] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:42.310362 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa252e8f-2f82-44fd-bfde-49ec01a83827 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:42.320459 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa252e8f-2f82-44fd-bfde-49ec01a83827 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:42.325758 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b2d27-c41b-479d-8649-8fc674a9ab88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:42.326425 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b2d27-c41b-479d-8649-8fc674a9ab88 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:42.326703 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b2d27-c41b-479d-8649-8fc674a9ab88 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:42.326975 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b2d27-c41b-479d-8649-8fc674a9ab88 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:42.327714 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b2d27-c41b-479d-8649-8fc674a9ab88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:42.329802 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b2d27-c41b-479d-8649-8fc674a9ab88 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:42.356682 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 604/1203] 10.222.0.31 () {60 vars in 1153 bytes} [Mon Jan 10 17:40:42 2022] POST /identity/v3/users => generated 251 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:40:44.926074 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e730f-fb95-481a-bbbc-8a75679daffc None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:44.926677 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e730f-fb95-481a-bbbc-8a75679daffc None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:44.926677 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e730f-fb95-481a-bbbc-8a75679daffc None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:44.928408 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 600/1204] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:40:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:40:44.933684 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14989aca-1e66-4ddd-a763-9aa522edea32 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:44.934228 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14989aca-1e66-4ddd-a763-9aa522edea32 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:44.934228 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14989aca-1e66-4ddd-a763-9aa522edea32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:44.952151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-14989aca-1e66-4ddd-a763-9aa522edea32 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:40:44.953455 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-14989aca-1e66-4ddd-a763-9aa522edea32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:40:44.962089 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 605/1205] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:40:44 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:40:44.987487 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e730f-fb95-481a-bbbc-8a75679daffc None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:45.001137 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e730f-fb95-481a-bbbc-8a75679daffc None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:45.005921 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2128d-a5ca-4469-a0ee-d1c615c70ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:45.006783 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2128d-a5ca-4469-a0ee-d1c615c70ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:45.007065 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2128d-a5ca-4469-a0ee-d1c615c70ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:45.007336 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2128d-a5ca-4469-a0ee-d1c615c70ca6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:45.020425 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2128d-a5ca-4469-a0ee-d1c615c70ca6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:40:45.027803 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-46b2128d-a5ca-4469-a0ee-d1c615c70ca6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 17:40:45.029048 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 601/1206] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:40:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:40:45.035639 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14989aca-1e66-4ddd-a763-9aa522edea32 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:45.045081 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14989aca-1e66-4ddd-a763-9aa522edea32 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:45.049652 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d77bb2-6fc2-4cc3-8153-7f5c2d239d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:45.050383 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d77bb2-6fc2-4cc3-8153-7f5c2d239d36 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:45.050723 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d77bb2-6fc2-4cc3-8153-7f5c2d239d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:45.051108 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d77bb2-6fc2-4cc3-8153-7f5c2d239d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:45.051847 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d77bb2-6fc2-4cc3-8153-7f5c2d239d36 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:45.052126 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d77bb2-6fc2-4cc3-8153-7f5c2d239d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:45.053903 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d77bb2-6fc2-4cc3-8153-7f5c2d239d36 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:45.063210 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 606/1207] 10.222.0.31 () {56 vars in 1124 bytes} [Mon Jan 10 17:40:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:45.068816 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2128d-a5ca-4469-a0ee-d1c615c70ca6 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:45.078447 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2128d-a5ca-4469-a0ee-d1c615c70ca6 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:45.083046 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e082b16-176a-4ed8-912a-08b72507ab7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:45.083833 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e082b16-176a-4ed8-912a-08b72507ab7b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:45.084113 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e082b16-176a-4ed8-912a-08b72507ab7b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:45.084381 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e082b16-176a-4ed8-912a-08b72507ab7b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:45.095220 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e082b16-176a-4ed8-912a-08b72507ab7b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:45.097114 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e082b16-176a-4ed8-912a-08b72507ab7b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:45.114353 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-8e082b16-176a-4ed8-912a-08b72507ab7b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:40:45.116932 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 602/1208] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:40:45.121334 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d77bb2-6fc2-4cc3-8153-7f5c2d239d36 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:45.131090 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d77bb2-6fc2-4cc3-8153-7f5c2d239d36 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:45.135724 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14b465-ab96-43c1-8610-365e41912dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:45.136380 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14b465-ab96-43c1-8610-365e41912dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:45.136663 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14b465-ab96-43c1-8610-365e41912dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:45.136978 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14b465-ab96-43c1-8610-365e41912dc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:45.137732 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14b465-ab96-43c1-8610-365e41912dc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:45.138036 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14b465-ab96-43c1-8610-365e41912dc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:45.139622 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14b465-ab96-43c1-8610-365e41912dc9 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:45.152716 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 607/1209] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:45.159001 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e082b16-176a-4ed8-912a-08b72507ab7b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:45.169502 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e082b16-176a-4ed8-912a-08b72507ab7b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:45.174841 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e92697-862b-42d4-a69d-b56798128668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:45.175730 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e92697-862b-42d4-a69d-b56798128668 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:45.176177 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e92697-862b-42d4-a69d-b56798128668 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:45.176444 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e92697-862b-42d4-a69d-b56798128668 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:45.184934 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e92697-862b-42d4-a69d-b56798128668 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:45.187068 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e92697-862b-42d4-a69d-b56798128668 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:45.201679 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-60e92697-862b-42d4-a69d-b56798128668 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 10 17:40:45.202911 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 603/1210] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:40:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:40:45.208996 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14b465-ab96-43c1-8610-365e41912dc9 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:45.218820 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14b465-ab96-43c1-8610-365e41912dc9 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:45.223784 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fae3e-c7df-41c0-890c-82614bf41d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:45.224444 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fae3e-c7df-41c0-890c-82614bf41d12 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:45.224716 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fae3e-c7df-41c0-890c-82614bf41d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:45.225039 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fae3e-c7df-41c0-890c-82614bf41d12 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:45.225880 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fae3e-c7df-41c0-890c-82614bf41d12 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:45.226185 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fae3e-c7df-41c0-890c-82614bf41d12 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:45.228012 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fae3e-c7df-41c0-890c-82614bf41d12 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:45.246433 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 608/1211] 10.222.0.31 () {56 vars in 1164 bytes} [Mon Jan 10 17:40:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:45.252485 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e92697-862b-42d4-a69d-b56798128668 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:45.262314 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e92697-862b-42d4-a69d-b56798128668 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:45.272303 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9c97d-aad1-43db-b98a-386583cc027a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:45.272303 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9c97d-aad1-43db-b98a-386583cc027a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:45.272303 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9c97d-aad1-43db-b98a-386583cc027a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:45.272303 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9c97d-aad1-43db-b98a-386583cc027a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:45.280449 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9c97d-aad1-43db-b98a-386583cc027a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:45.282441 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9c97d-aad1-43db-b98a-386583cc027a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:45.292634 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 604/1212] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:40:45 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:40:45.300638 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fae3e-c7df-41c0-890c-82614bf41d12 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:45.313623 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fae3e-c7df-41c0-890c-82614bf41d12 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:45.318840 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880c873-5eb1-4657-b082-6a6ad7ddfe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:45.320148 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880c873-5eb1-4657-b082-6a6ad7ddfe16 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:45.320148 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880c873-5eb1-4657-b082-6a6ad7ddfe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:45.320340 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880c873-5eb1-4657-b082-6a6ad7ddfe16 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:45.332966 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880c873-5eb1-4657-b082-6a6ad7ddfe16 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:45.334830 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880c873-5eb1-4657-b082-6a6ad7ddfe16 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:45.356348 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-1880c873-5eb1-4657-b082-6a6ad7ddfe16 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:40:45.357960 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 609/1213] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:40:45.365862 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9c97d-aad1-43db-b98a-386583cc027a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:45.375295 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9c97d-aad1-43db-b98a-386583cc027a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:45.382716 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9da45-0a2a-4e4a-a61a-c6f32f6e0d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:45.383478 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9da45-0a2a-4e4a-a61a-c6f32f6e0d35 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:45.383822 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9da45-0a2a-4e4a-a61a-c6f32f6e0d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:45.384132 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9da45-0a2a-4e4a-a61a-c6f32f6e0d35 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:45.384870 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9da45-0a2a-4e4a-a61a-c6f32f6e0d35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:45.385850 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9da45-0a2a-4e4a-a61a-c6f32f6e0d35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:45.386763 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9da45-0a2a-4e4a-a61a-c6f32f6e0d35 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:45.399369 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 605/1214] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:45.406155 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880c873-5eb1-4657-b082-6a6ad7ddfe16 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:45.415982 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880c873-5eb1-4657-b082-6a6ad7ddfe16 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:45.421033 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c7953-f63b-42c9-920a-3e840b598209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:45.421873 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c7953-f63b-42c9-920a-3e840b598209 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:45.422160 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c7953-f63b-42c9-920a-3e840b598209 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:45.422427 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c7953-f63b-42c9-920a-3e840b598209 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:45.430296 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c7953-f63b-42c9-920a-3e840b598209 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:45.432329 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c7953-f63b-42c9-920a-3e840b598209 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:45.447066 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-826c7953-f63b-42c9-920a-3e840b598209 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:40:45.448905 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 610/1215] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:40:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:40:45.455135 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9da45-0a2a-4e4a-a61a-c6f32f6e0d35 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:45.466599 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9da45-0a2a-4e4a-a61a-c6f32f6e0d35 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:45.472239 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac7168-af66-4248-980b-e3002076ceea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:45.473328 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac7168-af66-4248-980b-e3002076ceea admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:45.473757 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac7168-af66-4248-980b-e3002076ceea admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:45.474132 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac7168-af66-4248-980b-e3002076ceea admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:45.475242 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac7168-af66-4248-980b-e3002076ceea admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:45.475707 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac7168-af66-4248-980b-e3002076ceea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:45.478179 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac7168-af66-4248-980b-e3002076ceea admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:45.494330 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 606/1216] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:40:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:45.500560 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c7953-f63b-42c9-920a-3e840b598209 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:45.511473 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c7953-f63b-42c9-920a-3e840b598209 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:45.519684 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adfaff-6a9b-4e78-9198-c320b4067b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:45.520461 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adfaff-6a9b-4e78-9198-c320b4067b8c admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:45.520624 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adfaff-6a9b-4e78-9198-c320b4067b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:45.520887 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adfaff-6a9b-4e78-9198-c320b4067b8c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:45.521728 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adfaff-6a9b-4e78-9198-c320b4067b8c admin admin] RBAC: Adding query filter params (role.id=67bb9b9aab104609b23a2ab5e7d31142, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=3a3b8e620cfd42fe993c73dc83a246be) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:45.522720 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adfaff-6a9b-4e78-9198-c320b4067b8c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:45.524191 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adfaff-6a9b-4e78-9198-c320b4067b8c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:45.530527 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 611/1217] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:40:45 2022] GET /identity/v3/role_assignments?user.id=3a3b8e620cfd42fe993c73dc83a246be&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=67bb9b9aab104609b23a2ab5e7d31142 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:48.129061 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee46359-701c-4b60-9e1c-7b6e226785e8 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:48.129597 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee46359-701c-4b60-9e1c-7b6e226785e8 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:48.129597 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee46359-701c-4b60-9e1c-7b6e226785e8 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:48.131412 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 607/1218] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:40:48.137685 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409523fd-f54e-4d6c-8237-097e1bc61c5e None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:48.138127 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409523fd-f54e-4d6c-8237-097e1bc61c5e None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:48.138220 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409523fd-f54e-4d6c-8237-097e1bc61c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:48.162156 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-409523fd-f54e-4d6c-8237-097e1bc61c5e None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:40:48.163453 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-409523fd-f54e-4d6c-8237-097e1bc61c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:40:48.174630 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 612/1219] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:40:48 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:40:48.198846 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee46359-701c-4b60-9e1c-7b6e226785e8 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:48.212325 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee46359-701c-4b60-9e1c-7b6e226785e8 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:48.217679 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c25b36-03ce-447b-a0c9-8b647711f442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:48.218793 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c25b36-03ce-447b-a0c9-8b647711f442 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:48.219093 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c25b36-03ce-447b-a0c9-8b647711f442 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:48.219368 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c25b36-03ce-447b-a0c9-8b647711f442 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:48.230507 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c25b36-03ce-447b-a0c9-8b647711f442 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:40:48.237815 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-c1c25b36-03ce-447b-a0c9-8b647711f442 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 17:40:48.239012 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 608/1220] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:40:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:40:48.245253 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409523fd-f54e-4d6c-8237-097e1bc61c5e None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:48.254675 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409523fd-f54e-4d6c-8237-097e1bc61c5e None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:48.259523 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e657c-baff-4faf-891e-c4897d3a0792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:48.260218 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e657c-baff-4faf-891e-c4897d3a0792 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:48.260530 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e657c-baff-4faf-891e-c4897d3a0792 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:48.260802 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e657c-baff-4faf-891e-c4897d3a0792 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:48.261637 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e657c-baff-4faf-891e-c4897d3a0792 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:48.261945 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e657c-baff-4faf-891e-c4897d3a0792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:48.263637 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e657c-baff-4faf-891e-c4897d3a0792 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:48.272164 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 613/1221] 10.222.0.31 () {56 vars in 1124 bytes} [Mon Jan 10 17:40:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:48.278570 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c25b36-03ce-447b-a0c9-8b647711f442 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:48.290112 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c25b36-03ce-447b-a0c9-8b647711f442 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:48.294783 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f36c0e-baba-4f87-9014-5815a1d96dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:48.295595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f36c0e-baba-4f87-9014-5815a1d96dbd admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:48.295867 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f36c0e-baba-4f87-9014-5815a1d96dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:48.296131 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f36c0e-baba-4f87-9014-5815a1d96dbd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:48.306387 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f36c0e-baba-4f87-9014-5815a1d96dbd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:48.308222 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f36c0e-baba-4f87-9014-5815a1d96dbd admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:48.326154 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-e5f36c0e-baba-4f87-9014-5815a1d96dbd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:40:48.327389 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 609/1222] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:40:48.334167 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e657c-baff-4faf-891e-c4897d3a0792 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:48.343904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e657c-baff-4faf-891e-c4897d3a0792 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:48.348463 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b58491-3ba5-470d-af1d-5b963d0589fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:48.349141 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b58491-3ba5-470d-af1d-5b963d0589fd admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:48.349418 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b58491-3ba5-470d-af1d-5b963d0589fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:48.349688 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b58491-3ba5-470d-af1d-5b963d0589fd admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:48.350413 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b58491-3ba5-470d-af1d-5b963d0589fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:48.350711 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b58491-3ba5-470d-af1d-5b963d0589fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:48.352291 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b58491-3ba5-470d-af1d-5b963d0589fd admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:48.364752 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 614/1223] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:48.370706 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f36c0e-baba-4f87-9014-5815a1d96dbd admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:48.381183 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f36c0e-baba-4f87-9014-5815a1d96dbd admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:48.385672 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4b247-8cf4-4622-b3a9-2324a47389fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:48.386445 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4b247-8cf4-4622-b3a9-2324a47389fb admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:48.386726 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4b247-8cf4-4622-b3a9-2324a47389fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:48.386988 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4b247-8cf4-4622-b3a9-2324a47389fb admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:48.394462 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4b247-8cf4-4622-b3a9-2324a47389fb admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:48.396470 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4b247-8cf4-4622-b3a9-2324a47389fb admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:48.410718 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-d8e4b247-8cf4-4622-b3a9-2324a47389fb admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 10 17:40:48.411879 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 610/1224] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:40:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:40:48.417778 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b58491-3ba5-470d-af1d-5b963d0589fd admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:48.427455 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b58491-3ba5-470d-af1d-5b963d0589fd admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:48.432457 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa762a55-324d-4cb3-9156-4dd718166624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:48.433228 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa762a55-324d-4cb3-9156-4dd718166624 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:48.433576 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa762a55-324d-4cb3-9156-4dd718166624 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:48.433936 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa762a55-324d-4cb3-9156-4dd718166624 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:48.434849 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa762a55-324d-4cb3-9156-4dd718166624 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:48.435241 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa762a55-324d-4cb3-9156-4dd718166624 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:48.437176 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa762a55-324d-4cb3-9156-4dd718166624 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:48.454632 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 615/1225] 10.222.0.31 () {56 vars in 1164 bytes} [Mon Jan 10 17:40:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:48.461242 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4b247-8cf4-4622-b3a9-2324a47389fb admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:48.472993 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4b247-8cf4-4622-b3a9-2324a47389fb admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:48.478147 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1a5ba-a38f-4abf-a1ea-32181c80ffc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:48.478942 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1a5ba-a38f-4abf-a1ea-32181c80ffc4 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:48.479257 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1a5ba-a38f-4abf-a1ea-32181c80ffc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:48.479528 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1a5ba-a38f-4abf-a1ea-32181c80ffc4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:48.490137 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1a5ba-a38f-4abf-a1ea-32181c80ffc4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:48.491981 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1a5ba-a38f-4abf-a1ea-32181c80ffc4 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:48.508925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-cbe1a5ba-a38f-4abf-a1ea-32181c80ffc4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:40:48.510284 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 611/1226] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:40:48.515953 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa762a55-324d-4cb3-9156-4dd718166624 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:48.526317 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa762a55-324d-4cb3-9156-4dd718166624 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:48.530903 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f60e3-02c4-417d-9099-6e74fa9cb060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:48.531599 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f60e3-02c4-417d-9099-6e74fa9cb060 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:48.531882 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f60e3-02c4-417d-9099-6e74fa9cb060 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:48.532161 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f60e3-02c4-417d-9099-6e74fa9cb060 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:48.532931 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f60e3-02c4-417d-9099-6e74fa9cb060 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:48.533240 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f60e3-02c4-417d-9099-6e74fa9cb060 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:48.534832 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f60e3-02c4-417d-9099-6e74fa9cb060 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:48.546092 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 616/1227] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:48.551825 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1a5ba-a38f-4abf-a1ea-32181c80ffc4 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:48.561409 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1a5ba-a38f-4abf-a1ea-32181c80ffc4 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:48.566214 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d91b35-3afc-4d63-bfb8-2d1e160a8773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:48.567002 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d91b35-3afc-4d63-bfb8-2d1e160a8773 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:48.567281 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d91b35-3afc-4d63-bfb8-2d1e160a8773 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:48.567552 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d91b35-3afc-4d63-bfb8-2d1e160a8773 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:48.574419 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d91b35-3afc-4d63-bfb8-2d1e160a8773 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:48.576394 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d91b35-3afc-4d63-bfb8-2d1e160a8773 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:48.589519 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-17d91b35-3afc-4d63-bfb8-2d1e160a8773 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:40:48.590722 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 612/1228] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:40:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:40:48.597417 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f60e3-02c4-417d-9099-6e74fa9cb060 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:48.607268 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f60e3-02c4-417d-9099-6e74fa9cb060 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:48.612404 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447af6c3-cb1c-433b-a5f7-bd082b8f98cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:48.613094 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447af6c3-cb1c-433b-a5f7-bd082b8f98cf admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:48.613398 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447af6c3-cb1c-433b-a5f7-bd082b8f98cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:48.613668 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447af6c3-cb1c-433b-a5f7-bd082b8f98cf admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:48.614624 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447af6c3-cb1c-433b-a5f7-bd082b8f98cf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:48.615008 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447af6c3-cb1c-433b-a5f7-bd082b8f98cf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:48.616901 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447af6c3-cb1c-433b-a5f7-bd082b8f98cf admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:48.629517 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 617/1229] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:40:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:48.635789 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d91b35-3afc-4d63-bfb8-2d1e160a8773 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:48.646473 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d91b35-3afc-4d63-bfb8-2d1e160a8773 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:48.651693 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e89395-96e1-4e14-8a51-3bfdfb96dd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:48.652622 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e89395-96e1-4e14-8a51-3bfdfb96dd5e admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:48.652964 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e89395-96e1-4e14-8a51-3bfdfb96dd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:48.653238 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e89395-96e1-4e14-8a51-3bfdfb96dd5e admin admin] PATH_INFO: `/v3/projects/1415eea0335a49bf800e8215498af679/users/3a3b8e620cfd42fe993c73dc83a246be/roles/67bb9b9aab104609b23a2ab5e7d31142` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:48.668525 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e89395-96e1-4e14-8a51-3bfdfb96dd5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1415eea0335a49bf800e8215498af679, user_id=3a3b8e620cfd42fe993c73dc83a246be, role_id=67bb9b9aab104609b23a2ab5e7d31142)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:48.671217 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e89395-96e1-4e14-8a51-3bfdfb96dd5e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:48.686229 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 613/1230] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:40:48 2022] PUT /identity/v3/projects/1415eea0335a49bf800e8215498af679/users/3a3b8e620cfd42fe993c73dc83a246be/roles/67bb9b9aab104609b23a2ab5e7d31142 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:40:51.190318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8034ea-3caf-4e28-a9ed-f51085c50ea9 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:51.190901 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8034ea-3caf-4e28-a9ed-f51085c50ea9 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:51.190901 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8034ea-3caf-4e28-a9ed-f51085c50ea9 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:51.192996 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 618/1231] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:40:51.198443 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff207a-e10c-4801-bf5c-97ac8070e16f None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:51.198922 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff207a-e10c-4801-bf5c-97ac8070e16f None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:51.199036 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff207a-e10c-4801-bf5c-97ac8070e16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:51.216385 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-0dff207a-e10c-4801-bf5c-97ac8070e16f None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:40:51.217577 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-0dff207a-e10c-4801-bf5c-97ac8070e16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:40:51.273983 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 614/1232] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:40:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:40:51.299053 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8034ea-3caf-4e28-a9ed-f51085c50ea9 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:51.311529 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8034ea-3caf-4e28-a9ed-f51085c50ea9 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:51.316270 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c34ae-ec78-42e6-96b5-cb2fa8cebb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:51.317067 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c34ae-ec78-42e6-96b5-cb2fa8cebb00 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:51.317341 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c34ae-ec78-42e6-96b5-cb2fa8cebb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:51.317613 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c34ae-ec78-42e6-96b5-cb2fa8cebb00 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:51.328022 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c34ae-ec78-42e6-96b5-cb2fa8cebb00 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:40:51.334923 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-740c34ae-ec78-42e6-96b5-cb2fa8cebb00 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 17:40:51.337024 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 619/1233] 10.222.0.31 () {56 vars in 1123 bytes} [Mon Jan 10 17:40:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:40:51.342088 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff207a-e10c-4801-bf5c-97ac8070e16f None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:51.351273 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff207a-e10c-4801-bf5c-97ac8070e16f None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:51.356930 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0d7ea-d8bd-43dc-8232-ce214d898cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:51.357622 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0d7ea-d8bd-43dc-8232-ce214d898cfe admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:51.357888 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0d7ea-d8bd-43dc-8232-ce214d898cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:51.358163 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0d7ea-d8bd-43dc-8232-ce214d898cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:51.358929 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0d7ea-d8bd-43dc-8232-ce214d898cfe admin admin] RBAC: Adding query filter params (name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:51.359238 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0d7ea-d8bd-43dc-8232-ce214d898cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:51.361003 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0d7ea-d8bd-43dc-8232-ce214d898cfe admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:51.370078 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 615/1234] 10.222.0.31 () {56 vars in 1124 bytes} [Mon Jan 10 17:40:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:51.376381 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c34ae-ec78-42e6-96b5-cb2fa8cebb00 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:51.386613 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c34ae-ec78-42e6-96b5-cb2fa8cebb00 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:51.391402 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee85ef-8202-4f03-83e9-7326c6da1a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:51.392184 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee85ef-8202-4f03-83e9-7326c6da1a74 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:51.392460 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee85ef-8202-4f03-83e9-7326c6da1a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:51.392729 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee85ef-8202-4f03-83e9-7326c6da1a74 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:51.404335 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee85ef-8202-4f03-83e9-7326c6da1a74 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:51.406269 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee85ef-8202-4f03-83e9-7326c6da1a74 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:51.422526 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-beee85ef-8202-4f03-83e9-7326c6da1a74 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:40:51.423690 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 620/1235] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:40:51.429795 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0d7ea-d8bd-43dc-8232-ce214d898cfe admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:51.439962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0d7ea-d8bd-43dc-8232-ce214d898cfe admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:51.444795 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729275f2-dcf7-45d4-a490-2cf9018c9ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:51.445437 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729275f2-dcf7-45d4-a490-2cf9018c9ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:51.445795 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729275f2-dcf7-45d4-a490-2cf9018c9ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:51.446075 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729275f2-dcf7-45d4-a490-2cf9018c9ba5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:51.446837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729275f2-dcf7-45d4-a490-2cf9018c9ba5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:51.447143 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729275f2-dcf7-45d4-a490-2cf9018c9ba5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:51.448749 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729275f2-dcf7-45d4-a490-2cf9018c9ba5 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:51.461945 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 616/1236] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:51.467666 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee85ef-8202-4f03-83e9-7326c6da1a74 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:51.477320 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee85ef-8202-4f03-83e9-7326c6da1a74 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:51.481788 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c6093-2da3-471e-9429-b99ae5b7164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:51.482582 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c6093-2da3-471e-9429-b99ae5b7164f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:51.482853 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c6093-2da3-471e-9429-b99ae5b7164f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:51.483115 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c6093-2da3-471e-9429-b99ae5b7164f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:51.490389 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c6093-2da3-471e-9429-b99ae5b7164f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:51.492393 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c6093-2da3-471e-9429-b99ae5b7164f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:51.506108 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-079c6093-2da3-471e-9429-b99ae5b7164f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 10 17:40:51.507262 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 621/1237] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:40:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:40:51.513405 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729275f2-dcf7-45d4-a490-2cf9018c9ba5 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:51.523520 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729275f2-dcf7-45d4-a490-2cf9018c9ba5 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:51.528716 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373d8d7-50a3-4be4-a8a7-8487cd84c31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:51.529412 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373d8d7-50a3-4be4-a8a7-8487cd84c31b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:51.529690 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373d8d7-50a3-4be4-a8a7-8487cd84c31b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:51.529960 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373d8d7-50a3-4be4-a8a7-8487cd84c31b admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:51.530813 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373d8d7-50a3-4be4-a8a7-8487cd84c31b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:51.531170 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373d8d7-50a3-4be4-a8a7-8487cd84c31b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:51.533045 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373d8d7-50a3-4be4-a8a7-8487cd84c31b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:51.550338 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 617/1238] 10.222.0.31 () {56 vars in 1164 bytes} [Mon Jan 10 17:40:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:51.556028 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c6093-2da3-471e-9429-b99ae5b7164f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:51.565746 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c6093-2da3-471e-9429-b99ae5b7164f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:51.570188 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2679e-d4f9-4223-ba7a-a1ed57a30df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:51.570814 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2679e-d4f9-4223-ba7a-a1ed57a30df7 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:51.571090 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2679e-d4f9-4223-ba7a-a1ed57a30df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:51.571355 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2679e-d4f9-4223-ba7a-a1ed57a30df7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:51.579068 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2679e-d4f9-4223-ba7a-a1ed57a30df7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:51.580801 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2679e-d4f9-4223-ba7a-a1ed57a30df7 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:51.589349 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 622/1239] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:40:51 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:40:51.595496 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373d8d7-50a3-4be4-a8a7-8487cd84c31b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:51.607430 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373d8d7-50a3-4be4-a8a7-8487cd84c31b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:51.613381 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93748162-a21f-48e6-84cb-3295653fc97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:51.614314 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93748162-a21f-48e6-84cb-3295653fc97a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:51.614661 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93748162-a21f-48e6-84cb-3295653fc97a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:51.615052 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93748162-a21f-48e6-84cb-3295653fc97a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:51.627097 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93748162-a21f-48e6-84cb-3295653fc97a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:51.629328 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93748162-a21f-48e6-84cb-3295653fc97a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:51.645952 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-93748162-a21f-48e6-84cb-3295653fc97a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:40:51.647143 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 618/1240] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:40:51.653582 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2679e-d4f9-4223-ba7a-a1ed57a30df7 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:51.662814 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2679e-d4f9-4223-ba7a-a1ed57a30df7 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:51.667617 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3b92b-cfb5-4b5e-9910-68bec8c91ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:51.668272 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3b92b-cfb5-4b5e-9910-68bec8c91ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:51.668546 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3b92b-cfb5-4b5e-9910-68bec8c91ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:51.668816 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3b92b-cfb5-4b5e-9910-68bec8c91ba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:51.669582 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3b92b-cfb5-4b5e-9910-68bec8c91ba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:51.669882 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3b92b-cfb5-4b5e-9910-68bec8c91ba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:51.671501 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3b92b-cfb5-4b5e-9910-68bec8c91ba3 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:51.682894 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 623/1241] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:40:51.688491 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93748162-a21f-48e6-84cb-3295653fc97a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:51.698074 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93748162-a21f-48e6-84cb-3295653fc97a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:51.702650 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c9fc8-02f3-4ef6-9ae9-fd8a4758b25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:51.703485 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c9fc8-02f3-4ef6-9ae9-fd8a4758b25e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:51.703766 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c9fc8-02f3-4ef6-9ae9-fd8a4758b25e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:51.704038 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c9fc8-02f3-4ef6-9ae9-fd8a4758b25e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:51.710999 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c9fc8-02f3-4ef6-9ae9-fd8a4758b25e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:51.713274 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c9fc8-02f3-4ef6-9ae9-fd8a4758b25e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:51.727355 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-748c9fc8-02f3-4ef6-9ae9-fd8a4758b25e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:40:51.728695 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 619/1242] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:40:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:40:51.734671 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3b92b-cfb5-4b5e-9910-68bec8c91ba3 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:51.746598 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3b92b-cfb5-4b5e-9910-68bec8c91ba3 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:51.753058 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39cd24-a997-49e5-812e-ba454aa22959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:51.753786 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39cd24-a997-49e5-812e-ba454aa22959 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:51.754174 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39cd24-a997-49e5-812e-ba454aa22959 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:51.754457 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39cd24-a997-49e5-812e-ba454aa22959 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:51.755285 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39cd24-a997-49e5-812e-ba454aa22959 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:51.755658 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39cd24-a997-49e5-812e-ba454aa22959 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:51.757730 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39cd24-a997-49e5-812e-ba454aa22959 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:51.771853 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 624/1243] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:40:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:40:51.778375 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c9fc8-02f3-4ef6-9ae9-fd8a4758b25e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:51.789888 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c9fc8-02f3-4ef6-9ae9-fd8a4758b25e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:51.794718 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632c99f-2f8c-4c0a-a1d2-866f81bd0b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:51.795422 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632c99f-2f8c-4c0a-a1d2-866f81bd0b98 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:51.795724 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632c99f-2f8c-4c0a-a1d2-866f81bd0b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:51.795998 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632c99f-2f8c-4c0a-a1d2-866f81bd0b98 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:51.797003 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632c99f-2f8c-4c0a-a1d2-866f81bd0b98 admin admin] RBAC: Adding query filter params (role.id=67bb9b9aab104609b23a2ab5e7d31142, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=3a3b8e620cfd42fe993c73dc83a246be) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:51.797312 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632c99f-2f8c-4c0a-a1d2-866f81bd0b98 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:51.799244 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632c99f-2f8c-4c0a-a1d2-866f81bd0b98 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:51.805311 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 620/1244] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:40:51 2022] GET /identity/v3/role_assignments?user.id=3a3b8e620cfd42fe993c73dc83a246be&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=67bb9b9aab104609b23a2ab5e7d31142 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:54.315831 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c4151-dbc8-417f-832a-0062b1917f2f None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:54.316440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c4151-dbc8-417f-832a-0062b1917f2f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:54.316440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c4151-dbc8-417f-832a-0062b1917f2f None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:54.318450 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 625/1245] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:40:54.325089 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14335022-89df-4e43-83cf-1fd060ffd69b None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:54.325677 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14335022-89df-4e43-83cf-1fd060ffd69b None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:54.325677 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14335022-89df-4e43-83cf-1fd060ffd69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:54.344966 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-14335022-89df-4e43-83cf-1fd060ffd69b None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:40:54.346193 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-14335022-89df-4e43-83cf-1fd060ffd69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:40:54.354842 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 621/1246] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:40:54 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:40:54.380632 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c4151-dbc8-417f-832a-0062b1917f2f None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:54.394192 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c4151-dbc8-417f-832a-0062b1917f2f None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:54.400692 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3c595-dd23-4229-8be0-04e93323ef83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:54.401905 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3c595-dd23-4229-8be0-04e93323ef83 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:54.402188 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3c595-dd23-4229-8be0-04e93323ef83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:54.402463 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3c595-dd23-4229-8be0-04e93323ef83 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:54.416144 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3c595-dd23-4229-8be0-04e93323ef83 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:40:54.425031 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-bbd3c595-dd23-4229-8be0-04e93323ef83 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:40:54.426360 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 626/1247] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:40:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:40:54.432520 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14335022-89df-4e43-83cf-1fd060ffd69b None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:54.441874 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14335022-89df-4e43-83cf-1fd060ffd69b None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:54.447182 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a237ad7-7f1e-4f6b-aa73-76379ac04ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:54.447851 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a237ad7-7f1e-4f6b-aa73-76379ac04ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:54.448117 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a237ad7-7f1e-4f6b-aa73-76379ac04ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:54.448384 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a237ad7-7f1e-4f6b-aa73-76379ac04ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:54.449175 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a237ad7-7f1e-4f6b-aa73-76379ac04ae7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:54.449473 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a237ad7-7f1e-4f6b-aa73-76379ac04ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:54.451067 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a237ad7-7f1e-4f6b-aa73-76379ac04ae7 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:54.460416 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 622/1248] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:40:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:54.466614 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3c595-dd23-4229-8be0-04e93323ef83 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:54.478564 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3c595-dd23-4229-8be0-04e93323ef83 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:54.484114 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f120348-46f5-48ce-8b18-e6cf25ccae2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:54.484944 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f120348-46f5-48ce-8b18-e6cf25ccae2f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:54.486321 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f120348-46f5-48ce-8b18-e6cf25ccae2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:54.486321 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f120348-46f5-48ce-8b18-e6cf25ccae2f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:54.496030 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f120348-46f5-48ce-8b18-e6cf25ccae2f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:54.497894 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f120348-46f5-48ce-8b18-e6cf25ccae2f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:54.518480 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-9f120348-46f5-48ce-8b18-e6cf25ccae2f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:40:54.520002 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 627/1249] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:40:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:40:54.526334 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a237ad7-7f1e-4f6b-aa73-76379ac04ae7 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:54.536051 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a237ad7-7f1e-4f6b-aa73-76379ac04ae7 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:54.541125 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d376c07-da56-4560-b5a0-afc60069adab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:54.541817 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d376c07-da56-4560-b5a0-afc60069adab admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:54.542084 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d376c07-da56-4560-b5a0-afc60069adab admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:54.542364 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d376c07-da56-4560-b5a0-afc60069adab admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:54.543152 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d376c07-da56-4560-b5a0-afc60069adab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:54.543450 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d376c07-da56-4560-b5a0-afc60069adab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:54.545152 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d376c07-da56-4560-b5a0-afc60069adab admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:54.558120 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 623/1250] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:54.564255 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f120348-46f5-48ce-8b18-e6cf25ccae2f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:54.574293 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f120348-46f5-48ce-8b18-e6cf25ccae2f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:54.579761 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d85be-99d2-4214-818b-20bbd88c4929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:54.580642 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d85be-99d2-4214-818b-20bbd88c4929 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:54.581017 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d85be-99d2-4214-818b-20bbd88c4929 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:54.581225 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d85be-99d2-4214-818b-20bbd88c4929 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:54.589012 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d85be-99d2-4214-818b-20bbd88c4929 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:54.591014 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d85be-99d2-4214-818b-20bbd88c4929 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:54.604549 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-5a5d85be-99d2-4214-818b-20bbd88c4929 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 10 17:40:54.605768 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 628/1251] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:40:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:40:54.611780 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d376c07-da56-4560-b5a0-afc60069adab admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:54.622549 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d376c07-da56-4560-b5a0-afc60069adab admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:54.628388 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf4327-b2d3-4168-a598-5aade4327dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:54.629171 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf4327-b2d3-4168-a598-5aade4327dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:54.629521 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf4327-b2d3-4168-a598-5aade4327dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:54.630014 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf4327-b2d3-4168-a598-5aade4327dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:54.630977 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf4327-b2d3-4168-a598-5aade4327dc3 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:54.631293 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf4327-b2d3-4168-a598-5aade4327dc3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:54.633859 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf4327-b2d3-4168-a598-5aade4327dc3 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:54.653544 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 624/1252] 10.222.0.31 () {56 vars in 1164 bytes} [Mon Jan 10 17:40:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:54.660318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d85be-99d2-4214-818b-20bbd88c4929 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:54.675307 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d85be-99d2-4214-818b-20bbd88c4929 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:54.681093 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122626fa-33cf-49ba-9857-3a05bd91240a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:54.681743 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122626fa-33cf-49ba-9857-3a05bd91240a admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:54.682029 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122626fa-33cf-49ba-9857-3a05bd91240a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:54.682305 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122626fa-33cf-49ba-9857-3a05bd91240a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:54.691933 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122626fa-33cf-49ba-9857-3a05bd91240a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:54.694148 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122626fa-33cf-49ba-9857-3a05bd91240a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:54.705597 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 629/1253] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:40:54 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:40:54.711595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf4327-b2d3-4168-a598-5aade4327dc3 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:54.724065 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf4327-b2d3-4168-a598-5aade4327dc3 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:54.729620 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88fa59-6eb9-4b58-8250-a2a6f06d3e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:54.730446 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88fa59-6eb9-4b58-8250-a2a6f06d3e39 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:54.730725 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88fa59-6eb9-4b58-8250-a2a6f06d3e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:54.730995 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88fa59-6eb9-4b58-8250-a2a6f06d3e39 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:54.744121 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88fa59-6eb9-4b58-8250-a2a6f06d3e39 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:54.746071 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88fa59-6eb9-4b58-8250-a2a6f06d3e39 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:54.762883 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-be88fa59-6eb9-4b58-8250-a2a6f06d3e39 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:40:54.764118 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 625/1254] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:40:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:40:54.769997 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122626fa-33cf-49ba-9857-3a05bd91240a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:54.780200 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122626fa-33cf-49ba-9857-3a05bd91240a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:54.785213 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f34e6-14c1-47c2-908f-746711c9bb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:54.785862 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f34e6-14c1-47c2-908f-746711c9bb4c admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:54.786156 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f34e6-14c1-47c2-908f-746711c9bb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:54.786428 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f34e6-14c1-47c2-908f-746711c9bb4c admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:54.787154 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f34e6-14c1-47c2-908f-746711c9bb4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:54.787452 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f34e6-14c1-47c2-908f-746711c9bb4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:54.789056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f34e6-14c1-47c2-908f-746711c9bb4c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:54.807484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 630/1255] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:40:54.808809 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88fa59-6eb9-4b58-8250-a2a6f06d3e39 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:54.821221 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88fa59-6eb9-4b58-8250-a2a6f06d3e39 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:54.826120 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd4653-f8b8-49f8-b3cf-9e7ad764974e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:54.826881 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd4653-f8b8-49f8-b3cf-9e7ad764974e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:54.827163 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd4653-f8b8-49f8-b3cf-9e7ad764974e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:54.827425 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd4653-f8b8-49f8-b3cf-9e7ad764974e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:54.834517 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd4653-f8b8-49f8-b3cf-9e7ad764974e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:54.836486 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd4653-f8b8-49f8-b3cf-9e7ad764974e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:54.850095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-f3fd4653-f8b8-49f8-b3cf-9e7ad764974e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:40:54.851343 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 626/1256] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:40:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:40:54.857545 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f34e6-14c1-47c2-908f-746711c9bb4c admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:54.868414 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f34e6-14c1-47c2-908f-746711c9bb4c admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:54.873400 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c6e73-9422-4767-9a63-c65d2b451726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:54.874121 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c6e73-9422-4767-9a63-c65d2b451726 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:54.874449 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c6e73-9422-4767-9a63-c65d2b451726 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:54.874812 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c6e73-9422-4767-9a63-c65d2b451726 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:54.875664 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c6e73-9422-4767-9a63-c65d2b451726 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:54.876049 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c6e73-9422-4767-9a63-c65d2b451726 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:54.878081 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c6e73-9422-4767-9a63-c65d2b451726 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:54.891689 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 631/1257] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:40:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:54.898039 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd4653-f8b8-49f8-b3cf-9e7ad764974e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:54.909554 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd4653-f8b8-49f8-b3cf-9e7ad764974e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:54.914324 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807cdbb-0d5d-483a-af9e-2f307d3c86ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:54.915029 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807cdbb-0d5d-483a-af9e-2f307d3c86ff admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:54.915325 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807cdbb-0d5d-483a-af9e-2f307d3c86ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:54.915706 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807cdbb-0d5d-483a-af9e-2f307d3c86ff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:54.916578 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807cdbb-0d5d-483a-af9e-2f307d3c86ff admin admin] RBAC: Adding query filter params (role.id=3c05bedf79e04eb38d2ae66736030bfe, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=3a3b8e620cfd42fe993c73dc83a246be) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:54.916994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807cdbb-0d5d-483a-af9e-2f307d3c86ff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:54.918991 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807cdbb-0d5d-483a-af9e-2f307d3c86ff admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:54.925392 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 627/1258] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:40:54 2022] GET /identity/v3/role_assignments?user.id=3a3b8e620cfd42fe993c73dc83a246be&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=3c05bedf79e04eb38d2ae66736030bfe => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:40:57.454971 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22100485-cb92-4e39-ba31-b11c1fa83378 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:57.455625 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22100485-cb92-4e39-ba31-b11c1fa83378 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:57.455625 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22100485-cb92-4e39-ba31-b11c1fa83378 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:57.457354 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 632/1259] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:40:57.463601 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba9ab4-a627-4b1f-9a19-37e6fbe8d21c None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:57.464139 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba9ab4-a627-4b1f-9a19-37e6fbe8d21c None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:57.464249 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba9ab4-a627-4b1f-9a19-37e6fbe8d21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:57.482651 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-0aba9ab4-a627-4b1f-9a19-37e6fbe8d21c None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:40:57.483858 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-0aba9ab4-a627-4b1f-9a19-37e6fbe8d21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:40:57.492231 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 628/1260] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:40:57 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:40:57.520956 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22100485-cb92-4e39-ba31-b11c1fa83378 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:57.536572 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22100485-cb92-4e39-ba31-b11c1fa83378 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:57.541952 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d6779-12b7-42e3-b59c-de2aedd427e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:57.542781 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d6779-12b7-42e3-b59c-de2aedd427e9 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:57.543063 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d6779-12b7-42e3-b59c-de2aedd427e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:57.543333 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d6779-12b7-42e3-b59c-de2aedd427e9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:57.555096 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d6779-12b7-42e3-b59c-de2aedd427e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:40:57.562450 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-5a8d6779-12b7-42e3-b59c-de2aedd427e9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:40:57.564160 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 633/1261] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:40:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:40:57.570759 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba9ab4-a627-4b1f-9a19-37e6fbe8d21c None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:57.580381 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba9ab4-a627-4b1f-9a19-37e6fbe8d21c None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:57.585953 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979ef22-2352-4469-884f-3ec2f7e45eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:57.586619 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979ef22-2352-4469-884f-3ec2f7e45eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:57.586897 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979ef22-2352-4469-884f-3ec2f7e45eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:57.587271 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979ef22-2352-4469-884f-3ec2f7e45eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:57.588075 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979ef22-2352-4469-884f-3ec2f7e45eb7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:57.588378 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979ef22-2352-4469-884f-3ec2f7e45eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:57.590005 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979ef22-2352-4469-884f-3ec2f7e45eb7 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:57.598920 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 629/1262] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:40:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:57.605493 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d6779-12b7-42e3-b59c-de2aedd427e9 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:57.617833 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d6779-12b7-42e3-b59c-de2aedd427e9 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:57.622515 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73cdbc-2744-47ca-960d-457d2d0a7aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:57.623292 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73cdbc-2744-47ca-960d-457d2d0a7aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:57.623569 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73cdbc-2744-47ca-960d-457d2d0a7aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:57.623832 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73cdbc-2744-47ca-960d-457d2d0a7aa7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:57.635440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73cdbc-2744-47ca-960d-457d2d0a7aa7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:57.637857 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73cdbc-2744-47ca-960d-457d2d0a7aa7 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:57.658874 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-bd73cdbc-2744-47ca-960d-457d2d0a7aa7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:40:57.660407 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 634/1263] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:40:57.667125 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979ef22-2352-4469-884f-3ec2f7e45eb7 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:57.680056 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979ef22-2352-4469-884f-3ec2f7e45eb7 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:57.686233 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e577490-c0f1-4d85-af8b-760a33c2362f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:57.686998 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e577490-c0f1-4d85-af8b-760a33c2362f admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:57.687416 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e577490-c0f1-4d85-af8b-760a33c2362f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:57.687718 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e577490-c0f1-4d85-af8b-760a33c2362f admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:57.688568 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e577490-c0f1-4d85-af8b-760a33c2362f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:57.688998 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e577490-c0f1-4d85-af8b-760a33c2362f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:57.690941 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e577490-c0f1-4d85-af8b-760a33c2362f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:57.705374 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 630/1264] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:57.712004 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73cdbc-2744-47ca-960d-457d2d0a7aa7 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:57.724509 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73cdbc-2744-47ca-960d-457d2d0a7aa7 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:57.731844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97055159-a31b-4aec-9b23-d728770e06eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:57.731844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97055159-a31b-4aec-9b23-d728770e06eb admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:57.731844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97055159-a31b-4aec-9b23-d728770e06eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:57.731844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97055159-a31b-4aec-9b23-d728770e06eb admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:57.740958 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97055159-a31b-4aec-9b23-d728770e06eb admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:57.742968 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97055159-a31b-4aec-9b23-d728770e06eb admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:57.757229 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-97055159-a31b-4aec-9b23-d728770e06eb admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 10 17:40:57.758597 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 635/1265] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:40:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:40:57.764412 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e577490-c0f1-4d85-af8b-760a33c2362f admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:57.775454 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e577490-c0f1-4d85-af8b-760a33c2362f admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:57.780711 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a159cac-fd9b-4631-a602-d3f5d07cf1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:57.781435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a159cac-fd9b-4631-a602-d3f5d07cf1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:57.781815 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a159cac-fd9b-4631-a602-d3f5d07cf1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:57.781962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a159cac-fd9b-4631-a602-d3f5d07cf1d9 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:57.782814 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a159cac-fd9b-4631-a602-d3f5d07cf1d9 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:57.783143 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a159cac-fd9b-4631-a602-d3f5d07cf1d9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:57.785056 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a159cac-fd9b-4631-a602-d3f5d07cf1d9 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:57.803350 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 631/1266] 10.222.0.31 () {56 vars in 1164 bytes} [Mon Jan 10 17:40:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:57.809403 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97055159-a31b-4aec-9b23-d728770e06eb admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:57.818988 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97055159-a31b-4aec-9b23-d728770e06eb admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:57.824094 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810844f-5928-4886-adcd-cdc0c9810af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:57.824993 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810844f-5928-4886-adcd-cdc0c9810af4 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:57.825231 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810844f-5928-4886-adcd-cdc0c9810af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:57.825530 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810844f-5928-4886-adcd-cdc0c9810af4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:57.837051 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810844f-5928-4886-adcd-cdc0c9810af4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:57.839045 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810844f-5928-4886-adcd-cdc0c9810af4 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:57.856720 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-8810844f-5928-4886-adcd-cdc0c9810af4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:40:57.858135 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 636/1267] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:40:57.864084 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a159cac-fd9b-4631-a602-d3f5d07cf1d9 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:57.874348 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a159cac-fd9b-4631-a602-d3f5d07cf1d9 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:57.879142 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75285f0-a724-4419-a77c-a1726518abbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:57.879846 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75285f0-a724-4419-a77c-a1726518abbb admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:57.880136 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75285f0-a724-4419-a77c-a1726518abbb admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:57.880409 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75285f0-a724-4419-a77c-a1726518abbb admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:57.881233 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75285f0-a724-4419-a77c-a1726518abbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:57.881567 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75285f0-a724-4419-a77c-a1726518abbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:57.883193 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75285f0-a724-4419-a77c-a1726518abbb admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:57.896447 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 632/1268] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:57.904258 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810844f-5928-4886-adcd-cdc0c9810af4 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:57.917423 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810844f-5928-4886-adcd-cdc0c9810af4 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:57.924259 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd60e9-38b4-4a40-bccf-e2f88bafc8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:57.925149 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd60e9-38b4-4a40-bccf-e2f88bafc8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:57.925450 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd60e9-38b4-4a40-bccf-e2f88bafc8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:57.925732 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd60e9-38b4-4a40-bccf-e2f88bafc8a2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:57.933847 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd60e9-38b4-4a40-bccf-e2f88bafc8a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:57.936167 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd60e9-38b4-4a40-bccf-e2f88bafc8a2 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:57.949555 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-0dfd60e9-38b4-4a40-bccf-e2f88bafc8a2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:40:57.950836 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 637/1269] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:40:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:40:57.957442 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75285f0-a724-4419-a77c-a1726518abbb admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:57.967604 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75285f0-a724-4419-a77c-a1726518abbb admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:57.972387 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee8d20-b45c-4769-9561-3564ef2c6406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:57.973102 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee8d20-b45c-4769-9561-3564ef2c6406 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:57.973382 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee8d20-b45c-4769-9561-3564ef2c6406 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:57.973652 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee8d20-b45c-4769-9561-3564ef2c6406 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:57.974470 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee8d20-b45c-4769-9561-3564ef2c6406 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:40:57.974776 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee8d20-b45c-4769-9561-3564ef2c6406 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:57.976653 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee8d20-b45c-4769-9561-3564ef2c6406 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:57.989933 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 633/1270] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:40:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:40:57.996288 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd60e9-38b4-4a40-bccf-e2f88bafc8a2 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:40:58.007413 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd60e9-38b4-4a40-bccf-e2f88bafc8a2 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:40:58.012298 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7ecf8-8742-4794-88bf-fea32934e0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:40:58.013246 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7ecf8-8742-4794-88bf-fea32934e0a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:40:58.013524 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7ecf8-8742-4794-88bf-fea32934e0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:40:58.013801 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7ecf8-8742-4794-88bf-fea32934e0a1 admin admin] PATH_INFO: `/v3/projects/1415eea0335a49bf800e8215498af679/users/3a3b8e620cfd42fe993c73dc83a246be/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:40:58.015981 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7ecf8-8742-4794-88bf-fea32934e0a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1415eea0335a49bf800e8215498af679, user_id=3a3b8e620cfd42fe993c73dc83a246be, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:40:58.018695 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7ecf8-8742-4794-88bf-fea32934e0a1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:40:58.035133 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 638/1271] 10.222.0.31 () {58 vars in 1460 bytes} [Mon Jan 10 17:40:57 2022] PUT /identity/v3/projects/1415eea0335a49bf800e8215498af679/users/3a3b8e620cfd42fe993c73dc83a246be/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:41:00.459910 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed7bcc-a6cf-4d34-a5be-473806bfa781 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:00.460496 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed7bcc-a6cf-4d34-a5be-473806bfa781 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:00.460496 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed7bcc-a6cf-4d34-a5be-473806bfa781 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:00.463338 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 634/1272] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:41:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:41:00.470879 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242bfbf-27a6-4c3d-b062-fb1909cf2054 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:00.471316 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242bfbf-27a6-4c3d-b062-fb1909cf2054 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:00.471424 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242bfbf-27a6-4c3d-b062-fb1909cf2054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:00.490466 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-5242bfbf-27a6-4c3d-b062-fb1909cf2054 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:41:00.491631 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-5242bfbf-27a6-4c3d-b062-fb1909cf2054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:41:00.547701 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 639/1273] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:41:00 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:41:00.578835 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed7bcc-a6cf-4d34-a5be-473806bfa781 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:00.593371 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed7bcc-a6cf-4d34-a5be-473806bfa781 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:00.599039 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978745a1-c126-4deb-8223-6fbc569f5b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:00.599824 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978745a1-c126-4deb-8223-6fbc569f5b0f admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:00.600108 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978745a1-c126-4deb-8223-6fbc569f5b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:00.600378 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978745a1-c126-4deb-8223-6fbc569f5b0f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:00.611569 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978745a1-c126-4deb-8223-6fbc569f5b0f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 17:41:00.619187 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-978745a1-c126-4deb-8223-6fbc569f5b0f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 17:41:00.620341 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 635/1274] 10.222.0.31 () {56 vars in 1117 bytes} [Mon Jan 10 17:41:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:41:00.626628 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242bfbf-27a6-4c3d-b062-fb1909cf2054 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:00.636566 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242bfbf-27a6-4c3d-b062-fb1909cf2054 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:00.642486 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e045d8-ebd0-4c56-8524-16b310ccf0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:00.643144 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e045d8-ebd0-4c56-8524-16b310ccf0fd admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:00.643423 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e045d8-ebd0-4c56-8524-16b310ccf0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:00.643692 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e045d8-ebd0-4c56-8524-16b310ccf0fd admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:00.644453 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e045d8-ebd0-4c56-8524-16b310ccf0fd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:41:00.644754 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e045d8-ebd0-4c56-8524-16b310ccf0fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:00.646383 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e045d8-ebd0-4c56-8524-16b310ccf0fd admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:00.656107 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 640/1275] 10.222.0.31 () {56 vars in 1120 bytes} [Mon Jan 10 17:41:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:41:00.661659 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978745a1-c126-4deb-8223-6fbc569f5b0f admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:00.672046 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978745a1-c126-4deb-8223-6fbc569f5b0f admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:00.677001 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407db6cf-234f-4f14-ba6a-472f0acbcd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:00.677752 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407db6cf-234f-4f14-ba6a-472f0acbcd43 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:00.678082 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407db6cf-234f-4f14-ba6a-472f0acbcd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:00.678358 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407db6cf-234f-4f14-ba6a-472f0acbcd43 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:00.688733 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407db6cf-234f-4f14-ba6a-472f0acbcd43 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:00.690602 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407db6cf-234f-4f14-ba6a-472f0acbcd43 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:00.707162 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-407db6cf-234f-4f14-ba6a-472f0acbcd43 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:41:00.708442 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 636/1276] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:41:00.714016 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e045d8-ebd0-4c56-8524-16b310ccf0fd admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:00.724728 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e045d8-ebd0-4c56-8524-16b310ccf0fd admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:00.730546 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d232b0-530a-4d1d-9e44-53e193584074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:00.731197 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d232b0-530a-4d1d-9e44-53e193584074 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:00.731480 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d232b0-530a-4d1d-9e44-53e193584074 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:00.731749 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d232b0-530a-4d1d-9e44-53e193584074 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:00.732479 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d232b0-530a-4d1d-9e44-53e193584074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:41:00.732782 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d232b0-530a-4d1d-9e44-53e193584074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:00.734455 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d232b0-530a-4d1d-9e44-53e193584074 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:00.752137 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 641/1277] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:41:00.757239 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407db6cf-234f-4f14-ba6a-472f0acbcd43 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:00.767005 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407db6cf-234f-4f14-ba6a-472f0acbcd43 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:00.771764 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0d249-8a13-45a6-b55e-a7944f07c80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:00.772548 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0d249-8a13-45a6-b55e-a7944f07c80b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:00.772827 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0d249-8a13-45a6-b55e-a7944f07c80b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:00.773121 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0d249-8a13-45a6-b55e-a7944f07c80b admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:00.780560 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0d249-8a13-45a6-b55e-a7944f07c80b admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:00.782655 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0d249-8a13-45a6-b55e-a7944f07c80b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:00.796037 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-93d0d249-8a13-45a6-b55e-a7944f07c80b admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 10 17:41:00.797222 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 637/1278] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:41:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 17:41:00.802728 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d232b0-530a-4d1d-9e44-53e193584074 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:00.812197 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d232b0-530a-4d1d-9e44-53e193584074 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:00.817691 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a266683-2510-4a10-80a9-014ee9b12b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:00.818342 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a266683-2510-4a10-80a9-014ee9b12b73 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:00.818619 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a266683-2510-4a10-80a9-014ee9b12b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:00.818883 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a266683-2510-4a10-80a9-014ee9b12b73 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:00.819724 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a266683-2510-4a10-80a9-014ee9b12b73 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:41:00.820031 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a266683-2510-4a10-80a9-014ee9b12b73 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:00.821919 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a266683-2510-4a10-80a9-014ee9b12b73 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:00.839303 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 642/1279] 10.222.0.31 () {56 vars in 1164 bytes} [Mon Jan 10 17:41:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:41:00.844884 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0d249-8a13-45a6-b55e-a7944f07c80b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:00.854647 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0d249-8a13-45a6-b55e-a7944f07c80b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:00.860038 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8f13f-b003-47d5-8b68-e9253d2ccef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:00.860654 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8f13f-b003-47d5-8b68-e9253d2ccef0 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:00.860967 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8f13f-b003-47d5-8b68-e9253d2ccef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:00.861245 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8f13f-b003-47d5-8b68-e9253d2ccef0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:00.869171 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8f13f-b003-47d5-8b68-e9253d2ccef0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:00.870882 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8f13f-b003-47d5-8b68-e9253d2ccef0 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:00.879635 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 638/1280] 10.222.0.31 () {58 vars in 1324 bytes} [Mon Jan 10 17:41:00 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:41:00.885036 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a266683-2510-4a10-80a9-014ee9b12b73 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:00.894792 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a266683-2510-4a10-80a9-014ee9b12b73 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:00.900828 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a290ce-c940-4681-b66d-6c7c43d303d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:00.901622 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a290ce-c940-4681-b66d-6c7c43d303d0 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:00.901898 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a290ce-c940-4681-b66d-6c7c43d303d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:00.902176 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a290ce-c940-4681-b66d-6c7c43d303d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:00.913122 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a290ce-c940-4681-b66d-6c7c43d303d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:00.914916 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a290ce-c940-4681-b66d-6c7c43d303d0 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:00.931348 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-50a290ce-c940-4681-b66d-6c7c43d303d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 17:41:00.932640 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 643/1281] 10.222.0.31 () {56 vars in 1129 bytes} [Mon Jan 10 17:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:41:00.938065 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8f13f-b003-47d5-8b68-e9253d2ccef0 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:00.946801 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8f13f-b003-47d5-8b68-e9253d2ccef0 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:00.952630 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cd214-7c2b-4fbd-ad59-a1a2a2033874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:00.953383 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cd214-7c2b-4fbd-ad59-a1a2a2033874 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:00.953663 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cd214-7c2b-4fbd-ad59-a1a2a2033874 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:00.953934 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cd214-7c2b-4fbd-ad59-a1a2a2033874 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:00.954664 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cd214-7c2b-4fbd-ad59-a1a2a2033874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:41:00.954962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cd214-7c2b-4fbd-ad59-a1a2a2033874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:00.956523 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cd214-7c2b-4fbd-ad59-a1a2a2033874 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:00.968268 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 639/1282] 10.222.0.31 () {56 vars in 1130 bytes} [Mon Jan 10 17:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:41:00.973565 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a290ce-c940-4681-b66d-6c7c43d303d0 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:00.983538 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a290ce-c940-4681-b66d-6c7c43d303d0 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:00.989646 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead66d72-96f2-4b0f-b311-aafbf4e061a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:00.990391 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead66d72-96f2-4b0f-b311-aafbf4e061a4 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:00.990670 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead66d72-96f2-4b0f-b311-aafbf4e061a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:00.990942 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead66d72-96f2-4b0f-b311-aafbf4e061a4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:00.998319 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead66d72-96f2-4b0f-b311-aafbf4e061a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:01.000286 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead66d72-96f2-4b0f-b311-aafbf4e061a4 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:01.013495 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING keystone.server.flask.application [None req-ead66d72-96f2-4b0f-b311-aafbf4e061a4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 17:41:01.014591 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 644/1283] 10.222.0.31 () {56 vars in 1132 bytes} [Mon Jan 10 17:41:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:41:01.020090 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cd214-7c2b-4fbd-ad59-a1a2a2033874 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:01.029797 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cd214-7c2b-4fbd-ad59-a1a2a2033874 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:01.034943 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f4517-19be-4982-a4f9-5b6fc9135d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:01.035563 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f4517-19be-4982-a4f9-5b6fc9135d57 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:01.035844 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f4517-19be-4982-a4f9-5b6fc9135d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:01.036118 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f4517-19be-4982-a4f9-5b6fc9135d57 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:01.036909 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f4517-19be-4982-a4f9-5b6fc9135d57 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:41:01.037237 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f4517-19be-4982-a4f9-5b6fc9135d57 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:01.039055 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f4517-19be-4982-a4f9-5b6fc9135d57 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:01.050784 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 640/1284] 10.222.0.31 () {56 vars in 1169 bytes} [Mon Jan 10 17:41:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:41:01.056361 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead66d72-96f2-4b0f-b311-aafbf4e061a4 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:01.066306 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead66d72-96f2-4b0f-b311-aafbf4e061a4 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:01.072071 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b714b7c-baac-4f16-868c-1eb9708581aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:01.072672 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b714b7c-baac-4f16-868c-1eb9708581aa admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:01.072976 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b714b7c-baac-4f16-868c-1eb9708581aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:01.073248 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b714b7c-baac-4f16-868c-1eb9708581aa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:01.074077 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b714b7c-baac-4f16-868c-1eb9708581aa admin admin] RBAC: Adding query filter params (role.id=3c05bedf79e04eb38d2ae66736030bfe, scope.project.id=1415eea0335a49bf800e8215498af679, user.id=3a3b8e620cfd42fe993c73dc83a246be) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:41:01.074379 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b714b7c-baac-4f16-868c-1eb9708581aa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:01.076177 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b714b7c-baac-4f16-868c-1eb9708581aa admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:01.082172 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 645/1285] 10.222.0.31 () {56 vars in 1395 bytes} [Mon Jan 10 17:41:01 2022] GET /identity/v3/role_assignments?user.id=3a3b8e620cfd42fe993c73dc83a246be&scope.project.id=1415eea0335a49bf800e8215498af679&role.id=3c05bedf79e04eb38d2ae66736030bfe => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:41:03.428380 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348758ac-4a31-4936-84e5-675b971cf623 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:03.429326 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348758ac-4a31-4936-84e5-675b971cf623 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:03.429420 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348758ac-4a31-4936-84e5-675b971cf623 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:03.432199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 641/1286] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:41:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:41:03.439626 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3287c04-7fdd-486f-98f1-2a363322e4d5 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:03.440086 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3287c04-7fdd-486f-98f1-2a363322e4d5 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:03.440185 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3287c04-7fdd-486f-98f1-2a363322e4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:03.469161 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-f3287c04-7fdd-486f-98f1-2a363322e4d5 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:41:03.470353 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f3287c04-7fdd-486f-98f1-2a363322e4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:41:03.479256 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 646/1287] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:41:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:41:03.510164 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348758ac-4a31-4936-84e5-675b971cf623 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:03.525553 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348758ac-4a31-4936-84e5-675b971cf623 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:03.531328 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e0805-8030-47d6-870e-945cfdfdf582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:03.532109 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e0805-8030-47d6-870e-945cfdfdf582 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:03.532394 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e0805-8030-47d6-870e-945cfdfdf582 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:03.532662 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e0805-8030-47d6-870e-945cfdfdf582 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:03.533353 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e0805-8030-47d6-870e-945cfdfdf582 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:03.534953 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e0805-8030-47d6-870e-945cfdfdf582 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:03.546341 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-2f1e0805-8030-47d6-870e-945cfdfdf582 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 10 17:41:03.547725 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 642/1288] 10.222.0.31 () {56 vars in 1138 bytes} [Mon Jan 10 17:41:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:41:03.553904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3287c04-7fdd-486f-98f1-2a363322e4d5 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:03.566251 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3287c04-7fdd-486f-98f1-2a363322e4d5 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:03.572197 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401982af-6039-4e69-9c8d-8a2f93937dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:03.572844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401982af-6039-4e69-9c8d-8a2f93937dfe admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:03.573157 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401982af-6039-4e69-9c8d-8a2f93937dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:03.573427 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401982af-6039-4e69-9c8d-8a2f93937dfe admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:03.574148 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401982af-6039-4e69-9c8d-8a2f93937dfe admin admin] RBAC: Adding query filter params (name=placement) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:41:03.574452 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401982af-6039-4e69-9c8d-8a2f93937dfe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:03.576034 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401982af-6039-4e69-9c8d-8a2f93937dfe admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:03.581253 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 647/1289] 10.222.0.31 () {56 vars in 1137 bytes} [Mon Jan 10 17:41:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:41:03.586689 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e0805-8030-47d6-870e-945cfdfdf582 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:03.596656 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e0805-8030-47d6-870e-945cfdfdf582 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:03.602746 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e898999-2c3f-4361-9574-ef9473905b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:03.603373 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e898999-2c3f-4361-9574-ef9473905b03 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:03.603647 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e898999-2c3f-4361-9574-ef9473905b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:03.603914 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e898999-2c3f-4361-9574-ef9473905b03 admin admin] PATH_INFO: `/v3/services` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:03.604621 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e898999-2c3f-4361-9574-ef9473905b03 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:41:03.604959 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e898999-2c3f-4361-9574-ef9473905b03 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:03.606497 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e898999-2c3f-4361-9574-ef9473905b03 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:03.611297 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 643/1290] 10.222.0.31 () {56 vars in 1137 bytes} [Mon Jan 10 17:41:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:41:05.959531 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46d62d-f931-428d-a133-aaf9cee8af9a None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:05.960368 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46d62d-f931-428d-a133-aaf9cee8af9a None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:05.960368 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46d62d-f931-428d-a133-aaf9cee8af9a None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:05.963310 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 648/1291] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:41:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:41:05.968641 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98444b7-5c3e-44e1-a37c-aacf70f70204 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:05.969099 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98444b7-5c3e-44e1-a37c-aacf70f70204 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:05.969190 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98444b7-5c3e-44e1-a37c-aacf70f70204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:05.989665 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-d98444b7-5c3e-44e1-a37c-aacf70f70204 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:41:05.990767 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-d98444b7-5c3e-44e1-a37c-aacf70f70204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:41:05.999815 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 644/1292] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:41:05 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:41:06.026123 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46d62d-f931-428d-a133-aaf9cee8af9a None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:06.047747 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46d62d-f931-428d-a133-aaf9cee8af9a None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:06.054030 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c238d0-2ce3-4bd7-81c6-4d8c5519e8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:06.054677 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c238d0-2ce3-4bd7-81c6-4d8c5519e8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:06.054954 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c238d0-2ce3-4bd7-81c6-4d8c5519e8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:06.055221 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c238d0-2ce3-4bd7-81c6-4d8c5519e8d0 admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:06.055949 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c238d0-2ce3-4bd7-81c6-4d8c5519e8d0 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:06.057576 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c238d0-2ce3-4bd7-81c6-4d8c5519e8d0 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:06.075224 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 649/1293] 10.222.0.31 () {60 vars in 1162 bytes} [Mon Jan 10 17:41:06 2022] POST /identity/v3/services => generated 246 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:41:08.434508 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c517ff-e8a2-44c6-83be-dbbaf6e0b1d0 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:08.435111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c517ff-e8a2-44c6-83be-dbbaf6e0b1d0 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:08.435111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c517ff-e8a2-44c6-83be-dbbaf6e0b1d0 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:08.436831 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 645/1294] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:41:08.443164 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30dba77-3b40-4748-9882-02dc504bc105 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:08.444065 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30dba77-3b40-4748-9882-02dc504bc105 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:08.444065 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30dba77-3b40-4748-9882-02dc504bc105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:08.467205 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-e30dba77-3b40-4748-9882-02dc504bc105 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:41:08.468439 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-e30dba77-3b40-4748-9882-02dc504bc105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:41:08.486063 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 650/1295] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:41:08 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:41:08.510103 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c517ff-e8a2-44c6-83be-dbbaf6e0b1d0 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:08.524452 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c517ff-e8a2-44c6-83be-dbbaf6e0b1d0 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:08.529933 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608e476-55f9-4592-a957-b31f28e71993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:08.530719 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608e476-55f9-4592-a957-b31f28e71993 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:08.531059 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608e476-55f9-4592-a957-b31f28e71993 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:08.531324 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608e476-55f9-4592-a957-b31f28e71993 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:08.532005 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608e476-55f9-4592-a957-b31f28e71993 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:08.533639 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608e476-55f9-4592-a957-b31f28e71993 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:08.544543 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-8608e476-55f9-4592-a957-b31f28e71993 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 10 17:41:08.545690 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 646/1296] 10.222.0.31 () {56 vars in 1138 bytes} [Mon Jan 10 17:41:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:41:08.551532 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30dba77-3b40-4748-9882-02dc504bc105 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:08.561276 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30dba77-3b40-4748-9882-02dc504bc105 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:08.567915 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a6bdb-618c-4f89-859e-992f687d783b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:08.568565 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a6bdb-618c-4f89-859e-992f687d783b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:08.568845 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a6bdb-618c-4f89-859e-992f687d783b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:08.569146 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a6bdb-618c-4f89-859e-992f687d783b admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:08.569864 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a6bdb-618c-4f89-859e-992f687d783b admin admin] RBAC: Adding query filter params (name=placement) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:41:08.570169 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a6bdb-618c-4f89-859e-992f687d783b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:08.571752 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a6bdb-618c-4f89-859e-992f687d783b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:08.577711 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 651/1297] 10.222.0.31 () {56 vars in 1137 bytes} [Mon Jan 10 17:41:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:41:08.583290 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608e476-55f9-4592-a957-b31f28e71993 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:08.592880 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608e476-55f9-4592-a957-b31f28e71993 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:08.597893 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2728f0e-d2df-4a73-9d7f-4266162ecb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:08.598499 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2728f0e-d2df-4a73-9d7f-4266162ecb3d admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:08.598779 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2728f0e-d2df-4a73-9d7f-4266162ecb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:08.599046 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2728f0e-d2df-4a73-9d7f-4266162ecb3d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:08.599832 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2728f0e-d2df-4a73-9d7f-4266162ecb3d admin admin] RBAC: Adding query filter params (interface=public, service_id=f3c6cfae9ffc4d689b0331d8dbd5f0d4, region_id=RegionOne) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:41:08.600137 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2728f0e-d2df-4a73-9d7f-4266162ecb3d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:08.601728 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2728f0e-d2df-4a73-9d7f-4266162ecb3d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:08.606703 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 647/1298] 10.222.0.31 () {56 vars in 1272 bytes} [Mon Jan 10 17:41:08 2022] GET /identity/v3/endpoints?service_id=f3c6cfae9ffc4d689b0331d8dbd5f0d4&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:41:08.611697 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a6bdb-618c-4f89-859e-992f687d783b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:08.621481 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a6bdb-618c-4f89-859e-992f687d783b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:08.627442 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c238e-b76c-45f3-b98b-9733d49650dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:08.628056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c238e-b76c-45f3-b98b-9733d49650dd admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:08.628336 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c238e-b76c-45f3-b98b-9733d49650dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:08.628610 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c238e-b76c-45f3-b98b-9733d49650dd admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:08.629375 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c238e-b76c-45f3-b98b-9733d49650dd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:08.630902 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c238e-b76c-45f3-b98b-9733d49650dd admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:08.637958 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 652/1299] 10.222.0.31 () {56 vars in 1108 bytes} [Mon Jan 10 17:41:08 2022] GET /identity/v3/services => generated 2191 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:41:10.980835 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fa931-b094-4a3d-b7ee-c4b6ab45f91f None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:10.981455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fa931-b094-4a3d-b7ee-c4b6ab45f91f None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:10.981455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fa931-b094-4a3d-b7ee-c4b6ab45f91f None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:10.983297 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 648/1300] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:41:10.989515 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d8b03-75f5-4e35-b5b4-104ebbe791ec None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:10.990283 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d8b03-75f5-4e35-b5b4-104ebbe791ec None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:10.990404 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d8b03-75f5-4e35-b5b4-104ebbe791ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:11.013937 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-ac6d8b03-75f5-4e35-b5b4-104ebbe791ec None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:41:11.015100 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-ac6d8b03-75f5-4e35-b5b4-104ebbe791ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:41:11.025028 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 653/1301] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:41:10 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:41:11.049064 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fa931-b094-4a3d-b7ee-c4b6ab45f91f None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:11.062334 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fa931-b094-4a3d-b7ee-c4b6ab45f91f None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:11.067855 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8cb67-bb9e-4c40-9e83-b43b91d09834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:11.068630 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8cb67-bb9e-4c40-9e83-b43b91d09834 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:11.068913 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8cb67-bb9e-4c40-9e83-b43b91d09834 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:11.069213 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8cb67-bb9e-4c40-9e83-b43b91d09834 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:11.069882 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8cb67-bb9e-4c40-9e83-b43b91d09834 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:11.071469 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8cb67-bb9e-4c40-9e83-b43b91d09834 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:11.083094 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING keystone.server.flask.application [None req-8ca8cb67-bb9e-4c40-9e83-b43b91d09834 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 10 17:41:11.084192 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 649/1302] 10.222.0.31 () {56 vars in 1138 bytes} [Mon Jan 10 17:41:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 17:41:11.089784 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d8b03-75f5-4e35-b5b4-104ebbe791ec None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:11.098862 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d8b03-75f5-4e35-b5b4-104ebbe791ec None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:11.104741 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fd7ce-e1a3-402f-a54d-03933260e5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:11.105407 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fd7ce-e1a3-402f-a54d-03933260e5ca admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:11.105691 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fd7ce-e1a3-402f-a54d-03933260e5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:11.105959 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fd7ce-e1a3-402f-a54d-03933260e5ca admin admin] PATH_INFO: `/v3/services` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:11.106673 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fd7ce-e1a3-402f-a54d-03933260e5ca admin admin] RBAC: Adding query filter params (name=placement) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:41:11.106971 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fd7ce-e1a3-402f-a54d-03933260e5ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:11.108538 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fd7ce-e1a3-402f-a54d-03933260e5ca admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:11.114127 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 654/1303] 10.222.0.31 () {56 vars in 1137 bytes} [Mon Jan 10 17:41:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:41:11.119443 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8cb67-bb9e-4c40-9e83-b43b91d09834 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:41:11.128961 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8cb67-bb9e-4c40-9e83-b43b91d09834 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:41:11.134170 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee8091-1057-4954-8057-4548f050e547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:41:11.134780 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee8091-1057-4954-8057-4548f050e547 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:41:11.135061 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee8091-1057-4954-8057-4548f050e547 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:41:11.135330 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee8091-1057-4954-8057-4548f050e547 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:41:11.136089 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee8091-1057-4954-8057-4548f050e547 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:41:11.137677 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee8091-1057-4954-8057-4548f050e547 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:41:11.161727 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 650/1304] 10.222.0.31 () {60 vars in 1165 bytes} [Mon Jan 10 17:41:11 2022] POST /identity/v3/endpoints => generated 331 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:42:13.832308 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb7a77-0445-4a29-bd6f-a56eecffcf70 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:13.832801 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb7a77-0445-4a29-bd6f-a56eecffcf70 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:13.833050 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb7a77-0445-4a29-bd6f-a56eecffcf70 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:13.835068 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 655/1305] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:42:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:42:13.841617 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b6cc8-4740-4def-bc63-646fbe84ad8f None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:13.842098 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b6cc8-4740-4def-bc63-646fbe84ad8f None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:13.842191 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b6cc8-4740-4def-bc63-646fbe84ad8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:13.931837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-f05b6cc8-4740-4def-bc63-646fbe84ad8f None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:42:13.933565 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-f05b6cc8-4740-4def-bc63-646fbe84ad8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:14.062176 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 651/1306] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:42:14.085564 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb7a77-0445-4a29-bd6f-a56eecffcf70 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:42:14.087320 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-4efb7a77-0445-4a29-bd6f-a56eecffcf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:14.220939 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb7a77-0445-4a29-bd6f-a56eecffcf70 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:42:14.313560 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f355d-9dfa-49c4-aabc-2274fbf3243a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:42:14.314232 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f355d-9dfa-49c4-aabc-2274fbf3243a admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:14.314505 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f355d-9dfa-49c4-aabc-2274fbf3243a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:14.314787 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f355d-9dfa-49c4-aabc-2274fbf3243a admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:14.315536 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f355d-9dfa-49c4-aabc-2274fbf3243a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:42:14.317438 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f355d-9dfa-49c4-aabc-2274fbf3243a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:42:14.342550 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 656/1307] 10.222.0.31 () {56 vars in 1108 bytes} [Mon Jan 10 17:42:14 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:42:16.750923 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc936a16-1745-4a3e-8a20-91183e091087 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:16.751420 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc936a16-1745-4a3e-8a20-91183e091087 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:16.751529 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc936a16-1745-4a3e-8a20-91183e091087 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:16.754241 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 652/1308] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:42:16.759759 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1180a-5d9c-4f55-ba9d-26c2417442a6 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:16.760151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1180a-5d9c-4f55-ba9d-26c2417442a6 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:16.760296 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1180a-5d9c-4f55-ba9d-26c2417442a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:16.845515 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-8fe1180a-5d9c-4f55-ba9d-26c2417442a6 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:42:16.846721 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-8fe1180a-5d9c-4f55-ba9d-26c2417442a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:16.952900 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 657/1309] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:42:16.972826 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc936a16-1745-4a3e-8a20-91183e091087 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:42:16.974380 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-cc936a16-1745-4a3e-8a20-91183e091087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:17.136727 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc936a16-1745-4a3e-8a20-91183e091087 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:42:17.235546 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa858892-52c9-4709-bca0-77a6644485fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:42:17.236223 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa858892-52c9-4709-bca0-77a6644485fa admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:17.236506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa858892-52c9-4709-bca0-77a6644485fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:17.236779 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa858892-52c9-4709-bca0-77a6644485fa admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:17.237601 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa858892-52c9-4709-bca0-77a6644485fa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:42:17.239551 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa858892-52c9-4709-bca0-77a6644485fa admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:42:17.261859 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 653/1310] 10.222.0.31 () {56 vars in 1108 bytes} [Mon Jan 10 17:42:16 2022] GET /identity/v3/projects => generated 2553 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:42:19.675056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014802e3-95de-44c3-b262-95d5130f2c88 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:19.675898 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014802e3-95de-44c3-b262-95d5130f2c88 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:19.675898 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014802e3-95de-44c3-b262-95d5130f2c88 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:19.678837 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 658/1311] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:42:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:42:19.687409 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fd13d-839c-40f1-8e96-f38408d8b139 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:19.687812 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fd13d-839c-40f1-8e96-f38408d8b139 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:19.687958 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fd13d-839c-40f1-8e96-f38408d8b139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:19.769334 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-4c3fd13d-839c-40f1-8e96-f38408d8b139 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:42:19.770557 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-4c3fd13d-839c-40f1-8e96-f38408d8b139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:19.868670 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 654/1312] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:42:19.931468 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7ca90-c8f4-4188-824f-262a65d4f00a None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:19.931717 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7ca90-c8f4-4188-824f-262a65d4f00a None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:19.932193 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7ca90-c8f4-4188-824f-262a65d4f00a None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:19.935029 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 659/1313] 10.222.0.31 () {54 vars in 964 bytes} [Mon Jan 10 17:42:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:42:19.943917 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9bb92-1480-47f1-9517-80aa13cfffa8 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:19.944210 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9bb92-1480-47f1-9517-80aa13cfffa8 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:19.944482 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9bb92-1480-47f1-9517-80aa13cfffa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:20.021630 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-3ce9bb92-1480-47f1-9517-80aa13cfffa8 None None] MFA Rules not processed for user `2174a30e22c746589b3faaf4ccc8de3d`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:42:20.022828 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-3ce9bb92-1480-47f1-9517-80aa13cfffa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:20.101779 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 655/1314] 10.222.0.31 () {58 vars in 1061 bytes} [Mon Jan 10 17:42:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:42:20.113791 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7ca90-c8f4-4188-824f-262a65d4f00a None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:42:20.116187 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-6dd7ca90-c8f4-4188-824f-262a65d4f00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:20.234397 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7ca90-c8f4-4188-824f-262a65d4f00a None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:42:20.309340 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03468582-da46-4534-a04d-90a2406a7380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:42:20.309981 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03468582-da46-4534-a04d-90a2406a7380 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:20.310259 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03468582-da46-4534-a04d-90a2406a7380 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:20.310530 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03468582-da46-4534-a04d-90a2406a7380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:20.312177 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-03468582-da46-4534-a04d-90a2406a7380 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:20.432609 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03468582-da46-4534-a04d-90a2406a7380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:42:20.434114 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03468582-da46-4534-a04d-90a2406a7380 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:42:20.453383 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 660/1315] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:42:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:42:23.121537 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518afa2-9699-477a-a6c6-c82b310a8c32 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:23.122075 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518afa2-9699-477a-a6c6-c82b310a8c32 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:23.122075 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518afa2-9699-477a-a6c6-c82b310a8c32 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:23.123888 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 656/1316] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:42:23.130347 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81658af4-29da-4818-9b27-05b0af6aa932 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:23.131019 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81658af4-29da-4818-9b27-05b0af6aa932 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:23.131109 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81658af4-29da-4818-9b27-05b0af6aa932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:23.208197 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-81658af4-29da-4818-9b27-05b0af6aa932 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:42:23.209740 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-81658af4-29da-4818-9b27-05b0af6aa932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:23.314300 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 661/1317] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:42:23.349954 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518afa2-9699-477a-a6c6-c82b310a8c32 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:42:23.352336 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-8518afa2-9699-477a-a6c6-c82b310a8c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:23.493300 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518afa2-9699-477a-a6c6-c82b310a8c32 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:42:23.587212 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26007af-abed-4154-ae4b-5067546777fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:42:23.588049 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26007af-abed-4154-ae4b-5067546777fa admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:23.588320 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26007af-abed-4154-ae4b-5067546777fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:23.588593 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26007af-abed-4154-ae4b-5067546777fa admin admin] PATH_INFO: `/v3/projects/ef5870ae6e4a4492ac99ab89391674b9` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:23.589530 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26007af-abed-4154-ae4b-5067546777fa admin admin] RBAC: Authorizing `identity:get_project(project_id=ef5870ae6e4a4492ac99ab89391674b9)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:42:23.591323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26007af-abed-4154-ae4b-5067546777fa admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:42:23.593009 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 657/1318] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:42:23 2022] GET /identity/v3/projects/ef5870ae6e4a4492ac99ab89391674b9 => generated 344 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:42:23.605052 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81658af4-29da-4818-9b27-05b0af6aa932 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:42:23.606282 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-81658af4-29da-4818-9b27-05b0af6aa932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:23.710758 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81658af4-29da-4818-9b27-05b0af6aa932 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:42:23.786966 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b10af4-fc91-45e8-9c49-fe029cd6cd1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:42:23.787775 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b10af4-fc91-45e8-9c49-fe029cd6cd1a service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:23.788056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b10af4-fc91-45e8-9c49-fe029cd6cd1a service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:23.788330 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b10af4-fc91-45e8-9c49-fe029cd6cd1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:23.789986 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b4b10af4-fc91-45e8-9c49-fe029cd6cd1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:23.897932 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b10af4-fc91-45e8-9c49-fe029cd6cd1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:42:23.899672 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b10af4-fc91-45e8-9c49-fe029cd6cd1a service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:42:23.917527 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 662/1319] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:42:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:42:26.627758 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbbab8-7ad3-4ed8-aa09-6d33b35d2778 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:26.628641 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbbab8-7ad3-4ed8-aa09-6d33b35d2778 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:26.628641 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbbab8-7ad3-4ed8-aa09-6d33b35d2778 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:26.631500 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 658/1320] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:42:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:42:26.637780 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979c328-2456-499c-8318-93c705864198 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:26.638443 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979c328-2456-499c-8318-93c705864198 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:26.638585 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979c328-2456-499c-8318-93c705864198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:26.708055 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-b979c328-2456-499c-8318-93c705864198 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:42:26.709276 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b979c328-2456-499c-8318-93c705864198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:26.814744 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 663/1321] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:42:26.855966 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbbab8-7ad3-4ed8-aa09-6d33b35d2778 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:42:26.858374 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-28cbbab8-7ad3-4ed8-aa09-6d33b35d2778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:26.987530 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbbab8-7ad3-4ed8-aa09-6d33b35d2778 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:42:27.087683 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c683e6d-70f5-4cf7-8e72-17989dbfac95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:42:27.088679 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c683e6d-70f5-4cf7-8e72-17989dbfac95 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:27.088992 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c683e6d-70f5-4cf7-8e72-17989dbfac95 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:27.089262 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c683e6d-70f5-4cf7-8e72-17989dbfac95 admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:27.099610 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c683e6d-70f5-4cf7-8e72-17989dbfac95 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e853ee55e324805acbbf0aff75277c3)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:42:27.101731 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c683e6d-70f5-4cf7-8e72-17989dbfac95 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:42:27.103400 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 659/1322] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:42:26 2022] GET /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:42:27.116325 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979c328-2456-499c-8318-93c705864198 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:42:27.118245 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b979c328-2456-499c-8318-93c705864198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:27.216367 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979c328-2456-499c-8318-93c705864198 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:42:27.293721 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71babccd-6030-44f3-843c-d28abb910ac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:42:27.294290 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71babccd-6030-44f3-843c-d28abb910ac5 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:27.294574 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71babccd-6030-44f3-843c-d28abb910ac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:27.294847 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71babccd-6030-44f3-843c-d28abb910ac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:27.296559 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-71babccd-6030-44f3-843c-d28abb910ac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:27.427735 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71babccd-6030-44f3-843c-d28abb910ac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:42:27.429228 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71babccd-6030-44f3-843c-d28abb910ac5 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:42:27.447666 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 664/1323] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:42:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:42:30.340155 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b72c1-f28a-4b9c-9dbc-bea4cf21c6e6 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:30.341107 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b72c1-f28a-4b9c-9dbc-bea4cf21c6e6 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:30.341107 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b72c1-f28a-4b9c-9dbc-bea4cf21c6e6 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:30.343955 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 660/1324] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:42:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:42:30.349358 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb5100-8820-4fbb-80ce-436057c9e6df None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:30.349781 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb5100-8820-4fbb-80ce-436057c9e6df None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:30.349895 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb5100-8820-4fbb-80ce-436057c9e6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:30.413771 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-a0eb5100-8820-4fbb-80ce-436057c9e6df None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:42:30.414953 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a0eb5100-8820-4fbb-80ce-436057c9e6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:30.528730 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 665/1325] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:42:30.563627 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b72c1-f28a-4b9c-9dbc-bea4cf21c6e6 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:42:30.565180 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-a93b72c1-f28a-4b9c-9dbc-bea4cf21c6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:30.699244 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b72c1-f28a-4b9c-9dbc-bea4cf21c6e6 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:42:30.790800 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb3b1e-c299-442e-87f3-5dd26b115ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:42:30.791668 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb3b1e-c299-442e-87f3-5dd26b115ead admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:30.791949 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb3b1e-c299-442e-87f3-5dd26b115ead admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:30.792220 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb3b1e-c299-442e-87f3-5dd26b115ead admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:30.802060 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb3b1e-c299-442e-87f3-5dd26b115ead admin admin] RBAC: Authorizing `identity:get_project(project_id=3e853ee55e324805acbbf0aff75277c3)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:42:30.804131 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb3b1e-c299-442e-87f3-5dd26b115ead admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:42:30.805840 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 661/1326] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:42:30 2022] GET /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:42:30.818271 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb5100-8820-4fbb-80ce-436057c9e6df None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:42:30.820166 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a0eb5100-8820-4fbb-80ce-436057c9e6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:30.919312 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb5100-8820-4fbb-80ce-436057c9e6df None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:42:30.998972 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc557142-96fd-4068-b560-eac36e4cf392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:42:30.999558 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc557142-96fd-4068-b560-eac36e4cf392 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:30.999839 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc557142-96fd-4068-b560-eac36e4cf392 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:31.000115 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc557142-96fd-4068-b560-eac36e4cf392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:31.001770 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-cc557142-96fd-4068-b560-eac36e4cf392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:31.116192 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc557142-96fd-4068-b560-eac36e4cf392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:42:31.117671 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc557142-96fd-4068-b560-eac36e4cf392 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:42:31.135378 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 666/1327] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:42:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:42:34.172578 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae470f-417e-4dc9-b436-f5442a1a99f7 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:34.173189 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae470f-417e-4dc9-b436-f5442a1a99f7 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:34.173189 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae470f-417e-4dc9-b436-f5442a1a99f7 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:34.174961 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 662/1328] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:42:34.180233 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8ee79-1978-4ffb-bb9f-5405fb094a5b None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:34.180668 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8ee79-1978-4ffb-bb9f-5405fb094a5b None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:34.180762 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8ee79-1978-4ffb-bb9f-5405fb094a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:34.247413 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-6fb8ee79-1978-4ffb-bb9f-5405fb094a5b None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:42:34.248600 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-6fb8ee79-1978-4ffb-bb9f-5405fb094a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:34.358135 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 667/1329] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:42:34.417153 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c8823-00b5-4956-a70d-fe29cdcfccec None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:34.417404 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c8823-00b5-4956-a70d-fe29cdcfccec None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:34.417703 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c8823-00b5-4956-a70d-fe29cdcfccec None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:34.419537 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 663/1330] 10.222.0.31 () {54 vars in 964 bytes} [Mon Jan 10 17:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:42:34.425541 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e943a-0106-43b2-b934-29ef64bac5aa None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:34.425722 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e943a-0106-43b2-b934-29ef64bac5aa None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:34.426020 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e943a-0106-43b2-b934-29ef64bac5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:34.501681 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-f37e943a-0106-43b2-b934-29ef64bac5aa None None] MFA Rules not processed for user `2174a30e22c746589b3faaf4ccc8de3d`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:42:34.502881 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f37e943a-0106-43b2-b934-29ef64bac5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:34.577769 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 668/1331] 10.222.0.31 () {58 vars in 1061 bytes} [Mon Jan 10 17:42:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:42:34.587124 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c8823-00b5-4956-a70d-fe29cdcfccec None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:42:34.588653 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-647c8823-00b5-4956-a70d-fe29cdcfccec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:34.825723 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c8823-00b5-4956-a70d-fe29cdcfccec None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:42:34.909903 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af9917-013c-4ff3-a293-51747ec34cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:42:34.910557 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af9917-013c-4ff3-a293-51747ec34cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:34.910837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af9917-013c-4ff3-a293-51747ec34cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:34.911105 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af9917-013c-4ff3-a293-51747ec34cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:34.912725 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-58af9917-013c-4ff3-a293-51747ec34cb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:35.023777 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af9917-013c-4ff3-a293-51747ec34cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:42:35.026535 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af9917-013c-4ff3-a293-51747ec34cb7 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:42:35.053712 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 664/1332] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:42:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:42:37.722387 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553becf6-7563-4ddc-b1f8-8f6e385a23f6 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:37.722926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553becf6-7563-4ddc-b1f8-8f6e385a23f6 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:37.722926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553becf6-7563-4ddc-b1f8-8f6e385a23f6 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:37.724648 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 669/1333] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:42:37.730172 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78730429-43d1-4af0-9c1e-bacbbb0f38f7 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:37.730745 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78730429-43d1-4af0-9c1e-bacbbb0f38f7 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:37.730745 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78730429-43d1-4af0-9c1e-bacbbb0f38f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:37.801107 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-78730429-43d1-4af0-9c1e-bacbbb0f38f7 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:42:37.802333 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-78730429-43d1-4af0-9c1e-bacbbb0f38f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:37.903499 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 665/1334] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:42:37.940877 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553becf6-7563-4ddc-b1f8-8f6e385a23f6 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:42:37.942471 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-553becf6-7563-4ddc-b1f8-8f6e385a23f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:38.044703 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553becf6-7563-4ddc-b1f8-8f6e385a23f6 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:42:38.116952 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f7e7e-84cf-478d-8d4c-d4b36cdc64e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:42:38.117536 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f7e7e-84cf-478d-8d4c-d4b36cdc64e2 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:38.117818 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f7e7e-84cf-478d-8d4c-d4b36cdc64e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:38.118083 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f7e7e-84cf-478d-8d4c-d4b36cdc64e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:38.119690 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-383f7e7e-84cf-478d-8d4c-d4b36cdc64e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:38.228972 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f7e7e-84cf-478d-8d4c-d4b36cdc64e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:42:38.230403 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f7e7e-84cf-478d-8d4c-d4b36cdc64e2 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:42:38.248042 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 670/1335] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:42:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:42:40.659138 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bd8eb-f420-4481-acea-e4800d34c715 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:40.659749 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bd8eb-f420-4481-acea-e4800d34c715 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:40.659749 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bd8eb-f420-4481-acea-e4800d34c715 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:40.661523 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 666/1336] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:42:40.667474 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2372e-968a-47e2-8b36-1fd0ab269813 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:40.667878 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2372e-968a-47e2-8b36-1fd0ab269813 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:40.668093 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2372e-968a-47e2-8b36-1fd0ab269813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:40.745955 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-f5b2372e-968a-47e2-8b36-1fd0ab269813 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:42:40.747152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f5b2372e-968a-47e2-8b36-1fd0ab269813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:40.841329 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 671/1337] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:42:40.874582 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bd8eb-f420-4481-acea-e4800d34c715 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:42:40.876099 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-985bd8eb-f420-4481-acea-e4800d34c715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:40.998590 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bd8eb-f420-4481-acea-e4800d34c715 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:42:41.089363 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b44358-cfb5-4384-ada7-95e5b904f489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:42:41.090226 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b44358-cfb5-4384-ada7-95e5b904f489 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:41.090503 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b44358-cfb5-4384-ada7-95e5b904f489 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:41.090767 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b44358-cfb5-4384-ada7-95e5b904f489 admin admin] PATH_INFO: `/v3/projects/3e853ee55e324805acbbf0aff75277c3` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:41.100685 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b44358-cfb5-4384-ada7-95e5b904f489 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e853ee55e324805acbbf0aff75277c3)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:42:41.102744 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b44358-cfb5-4384-ada7-95e5b904f489 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:42:41.104484 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 667/1338] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:42:40 2022] GET /identity/v3/projects/3e853ee55e324805acbbf0aff75277c3 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:42:41.116464 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2372e-968a-47e2-8b36-1fd0ab269813 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:42:41.117718 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f5b2372e-968a-47e2-8b36-1fd0ab269813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:41.215359 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2372e-968a-47e2-8b36-1fd0ab269813 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:42:41.287978 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4db01d-3d49-485e-9242-1e401313b362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:42:41.288526 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4db01d-3d49-485e-9242-1e401313b362 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:41.288775 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4db01d-3d49-485e-9242-1e401313b362 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:41.289108 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4db01d-3d49-485e-9242-1e401313b362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:41.290717 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-8f4db01d-3d49-485e-9242-1e401313b362 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:41.397296 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4db01d-3d49-485e-9242-1e401313b362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:42:41.398742 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4db01d-3d49-485e-9242-1e401313b362 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:42:41.416823 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 672/1339] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:42:44.038399 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6196a3d-9fc9-434e-8547-cfc1d87a6a93 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:44.038942 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6196a3d-9fc9-434e-8547-cfc1d87a6a93 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:44.038942 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6196a3d-9fc9-434e-8547-cfc1d87a6a93 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:44.040761 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 668/1340] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:42:44.046444 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab7390-cb5f-4b6a-a516-6604d028d98c None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:44.046907 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab7390-cb5f-4b6a-a516-6604d028d98c None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:44.047017 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab7390-cb5f-4b6a-a516-6604d028d98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:44.113962 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-84ab7390-cb5f-4b6a-a516-6604d028d98c None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:42:44.115133 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-84ab7390-cb5f-4b6a-a516-6604d028d98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:44.237305 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 673/1341] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:42:44.270404 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6196a3d-9fc9-434e-8547-cfc1d87a6a93 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:42:44.272928 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-c6196a3d-9fc9-434e-8547-cfc1d87a6a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:44.382598 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6196a3d-9fc9-434e-8547-cfc1d87a6a93 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:42:44.387054 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1c7f8-397b-4605-a413-82c5f218ef91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:42:44.387697 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1c7f8-397b-4605-a413-82c5f218ef91 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:44.387977 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1c7f8-397b-4605-a413-82c5f218ef91 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:44.388253 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1c7f8-397b-4605-a413-82c5f218ef91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:44.418268 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1c7f8-397b-4605-a413-82c5f218ef91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:42:44.419742 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1c7f8-397b-4605-a413-82c5f218ef91 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:42:44.429167 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 669/1342] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:42:46.822117 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943251a-3ec1-4ad7-a08e-695f873baef6 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:46.822948 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943251a-3ec1-4ad7-a08e-695f873baef6 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:46.822948 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943251a-3ec1-4ad7-a08e-695f873baef6 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:46.825899 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 674/1343] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:42:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:42:46.834512 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91780193-7ff9-44c4-b55e-907510402e8a None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:46.834915 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91780193-7ff9-44c4-b55e-907510402e8a None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:46.835062 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91780193-7ff9-44c4-b55e-907510402e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:46.904455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-91780193-7ff9-44c4-b55e-907510402e8a None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:42:46.905674 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-91780193-7ff9-44c4-b55e-907510402e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:46.925259 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 670/1344] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:42:46.963391 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943251a-3ec1-4ad7-a08e-695f873baef6 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:42:46.977529 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943251a-3ec1-4ad7-a08e-695f873baef6 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:42:46.982436 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0586fa4-cf24-4d91-a8ad-4c607e5632ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:42:46.983331 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0586fa4-cf24-4d91-a8ad-4c607e5632ac admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:46.983666 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0586fa4-cf24-4d91-a8ad-4c607e5632ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:46.983887 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0586fa4-cf24-4d91-a8ad-4c607e5632ac admin admin] PATH_INFO: `/v3/projects/ef5870ae6e4a4492ac99ab89391674b9` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:46.985158 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0586fa4-cf24-4d91-a8ad-4c607e5632ac admin admin] RBAC: Authorizing `identity:get_project(project_id=ef5870ae6e4a4492ac99ab89391674b9)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:42:46.986938 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0586fa4-cf24-4d91-a8ad-4c607e5632ac admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:42:46.988630 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 675/1345] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:42:46 2022] GET /identity/v3/projects/ef5870ae6e4a4492ac99ab89391674b9 => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:42:47.000384 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91780193-7ff9-44c4-b55e-907510402e8a None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:42:47.010034 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91780193-7ff9-44c4-b55e-907510402e8a None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:42:47.015786 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0b09a-0d14-4339-8e34-f51fa20a99bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:42:47.016427 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0b09a-0d14-4339-8e34-f51fa20a99bb service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:47.016705 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0b09a-0d14-4339-8e34-f51fa20a99bb service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:47.017005 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0b09a-0d14-4339-8e34-f51fa20a99bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:47.027524 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0b09a-0d14-4339-8e34-f51fa20a99bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:42:47.029007 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0b09a-0d14-4339-8e34-f51fa20a99bb service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:42:47.038563 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 671/1346] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:42:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:42:49.742559 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be441dac-201c-44fe-8b6a-725e6e0bbad8 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:49.743024 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be441dac-201c-44fe-8b6a-725e6e0bbad8 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:49.743118 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be441dac-201c-44fe-8b6a-725e6e0bbad8 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:49.744889 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 676/1347] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:42:49.750573 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca61250-6337-4d42-8f9f-e78bc9705654 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:49.751020 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca61250-6337-4d42-8f9f-e78bc9705654 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:49.751121 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca61250-6337-4d42-8f9f-e78bc9705654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:49.769966 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-aca61250-6337-4d42-8f9f-e78bc9705654 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:42:49.771145 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-aca61250-6337-4d42-8f9f-e78bc9705654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:49.781126 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 672/1348] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:42:49.822201 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be441dac-201c-44fe-8b6a-725e6e0bbad8 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:42:49.836440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be441dac-201c-44fe-8b6a-725e6e0bbad8 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:42:49.841207 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34260f-2b1e-4547-ae83-5f7570b58375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:42:49.841843 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34260f-2b1e-4547-ae83-5f7570b58375 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:49.842124 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34260f-2b1e-4547-ae83-5f7570b58375 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:49.842401 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34260f-2b1e-4547-ae83-5f7570b58375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:49.851970 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34260f-2b1e-4547-ae83-5f7570b58375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:42:49.853440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34260f-2b1e-4547-ae83-5f7570b58375 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:42:49.862852 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 677/1349] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:42:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:42:54.191059 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384c70c-776d-4d00-bf69-dc86acc25659 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:54.191638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384c70c-776d-4d00-bf69-dc86acc25659 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:54.191638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384c70c-776d-4d00-bf69-dc86acc25659 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:54.193420 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 673/1350] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:42:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:42:54.200054 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50878173-8aa4-4200-9a35-83113b563b3f None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:54.200477 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50878173-8aa4-4200-9a35-83113b563b3f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:54.200665 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50878173-8aa4-4200-9a35-83113b563b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:54.218872 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-50878173-8aa4-4200-9a35-83113b563b3f None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:42:54.220032 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-50878173-8aa4-4200-9a35-83113b563b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:54.228257 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 678/1351] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:42:54.251287 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384c70c-776d-4d00-bf69-dc86acc25659 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:42:54.264185 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384c70c-776d-4d00-bf69-dc86acc25659 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:42:54.269099 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f4e26-8772-4625-8089-215a23adc400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:42:54.269721 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f4e26-8772-4625-8089-215a23adc400 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:54.269981 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f4e26-8772-4625-8089-215a23adc400 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:54.270246 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f4e26-8772-4625-8089-215a23adc400 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:54.271004 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f4e26-8772-4625-8089-215a23adc400 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:42:54.272832 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f4e26-8772-4625-8089-215a23adc400 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:42:54.287567 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 674/1352] 10.222.0.31 () {56 vars in 1108 bytes} [Mon Jan 10 17:42:54 2022] GET /identity/v3/projects => generated 2553 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:42:56.716816 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c39ea-a305-41b7-840e-947ae9d92cc3 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:56.717341 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c39ea-a305-41b7-840e-947ae9d92cc3 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:56.717418 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c39ea-a305-41b7-840e-947ae9d92cc3 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:56.719492 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 679/1353] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:42:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:42:56.725245 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fe123-0164-4f67-820c-412b87fa7a21 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:56.725727 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fe123-0164-4f67-820c-412b87fa7a21 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:56.725817 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fe123-0164-4f67-820c-412b87fa7a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:56.751273 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-ea9fe123-0164-4f67-820c-412b87fa7a21 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:42:56.752611 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-ea9fe123-0164-4f67-820c-412b87fa7a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:56.761750 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 675/1354] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:42:56.796929 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c39ea-a305-41b7-840e-947ae9d92cc3 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:42:56.809005 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c39ea-a305-41b7-840e-947ae9d92cc3 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:42:56.813534 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafea812-148b-4c46-b498-d077c9a4687b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:42:56.814376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafea812-148b-4c46-b498-d077c9a4687b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:56.814648 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafea812-148b-4c46-b498-d077c9a4687b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:56.814917 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafea812-148b-4c46-b498-d077c9a4687b admin admin] PATH_INFO: `/v3/projects/ef5870ae6e4a4492ac99ab89391674b9` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:56.816074 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafea812-148b-4c46-b498-d077c9a4687b admin admin] RBAC: Authorizing `identity:get_project(project_id=ef5870ae6e4a4492ac99ab89391674b9)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:42:56.817889 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafea812-148b-4c46-b498-d077c9a4687b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:42:56.819690 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 680/1355] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:42:56 2022] GET /identity/v3/projects/ef5870ae6e4a4492ac99ab89391674b9 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:42:56.831667 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fe123-0164-4f67-820c-412b87fa7a21 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:42:56.841803 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fe123-0164-4f67-820c-412b87fa7a21 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:42:56.846456 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e21758-f1a3-4095-a35c-10d1497ad1e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:42:56.847105 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e21758-f1a3-4095-a35c-10d1497ad1e1 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:56.847391 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e21758-f1a3-4095-a35c-10d1497ad1e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:56.847661 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e21758-f1a3-4095-a35c-10d1497ad1e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:56.856712 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e21758-f1a3-4095-a35c-10d1497ad1e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:42:56.858268 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e21758-f1a3-4095-a35c-10d1497ad1e1 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:42:56.867760 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 676/1356] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:42:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:42:59.875746 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22370011-5b01-4bd9-9eaa-8a5d781525f9 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:59.876296 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22370011-5b01-4bd9-9eaa-8a5d781525f9 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:59.876296 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22370011-5b01-4bd9-9eaa-8a5d781525f9 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:59.878124 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 681/1357] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:42:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:42:59.883472 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a90e8-588c-4074-8b71-78bd482f3bac None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:59.883980 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a90e8-588c-4074-8b71-78bd482f3bac None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:59.884078 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a90e8-588c-4074-8b71-78bd482f3bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:59.903127 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-769a90e8-588c-4074-8b71-78bd482f3bac None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:42:59.904337 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-769a90e8-588c-4074-8b71-78bd482f3bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:59.914261 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 677/1358] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:42:59.952893 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22370011-5b01-4bd9-9eaa-8a5d781525f9 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:42:59.955123 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-22370011-5b01-4bd9-9eaa-8a5d781525f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:42:59.969011 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22370011-5b01-4bd9-9eaa-8a5d781525f9 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:42:59.972723 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e0980-321c-4ad4-a0c4-c76576533b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:42:59.973372 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e0980-321c-4ad4-a0c4-c76576533b1f service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:42:59.973651 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e0980-321c-4ad4-a0c4-c76576533b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:42:59.973931 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e0980-321c-4ad4-a0c4-c76576533b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:42:59.982664 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e0980-321c-4ad4-a0c4-c76576533b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:42:59.984187 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e0980-321c-4ad4-a0c4-c76576533b1f service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:43:00.004152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 682/1359] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:42:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:43:04.948332 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3bf8b-642a-4e20-ab1c-174e051775cc None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:04.949314 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3bf8b-642a-4e20-ab1c-174e051775cc None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:04.949314 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3bf8b-642a-4e20-ab1c-174e051775cc None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:04.952108 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 678/1360] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:43:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:04.958131 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e2de5-325b-4a8c-a0f3-bc8f04a7e821 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:04.958824 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e2de5-325b-4a8c-a0f3-bc8f04a7e821 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:04.958957 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e2de5-325b-4a8c-a0f3-bc8f04a7e821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:04.985995 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-1b0e2de5-325b-4a8c-a0f3-bc8f04a7e821 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:04.987209 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-1b0e2de5-325b-4a8c-a0f3-bc8f04a7e821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:04.996620 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 683/1361] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:43:05.035835 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3bf8b-642a-4e20-ab1c-174e051775cc None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:43:05.046953 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3bf8b-642a-4e20-ab1c-174e051775cc None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:43:05.050602 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd7168-d5b8-4f56-9db3-b0aeeb6fe1e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:43:05.051238 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd7168-d5b8-4f56-9db3-b0aeeb6fe1e9 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:05.051517 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd7168-d5b8-4f56-9db3-b0aeeb6fe1e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:05.051789 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd7168-d5b8-4f56-9db3-b0aeeb6fe1e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:05.060339 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd7168-d5b8-4f56-9db3-b0aeeb6fe1e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:43:05.061826 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd7168-d5b8-4f56-9db3-b0aeeb6fe1e9 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:43:05.071109 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 679/1362] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:43:09.970085 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a17bf3-c845-4516-af06-b16b9179b26c None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:09.971176 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a17bf3-c845-4516-af06-b16b9179b26c None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:09.971726 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a17bf3-c845-4516-af06-b16b9179b26c None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:09.973790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 684/1363] 10.222.0.31 () {54 vars in 921 bytes} [Mon Jan 10 17:43:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:09.980115 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4b4e0-6e8f-455e-833c-fdd0670ea787 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:09.981178 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4b4e0-6e8f-455e-833c-fdd0670ea787 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:09.981681 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4b4e0-6e8f-455e-833c-fdd0670ea787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:10.051175 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-d5f4b4e0-6e8f-455e-833c-fdd0670ea787 None None] MFA Rules not processed for user `3a3b8e620cfd42fe993c73dc83a246be`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:10.052834 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-d5f4b4e0-6e8f-455e-833c-fdd0670ea787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:10.132638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 680/1364] 10.222.0.31 () {58 vars in 1018 bytes} [Mon Jan 10 17:43:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:43:14.085199 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11509bcd-794f-437c-9fff-bf31c2430862 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:14.086772 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11509bcd-794f-437c-9fff-bf31c2430862 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:14.087040 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11509bcd-794f-437c-9fff-bf31c2430862 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:14.089355 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 685/1365] 10.222.0.31 () {54 vars in 921 bytes} [Mon Jan 10 17:43:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:14.094706 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e688b-039f-46db-9b35-ae9fdab45809 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:14.095162 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e688b-039f-46db-9b35-ae9fdab45809 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:14.095542 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e688b-039f-46db-9b35-ae9fdab45809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:14.115295 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-8a1e688b-039f-46db-9b35-ae9fdab45809 None None] MFA Rules not processed for user `3a3b8e620cfd42fe993c73dc83a246be`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:14.116797 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-8a1e688b-039f-46db-9b35-ae9fdab45809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:14.126566 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 681/1366] 10.222.0.31 () {58 vars in 1018 bytes} [Mon Jan 10 17:43:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:43:15.763375 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1aef5-2206-4f92-aa96-4753819ed9c1 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:15.763970 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1aef5-2206-4f92-aa96-4753819ed9c1 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:15.763970 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1aef5-2206-4f92-aa96-4753819ed9c1 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:15.766130 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 686/1367] 10.222.0.31 () {54 vars in 921 bytes} [Mon Jan 10 17:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:15.770927 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30c534-5e6d-4614-bb6e-ba16490d4d6d None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:15.772014 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30c534-5e6d-4614-bb6e-ba16490d4d6d None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:15.772439 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30c534-5e6d-4614-bb6e-ba16490d4d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:15.791807 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-bb30c534-5e6d-4614-bb6e-ba16490d4d6d None None] MFA Rules not processed for user `3a3b8e620cfd42fe993c73dc83a246be`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:15.793125 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-bb30c534-5e6d-4614-bb6e-ba16490d4d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:15.802742 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 682/1368] 10.222.0.31 () {58 vars in 1018 bytes} [Mon Jan 10 17:43:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:43:19.670666 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372dcd5-6dc8-408d-841b-e035a5fc51a1 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:19.671269 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372dcd5-6dc8-408d-841b-e035a5fc51a1 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:19.671507 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372dcd5-6dc8-408d-841b-e035a5fc51a1 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:19.680010 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39945d1-3f94-4ff0-9727-51149bf4a3ac None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:19.680916 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39945d1-3f94-4ff0-9727-51149bf4a3ac None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:19.681416 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39945d1-3f94-4ff0-9727-51149bf4a3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:19.684157 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 687/1369] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:43:19 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:19.700488 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-f39945d1-3f94-4ff0-9727-51149bf4a3ac None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:19.701934 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-f39945d1-3f94-4ff0-9727-51149bf4a3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:19.713288 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 683/1370] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:43:19.757124 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfe2d1-0ea6-49a8-8b1b-4664770f4c0b None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:19.757414 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfe2d1-0ea6-49a8-8b1b-4664770f4c0b None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:19.757690 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfe2d1-0ea6-49a8-8b1b-4664770f4c0b None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:19.759605 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 688/1371] 10.222.0.31 () {54 vars in 961 bytes} [Mon Jan 10 17:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:19.765146 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48c1f3-a4e5-437f-bac0-f6f9ff021ddb None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:19.765546 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48c1f3-a4e5-437f-bac0-f6f9ff021ddb None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:19.765926 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48c1f3-a4e5-437f-bac0-f6f9ff021ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:19.816399 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-fd48c1f3-a4e5-437f-bac0-f6f9ff021ddb None None] MFA Rules not processed for user `877acd6448214ef893d119e3b1043402`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:19.817632 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-fd48c1f3-a4e5-437f-bac0-f6f9ff021ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:19.897726 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 684/1372] 10.222.0.31 () {58 vars in 1058 bytes} [Mon Jan 10 17:43:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:43:19.906112 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfe2d1-0ea6-49a8-8b1b-4664770f4c0b None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:43:19.920514 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfe2d1-0ea6-49a8-8b1b-4664770f4c0b None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:43:19.929084 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10be04-8b91-42ff-a5b3-238d4cbff62e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:43:19.929808 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10be04-8b91-42ff-a5b3-238d4cbff62e service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:19.930192 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10be04-8b91-42ff-a5b3-238d4cbff62e service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:19.930592 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10be04-8b91-42ff-a5b3-238d4cbff62e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:19.941079 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10be04-8b91-42ff-a5b3-238d4cbff62e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:43:19.942773 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10be04-8b91-42ff-a5b3-238d4cbff62e service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:43:19.953315 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 689/1373] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:43:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:43:22.536598 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27ddf7-1b2c-4914-b7d4-00856b62781e None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:22.537195 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27ddf7-1b2c-4914-b7d4-00856b62781e None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:22.537195 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27ddf7-1b2c-4914-b7d4-00856b62781e None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:22.539051 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 685/1374] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:43:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:22.544032 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cf95f-421a-47d2-a993-a8296b5e1053 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:22.544434 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cf95f-421a-47d2-a993-a8296b5e1053 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:22.544739 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cf95f-421a-47d2-a993-a8296b5e1053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:22.562667 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-9e5cf95f-421a-47d2-a993-a8296b5e1053 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:22.563786 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-9e5cf95f-421a-47d2-a993-a8296b5e1053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:22.571453 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 690/1375] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:43:22.616394 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27ddf7-1b2c-4914-b7d4-00856b62781e None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:43:22.630783 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27ddf7-1b2c-4914-b7d4-00856b62781e None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:43:22.636289 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f6f08-cb35-4f68-9257-c9292ebf175a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:43:22.636951 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f6f08-cb35-4f68-9257-c9292ebf175a service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:22.637236 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f6f08-cb35-4f68-9257-c9292ebf175a service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:22.637540 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f6f08-cb35-4f68-9257-c9292ebf175a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:22.646835 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f6f08-cb35-4f68-9257-c9292ebf175a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:43:22.648617 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f6f08-cb35-4f68-9257-c9292ebf175a service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:43:22.658760 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 686/1376] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:43:25.345954 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8975f4-7cc2-433f-b16a-318250966ab7 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:25.346454 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8975f4-7cc2-433f-b16a-318250966ab7 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:25.346454 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8975f4-7cc2-433f-b16a-318250966ab7 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:25.348189 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 691/1377] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:25.353569 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4ae3a-75e8-4cd6-92f6-3350178276c6 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:25.353994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4ae3a-75e8-4cd6-92f6-3350178276c6 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:25.354109 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4ae3a-75e8-4cd6-92f6-3350178276c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:25.372462 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-dee4ae3a-75e8-4cd6-92f6-3350178276c6 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:25.373737 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-dee4ae3a-75e8-4cd6-92f6-3350178276c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:25.382571 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 687/1378] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:43:25.430376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed9d11-bc65-4743-9f28-060f66df2854 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:25.430376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed9d11-bc65-4743-9f28-060f66df2854 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:25.430686 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed9d11-bc65-4743-9f28-060f66df2854 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:25.432748 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 692/1379] 10.222.0.31 () {54 vars in 961 bytes} [Mon Jan 10 17:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:25.438847 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73210752-f9ce-4aba-85f4-fb2d303bc4c4 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:25.439204 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73210752-f9ce-4aba-85f4-fb2d303bc4c4 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:25.439525 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73210752-f9ce-4aba-85f4-fb2d303bc4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:25.465046 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-73210752-f9ce-4aba-85f4-fb2d303bc4c4 None None] MFA Rules not processed for user `877acd6448214ef893d119e3b1043402`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:25.466220 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-73210752-f9ce-4aba-85f4-fb2d303bc4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:25.475435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 688/1380] 10.222.0.31 () {58 vars in 1058 bytes} [Mon Jan 10 17:43:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:43:25.483645 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed9d11-bc65-4743-9f28-060f66df2854 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:43:25.497950 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed9d11-bc65-4743-9f28-060f66df2854 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:43:25.503421 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680e1d1-a40c-4d47-a98e-b70ba4ba80fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:43:25.504130 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680e1d1-a40c-4d47-a98e-b70ba4ba80fe service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:25.504479 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680e1d1-a40c-4d47-a98e-b70ba4ba80fe service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:25.504819 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680e1d1-a40c-4d47-a98e-b70ba4ba80fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:25.512894 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680e1d1-a40c-4d47-a98e-b70ba4ba80fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:43:25.514597 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680e1d1-a40c-4d47-a98e-b70ba4ba80fe service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:43:25.523999 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 693/1381] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:43:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:43:27.597306 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a59e5-b35d-49d8-83c8-05c7a2c68b86 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:27.598163 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a59e5-b35d-49d8-83c8-05c7a2c68b86 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:27.598618 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a59e5-b35d-49d8-83c8-05c7a2c68b86 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:27.600676 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 689/1382] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:43:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:27.607373 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46083e6-7b28-4a17-a34d-6a72badc70e2 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:27.608236 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46083e6-7b28-4a17-a34d-6a72badc70e2 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:27.608679 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46083e6-7b28-4a17-a34d-6a72badc70e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:27.626990 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-f46083e6-7b28-4a17-a34d-6a72badc70e2 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:27.628416 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f46083e6-7b28-4a17-a34d-6a72badc70e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:27.636521 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 694/1383] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:43:27.691214 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922ef0c-ba8c-44a0-b6de-eecc2854b05c None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:27.691402 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922ef0c-ba8c-44a0-b6de-eecc2854b05c None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:27.691668 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922ef0c-ba8c-44a0-b6de-eecc2854b05c None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:27.693676 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 690/1384] 10.222.0.31 () {54 vars in 963 bytes} [Mon Jan 10 17:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:27.698648 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6885b-e6b2-4b9b-b850-09482d13e462 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:27.699327 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6885b-e6b2-4b9b-b850-09482d13e462 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:27.699703 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6885b-e6b2-4b9b-b850-09482d13e462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:27.761122 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-3dc6885b-e6b2-4b9b-b850-09482d13e462 None None] MFA Rules not processed for user `955fd3e0d82f416c99001bdc7f129017`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:27.762325 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-3dc6885b-e6b2-4b9b-b850-09482d13e462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:27.828174 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 695/1385] 10.222.0.31 () {58 vars in 1060 bytes} [Mon Jan 10 17:43:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:43:27.835764 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922ef0c-ba8c-44a0-b6de-eecc2854b05c None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:43:27.846341 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922ef0c-ba8c-44a0-b6de-eecc2854b05c None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:43:27.850014 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43e0e7-7e3c-45ce-8f2c-3df02f23b2db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:43:27.850651 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43e0e7-7e3c-45ce-8f2c-3df02f23b2db service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:27.850930 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43e0e7-7e3c-45ce-8f2c-3df02f23b2db service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:27.851203 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43e0e7-7e3c-45ce-8f2c-3df02f23b2db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:27.860308 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43e0e7-7e3c-45ce-8f2c-3df02f23b2db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:43:27.861780 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43e0e7-7e3c-45ce-8f2c-3df02f23b2db service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:43:27.871852 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 691/1386] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:43:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:43:28.012828 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db019008-fd23-4c15-81b7-5647f9ef0b37 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:28.013243 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db019008-fd23-4c15-81b7-5647f9ef0b37 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:28.013502 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db019008-fd23-4c15-81b7-5647f9ef0b37 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:28.015455 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 696/1387] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:43:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:28.021292 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0554e8-2a6b-4a10-9d07-6358028b575d None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:28.021593 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0554e8-2a6b-4a10-9d07-6358028b575d None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:28.021873 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0554e8-2a6b-4a10-9d07-6358028b575d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:28.040132 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-fc0554e8-2a6b-4a10-9d07-6358028b575d None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:28.041355 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-fc0554e8-2a6b-4a10-9d07-6358028b575d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:28.049969 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 692/1388] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:43:28.095194 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db019008-fd23-4c15-81b7-5647f9ef0b37 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:43:28.110725 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db019008-fd23-4c15-81b7-5647f9ef0b37 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:43:28.116421 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab257e3f-2d63-4027-ad50-f1d16a0659c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:43:28.117100 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab257e3f-2d63-4027-ad50-f1d16a0659c3 service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:28.117387 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab257e3f-2d63-4027-ad50-f1d16a0659c3 service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:28.117665 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab257e3f-2d63-4027-ad50-f1d16a0659c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:28.126297 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab257e3f-2d63-4027-ad50-f1d16a0659c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:43:28.127878 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab257e3f-2d63-4027-ad50-f1d16a0659c3 service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:43:28.140120 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 697/1389] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:43:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:43:30.576451 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78303fb-930d-44a1-9fcd-958c1a75df29 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:30.576986 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78303fb-930d-44a1-9fcd-958c1a75df29 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:30.576986 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78303fb-930d-44a1-9fcd-958c1a75df29 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:30.578839 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 693/1390] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:43:30.584244 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da388b-d514-494b-b42c-aa142f6dfbb5 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:30.584661 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da388b-d514-494b-b42c-aa142f6dfbb5 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:30.584772 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da388b-d514-494b-b42c-aa142f6dfbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:30.603554 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-b3da388b-d514-494b-b42c-aa142f6dfbb5 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:30.604748 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b3da388b-d514-494b-b42c-aa142f6dfbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:30.613894 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 698/1391] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:43:30.660185 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78303fb-930d-44a1-9fcd-958c1a75df29 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:43:30.674780 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78303fb-930d-44a1-9fcd-958c1a75df29 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:43:30.681865 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18195df5-da51-4cfa-a5b3-6be44e016b96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:43:30.682519 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18195df5-da51-4cfa-a5b3-6be44e016b96 service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:30.682798 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18195df5-da51-4cfa-a5b3-6be44e016b96 service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:30.683069 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18195df5-da51-4cfa-a5b3-6be44e016b96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:30.693481 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18195df5-da51-4cfa-a5b3-6be44e016b96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:43:30.695319 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18195df5-da51-4cfa-a5b3-6be44e016b96 service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:43:30.710615 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 694/1392] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:43:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:43:33.150336 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97f4d-600e-489f-822e-c4fb4c2bcfd0 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:33.150833 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97f4d-600e-489f-822e-c4fb4c2bcfd0 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:33.150833 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97f4d-600e-489f-822e-c4fb4c2bcfd0 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:33.152630 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 699/1393] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:43:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:33.158193 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db578c47-da69-4600-8034-03e8fce45d8b None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:33.158597 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db578c47-da69-4600-8034-03e8fce45d8b None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:33.158739 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db578c47-da69-4600-8034-03e8fce45d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:33.177736 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-db578c47-da69-4600-8034-03e8fce45d8b None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:33.178917 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-db578c47-da69-4600-8034-03e8fce45d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:33.188069 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 695/1394] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:43:33.234867 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c97f4d-600e-489f-822e-c4fb4c2bcfd0 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:43:33.250396 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c97f4d-600e-489f-822e-c4fb4c2bcfd0 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:43:33.256386 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7dcc3-8022-450c-8173-0cc227df12bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:43:33.257309 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7dcc3-8022-450c-8173-0cc227df12bc service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:33.257762 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7dcc3-8022-450c-8173-0cc227df12bc service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:33.258226 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7dcc3-8022-450c-8173-0cc227df12bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:33.267348 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7dcc3-8022-450c-8173-0cc227df12bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:43:33.269248 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7dcc3-8022-450c-8173-0cc227df12bc service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:43:33.279030 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 700/1395] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:43:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:43:35.714367 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00422653-8337-4716-8df6-e1256a02c945 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:35.715579 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00422653-8337-4716-8df6-e1256a02c945 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:35.716132 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00422653-8337-4716-8df6-e1256a02c945 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:35.718869 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 696/1396] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:43:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:35.726593 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee441b8-0d8c-4345-aa85-daedcac3c9b7 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:35.727179 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee441b8-0d8c-4345-aa85-daedcac3c9b7 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:35.727179 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee441b8-0d8c-4345-aa85-daedcac3c9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:35.747098 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-bee441b8-0d8c-4345-aa85-daedcac3c9b7 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:35.748363 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-bee441b8-0d8c-4345-aa85-daedcac3c9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:35.756336 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 701/1397] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:43:35.799954 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00422653-8337-4716-8df6-e1256a02c945 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:43:35.815453 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00422653-8337-4716-8df6-e1256a02c945 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:43:35.821307 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43422214-9605-40bc-9d19-988c446f6409 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:43:35.821968 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43422214-9605-40bc-9d19-988c446f6409 service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:35.822242 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43422214-9605-40bc-9d19-988c446f6409 service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:35.822509 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43422214-9605-40bc-9d19-988c446f6409 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:35.831042 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43422214-9605-40bc-9d19-988c446f6409 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:43:35.832656 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43422214-9605-40bc-9d19-988c446f6409 service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:43:35.842170 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 697/1398] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:43:38.376282 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8f3e6-1df4-4f8f-aca9-11983c55d642 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:38.376904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8f3e6-1df4-4f8f-aca9-11983c55d642 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:38.376904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8f3e6-1df4-4f8f-aca9-11983c55d642 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:38.378848 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 702/1399] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:43:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:38.384891 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e132b44-1562-49ee-b605-3e480ff78a65 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:38.385357 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e132b44-1562-49ee-b605-3e480ff78a65 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:38.385644 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e132b44-1562-49ee-b605-3e480ff78a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:38.409898 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-8e132b44-1562-49ee-b605-3e480ff78a65 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:38.411522 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-8e132b44-1562-49ee-b605-3e480ff78a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:38.420912 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 698/1400] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:43:38.467322 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8f3e6-1df4-4f8f-aca9-11983c55d642 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:43:38.483418 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8f3e6-1df4-4f8f-aca9-11983c55d642 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:43:38.489113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c40cb-0242-49b4-a21e-9e4d5ddfd36c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:43:38.489793 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c40cb-0242-49b4-a21e-9e4d5ddfd36c service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:38.490075 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c40cb-0242-49b4-a21e-9e4d5ddfd36c service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:38.490358 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c40cb-0242-49b4-a21e-9e4d5ddfd36c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:38.499320 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c40cb-0242-49b4-a21e-9e4d5ddfd36c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:43:38.501012 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c40cb-0242-49b4-a21e-9e4d5ddfd36c service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:43:38.511226 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 703/1401] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:43:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:43:41.025875 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c88aea-842b-4503-a764-be4bef051d43 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:41.026443 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c88aea-842b-4503-a764-be4bef051d43 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:41.026443 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c88aea-842b-4503-a764-be4bef051d43 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:41.028232 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 699/1402] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:43:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:41.033569 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b961b-c86e-40d2-ab07-004d709df700 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:41.034028 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b961b-c86e-40d2-ab07-004d709df700 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:41.034118 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b961b-c86e-40d2-ab07-004d709df700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:41.052203 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-c58b961b-c86e-40d2-ab07-004d709df700 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:41.053410 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-c58b961b-c86e-40d2-ab07-004d709df700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:41.061739 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 704/1403] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:43:41.107199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c88aea-842b-4503-a764-be4bef051d43 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:43:41.123404 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c88aea-842b-4503-a764-be4bef051d43 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:43:41.129489 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076af470-85f6-4449-9da1-3115d6982c0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:43:41.130138 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076af470-85f6-4449-9da1-3115d6982c0c service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:41.130425 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076af470-85f6-4449-9da1-3115d6982c0c service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:41.130700 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076af470-85f6-4449-9da1-3115d6982c0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:41.140261 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076af470-85f6-4449-9da1-3115d6982c0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:43:41.141944 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076af470-85f6-4449-9da1-3115d6982c0c service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:43:41.152242 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 700/1404] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:43:42.801913 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca9de7-1972-414a-a37f-9bdd7d602c3b None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:42.802493 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca9de7-1972-414a-a37f-9bdd7d602c3b None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:42.802493 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca9de7-1972-414a-a37f-9bdd7d602c3b None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:42.804235 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 705/1405] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:42.809568 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888320d-a09a-4f28-9800-63faf866c17d None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:42.810017 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888320d-a09a-4f28-9800-63faf866c17d None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:42.810119 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888320d-a09a-4f28-9800-63faf866c17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:42.828149 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-3888320d-a09a-4f28-9800-63faf866c17d None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:42.829339 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-3888320d-a09a-4f28-9800-63faf866c17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:42.837457 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 701/1406] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:43:42.894058 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbaf01-07df-4a73-af83-d02feb0a53cc None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:42.894337 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbaf01-07df-4a73-af83-d02feb0a53cc None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:42.894611 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbaf01-07df-4a73-af83-d02feb0a53cc None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:42.896533 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 706/1407] 10.222.0.31 () {54 vars in 962 bytes} [Mon Jan 10 17:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:42.902351 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f9eff-5964-46ce-9bc5-91e4451b967d None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:42.902607 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f9eff-5964-46ce-9bc5-91e4451b967d None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:42.902912 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f9eff-5964-46ce-9bc5-91e4451b967d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:42.953074 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-ff5f9eff-5964-46ce-9bc5-91e4451b967d None None] MFA Rules not processed for user `15232a1930bc43e8bb5aa7310a709056`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:42.954264 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-ff5f9eff-5964-46ce-9bc5-91e4451b967d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:43.015417 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 702/1408] 10.222.0.31 () {58 vars in 1059 bytes} [Mon Jan 10 17:43:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:43:43.023116 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbaf01-07df-4a73-af83-d02feb0a53cc None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:43:43.034231 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbaf01-07df-4a73-af83-d02feb0a53cc None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:43:43.037725 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848efe6-c284-4a56-bfe5-e469d0af7dfd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15232a1930bc43e8bb5aa7310a709056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:43:43.038348 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848efe6-c284-4a56-bfe5-e469d0af7dfd service glance] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:43.038621 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848efe6-c284-4a56-bfe5-e469d0af7dfd service glance] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:43.038889 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848efe6-c284-4a56-bfe5-e469d0af7dfd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:43.047652 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848efe6-c284-4a56-bfe5-e469d0af7dfd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:43:43.049095 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848efe6-c284-4a56-bfe5-e469d0af7dfd service glance] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:43:43.058444 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 707/1409] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:43:43.471856 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31ba75-2fe8-4874-b286-7ad2bea760b1 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:43.472207 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31ba75-2fe8-4874-b286-7ad2bea760b1 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:43.472546 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31ba75-2fe8-4874-b286-7ad2bea760b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:43.519641 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-5b31ba75-2fe8-4874-b286-7ad2bea760b1 None None] MFA Rules not processed for user `3b3dbe4735a54de1825abc28ecf00b84`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:43.521007 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-5b31ba75-2fe8-4874-b286-7ad2bea760b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:43.548515 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71d3e5-7577-4506-bbe5-ccdb316e8bce None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:43.548773 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71d3e5-7577-4506-bbe5-ccdb316e8bce None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:43.549111 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71d3e5-7577-4506-bbe5-ccdb316e8bce None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:43.550949 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 708/1410] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:43:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:43.555849 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166b7cd-4162-41b0-b9b4-999cfcb3b71c None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:43.556125 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166b7cd-4162-41b0-b9b4-999cfcb3b71c None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:43.556574 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166b7cd-4162-41b0-b9b4-999cfcb3b71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:43.574024 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-b166b7cd-4162-41b0-b9b4-999cfcb3b71c None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:43.575203 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b166b7cd-4162-41b0-b9b4-999cfcb3b71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:43.583051 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 709/1411] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:43:43.583286 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 703/1412] 10.222.0.31 () {58 vars in 1009 bytes} [Mon Jan 10 17:43:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:43:43.627730 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31ba75-2fe8-4874-b286-7ad2bea760b1 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:43:43.628249 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c0ffe-0f6c-49ff-be42-32a6ef2261ca None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:43.628539 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c0ffe-0f6c-49ff-be42-32a6ef2261ca None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:43.628807 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c0ffe-0f6c-49ff-be42-32a6ef2261ca None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:43.630865 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 710/1413] 10.222.0.31 () {54 vars in 942 bytes} [Mon Jan 10 17:43:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:43.637075 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e434f80-3b23-4106-838d-adc96838cfd7 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:43.637364 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e434f80-3b23-4106-838d-adc96838cfd7 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:43.637641 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e434f80-3b23-4106-838d-adc96838cfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:43.644669 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31ba75-2fe8-4874-b286-7ad2bea760b1 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:43:43.650683 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13358a2c-d4f1-45d5-8531-773752361cd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:43:43.651331 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13358a2c-d4f1-45d5-8531-773752361cd6 service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:43.651605 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13358a2c-d4f1-45d5-8531-773752361cd6 service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:43.651873 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13358a2c-d4f1-45d5-8531-773752361cd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:43.659955 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13358a2c-d4f1-45d5-8531-773752361cd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:43:43.661559 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13358a2c-d4f1-45d5-8531-773752361cd6 service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:43:43.670565 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 704/1414] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:43:43.686083 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-1e434f80-3b23-4106-838d-adc96838cfd7 None None] MFA Rules not processed for user `0257a86ce85b4b4386cde32c8ed4b39a`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:43.687323 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-1e434f80-3b23-4106-838d-adc96838cfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:43.765413 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 711/1415] 10.222.0.31 () {58 vars in 1039 bytes} [Mon Jan 10 17:43:43 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:43:43.775871 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13358a2c-d4f1-45d5-8531-773752361cd6 service nova] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:43:43.787811 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13358a2c-d4f1-45d5-8531-773752361cd6 service nova] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:43:43.792950 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6adf8b-fcbc-4e82-961f-7d0f662b9dc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257a86ce85b4b4386cde32c8ed4b39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:43:43.793702 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6adf8b-fcbc-4e82-961f-7d0f662b9dc6 service swift] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:43.794053 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6adf8b-fcbc-4e82-961f-7d0f662b9dc6 service swift] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:43.794413 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6adf8b-fcbc-4e82-961f-7d0f662b9dc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:43.803808 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6adf8b-fcbc-4e82-961f-7d0f662b9dc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:43:43.805637 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6adf8b-fcbc-4e82-961f-7d0f662b9dc6 service swift] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:43:43.815110 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 705/1416] 10.222.0.31 () {60 vars in 1384 bytes} [Mon Jan 10 17:43:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:43:46.092346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc77a31-e96e-45ac-968e-2a876ee1f73e None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:46.092943 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc77a31-e96e-45ac-968e-2a876ee1f73e None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:46.092943 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc77a31-e96e-45ac-968e-2a876ee1f73e None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:46.094594 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 712/1417] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:46.099738 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aadeae-ff97-46ad-b224-84cf889b007d None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:46.100177 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aadeae-ff97-46ad-b224-84cf889b007d None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:46.100281 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aadeae-ff97-46ad-b224-84cf889b007d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:46.119293 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-d3aadeae-ff97-46ad-b224-84cf889b007d None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:46.120754 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-d3aadeae-ff97-46ad-b224-84cf889b007d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:46.129134 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 706/1418] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:43:46.204996 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc77a31-e96e-45ac-968e-2a876ee1f73e None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:43:46.226311 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc77a31-e96e-45ac-968e-2a876ee1f73e None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:43:46.236513 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc56356-cd74-4394-bfc2-cb579be80248 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:43:46.237229 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc56356-cd74-4394-bfc2-cb579be80248 service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:46.237502 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc56356-cd74-4394-bfc2-cb579be80248 service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:46.237884 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc56356-cd74-4394-bfc2-cb579be80248 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:46.247668 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc56356-cd74-4394-bfc2-cb579be80248 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:43:46.249331 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc56356-cd74-4394-bfc2-cb579be80248 service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:43:46.259819 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 713/1419] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:43:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:43:48.711924 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403cbab-0e70-453f-b896-115456ddfc2a None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:48.712525 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403cbab-0e70-453f-b896-115456ddfc2a None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:48.712525 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403cbab-0e70-453f-b896-115456ddfc2a None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:48.718091 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 707/1420] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:43:48.720172 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7f3e3-5a91-4e94-804d-8975e2ef5237 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:48.720616 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7f3e3-5a91-4e94-804d-8975e2ef5237 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:48.720844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7f3e3-5a91-4e94-804d-8975e2ef5237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:48.743107 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-a5a7f3e3-5a91-4e94-804d-8975e2ef5237 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:43:48.744395 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a5a7f3e3-5a91-4e94-804d-8975e2ef5237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:43:48.764239 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 714/1421] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:43:48.800410 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403cbab-0e70-453f-b896-115456ddfc2a None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:43:48.814619 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403cbab-0e70-453f-b896-115456ddfc2a None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:43:48.820621 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9d11c-ad1b-4c63-90f2-88b9a9bf5e1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:43:48.821310 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9d11c-ad1b-4c63-90f2-88b9a9bf5e1e service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:43:48.821595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9d11c-ad1b-4c63-90f2-88b9a9bf5e1e service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:43:48.821866 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9d11c-ad1b-4c63-90f2-88b9a9bf5e1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:43:48.830861 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9d11c-ad1b-4c63-90f2-88b9a9bf5e1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:43:48.832475 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9d11c-ad1b-4c63-90f2-88b9a9bf5e1e service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:43:48.842255 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 708/1422] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:44:06.832985 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206da14e-47d7-4b07-a2a3-10ed710c7960 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:06.833655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206da14e-47d7-4b07-a2a3-10ed710c7960 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:06.833655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206da14e-47d7-4b07-a2a3-10ed710c7960 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:06.836035 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 715/1423] 10.222.0.31 () {54 vars in 918 bytes} [Mon Jan 10 17:44:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:44:06.841748 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0908ec-16ff-47f7-b166-42c7368935fb None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:06.842442 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0908ec-16ff-47f7-b166-42c7368935fb None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:06.842442 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0908ec-16ff-47f7-b166-42c7368935fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:06.862452 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-4c0908ec-16ff-47f7-b166-42c7368935fb None None] MFA Rules not processed for user `3a3b8e620cfd42fe993c73dc83a246be`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:44:06.863661 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-4c0908ec-16ff-47f7-b166-42c7368935fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:44:06.873919 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 709/1424] 10.222.0.31 () {58 vars in 1015 bytes} [Mon Jan 10 17:44:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:44:06.888497 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e58e0-85a2-4c26-be39-c3323ad2bbee None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:06.888784 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e58e0-85a2-4c26-be39-c3323ad2bbee None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:06.889095 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e58e0-85a2-4c26-be39-c3323ad2bbee None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:06.890894 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 716/1425] 10.222.0.31 () {54 vars in 918 bytes} [Mon Jan 10 17:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:44:06.896468 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba4010-263b-4c55-ba39-d033368de665 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:06.896826 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba4010-263b-4c55-ba39-d033368de665 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:06.897274 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba4010-263b-4c55-ba39-d033368de665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:06.919156 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-23ba4010-263b-4c55-ba39-d033368de665 None None] MFA Rules not processed for user `877acd6448214ef893d119e3b1043402`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:44:06.920342 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-23ba4010-263b-4c55-ba39-d033368de665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:44:06.931103 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 710/1426] 10.222.0.31 () {58 vars in 1015 bytes} [Mon Jan 10 17:44:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:44:09.718556 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39304ca7-56ef-4f43-85ea-f237e019681d None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:09.719102 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39304ca7-56ef-4f43-85ea-f237e019681d None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:09.719102 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39304ca7-56ef-4f43-85ea-f237e019681d None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:09.720778 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 717/1427] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 17:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:44:09.727698 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3d874-737c-4788-97a1-8e6a469d6d57 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:09.728199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3d874-737c-4788-97a1-8e6a469d6d57 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:09.728199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3d874-737c-4788-97a1-8e6a469d6d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:09.747977 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-9cb3d874-737c-4788-97a1-8e6a469d6d57 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:44:09.749194 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-9cb3d874-737c-4788-97a1-8e6a469d6d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:44:09.757472 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 711/1428] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 17:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:44:09.803844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39304ca7-56ef-4f43-85ea-f237e019681d None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:44:09.819056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39304ca7-56ef-4f43-85ea-f237e019681d None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:44:09.824718 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77297994-3364-447d-ae89-1800fc36f572 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:44:09.825413 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77297994-3364-447d-ae89-1800fc36f572 service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:09.825806 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77297994-3364-447d-ae89-1800fc36f572 service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:09.826080 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77297994-3364-447d-ae89-1800fc36f572 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:09.834334 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77297994-3364-447d-ae89-1800fc36f572 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:44:09.835939 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77297994-3364-447d-ae89-1800fc36f572 service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:44:09.845581 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 718/1429] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:44:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:44:11.454446 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae498e-44af-481a-8a04-d10d54068483 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:11.455068 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae498e-44af-481a-8a04-d10d54068483 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:11.455068 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae498e-44af-481a-8a04-d10d54068483 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:11.456779 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 712/1430] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 17:44:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:44:11.461935 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ce94e-8bd8-46d4-ab6d-cb892a98798c None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:11.462393 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ce94e-8bd8-46d4-ab6d-cb892a98798c None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:11.462488 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ce94e-8bd8-46d4-ab6d-cb892a98798c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:11.482037 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-914ce94e-8bd8-46d4-ab6d-cb892a98798c None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:44:11.483216 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-914ce94e-8bd8-46d4-ab6d-cb892a98798c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:44:11.492214 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 719/1431] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 17:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:44:11.653743 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae498e-44af-481a-8a04-d10d54068483 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:44:11.672775 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae498e-44af-481a-8a04-d10d54068483 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:44:11.683406 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c88ae-acee-4432-b28a-6c0e4c7c51db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:44:11.684049 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c88ae-acee-4432-b28a-6c0e4c7c51db service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:11.684329 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c88ae-acee-4432-b28a-6c0e4c7c51db service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:11.684600 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c88ae-acee-4432-b28a-6c0e4c7c51db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:11.693628 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c88ae-acee-4432-b28a-6c0e4c7c51db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:44:11.695261 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c88ae-acee-4432-b28a-6c0e4c7c51db service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:44:11.705159 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 713/1432] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:44:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:44:13.267798 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184227f1-c155-4421-b127-87f11bf89fc9 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:13.268405 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184227f1-c155-4421-b127-87f11bf89fc9 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:13.268405 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184227f1-c155-4421-b127-87f11bf89fc9 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:13.270146 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 720/1433] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 17:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:44:13.275684 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dec0dc-a032-4604-a43b-24f40463e912 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:13.276102 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dec0dc-a032-4604-a43b-24f40463e912 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:13.276220 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dec0dc-a032-4604-a43b-24f40463e912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:13.296052 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-17dec0dc-a032-4604-a43b-24f40463e912 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:44:13.297253 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-17dec0dc-a032-4604-a43b-24f40463e912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:44:13.305778 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 714/1434] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 17:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:44:13.459132 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184227f1-c155-4421-b127-87f11bf89fc9 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:44:13.478319 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184227f1-c155-4421-b127-87f11bf89fc9 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:44:13.484529 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff464d-a83f-4f16-946d-30b599e6fe36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:44:13.485210 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff464d-a83f-4f16-946d-30b599e6fe36 service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:13.485497 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff464d-a83f-4f16-946d-30b599e6fe36 service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:13.485783 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff464d-a83f-4f16-946d-30b599e6fe36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:13.493971 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff464d-a83f-4f16-946d-30b599e6fe36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:44:13.495558 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff464d-a83f-4f16-946d-30b599e6fe36 service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:44:13.504928 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 721/1435] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:44:15.039090 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6c238-cb37-4777-a4c2-43d7286ef8ce None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:15.039943 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6c238-cb37-4777-a4c2-43d7286ef8ce None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:15.039943 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6c238-cb37-4777-a4c2-43d7286ef8ce None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:15.042850 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 715/1436] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 17:44:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:44:15.051271 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5b68d-2da7-43a4-81d2-91bb9c606c52 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:15.051685 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5b68d-2da7-43a4-81d2-91bb9c606c52 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:15.051908 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5b68d-2da7-43a4-81d2-91bb9c606c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:15.073382 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-e3d5b68d-2da7-43a4-81d2-91bb9c606c52 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:44:15.074564 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-e3d5b68d-2da7-43a4-81d2-91bb9c606c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:44:15.082723 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 722/1437] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 17:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:44:15.234387 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6c238-cb37-4777-a4c2-43d7286ef8ce None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:44:15.249812 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6c238-cb37-4777-a4c2-43d7286ef8ce None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:44:15.255692 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd5ea3-b50c-4e11-9323-3acc9b1e1979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:44:15.256331 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd5ea3-b50c-4e11-9323-3acc9b1e1979 service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:15.256617 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd5ea3-b50c-4e11-9323-3acc9b1e1979 service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:15.256891 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd5ea3-b50c-4e11-9323-3acc9b1e1979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:15.265641 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd5ea3-b50c-4e11-9323-3acc9b1e1979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:44:15.267246 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd5ea3-b50c-4e11-9323-3acc9b1e1979 service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:44:15.277220 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 716/1438] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:44:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:44:16.826735 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb3782-9b5a-4126-8f04-8bda147e0278 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:16.827551 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb3782-9b5a-4126-8f04-8bda147e0278 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:16.827680 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb3782-9b5a-4126-8f04-8bda147e0278 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:16.830308 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 723/1439] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 17:44:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:44:16.835345 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1afb6-5391-45ea-8b23-edc8171e47d3 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:16.835769 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1afb6-5391-45ea-8b23-edc8171e47d3 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:16.835881 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1afb6-5391-45ea-8b23-edc8171e47d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:16.861631 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-4fd1afb6-5391-45ea-8b23-edc8171e47d3 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:44:16.862838 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-4fd1afb6-5391-45ea-8b23-edc8171e47d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:44:16.872516 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 717/1440] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 17:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:44:17.028470 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb3782-9b5a-4126-8f04-8bda147e0278 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:44:17.050194 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb3782-9b5a-4126-8f04-8bda147e0278 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:44:17.056157 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbf60d-e4ea-4fa1-bcac-540b767c596c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:44:17.056790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbf60d-e4ea-4fa1-bcac-540b767c596c service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:17.057101 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbf60d-e4ea-4fa1-bcac-540b767c596c service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:17.057373 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbf60d-e4ea-4fa1-bcac-540b767c596c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:17.065827 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbf60d-e4ea-4fa1-bcac-540b767c596c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:44:17.067398 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbf60d-e4ea-4fa1-bcac-540b767c596c service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:44:17.076943 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 724/1441] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:44:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:44:18.564753 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58735213-779f-40a0-943f-1d08defa7636 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:18.565367 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58735213-779f-40a0-943f-1d08defa7636 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:18.565367 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58735213-779f-40a0-943f-1d08defa7636 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:18.567142 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 718/1442] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 17:44:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:44:18.572328 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2376ac-0e6f-4bf5-9109-11e046dbbb32 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:18.572768 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2376ac-0e6f-4bf5-9109-11e046dbbb32 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:18.572900 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2376ac-0e6f-4bf5-9109-11e046dbbb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:18.592721 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-1b2376ac-0e6f-4bf5-9109-11e046dbbb32 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:44:18.593977 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-1b2376ac-0e6f-4bf5-9109-11e046dbbb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:44:18.602179 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 725/1443] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 17:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:44:18.754244 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58735213-779f-40a0-943f-1d08defa7636 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:44:18.769540 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58735213-779f-40a0-943f-1d08defa7636 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:44:18.775725 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccd290-241f-411d-b5af-b52c10cd1ef6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:44:18.776353 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccd290-241f-411d-b5af-b52c10cd1ef6 service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:18.776632 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccd290-241f-411d-b5af-b52c10cd1ef6 service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:18.776927 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccd290-241f-411d-b5af-b52c10cd1ef6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:18.785774 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccd290-241f-411d-b5af-b52c10cd1ef6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:44:18.787389 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccd290-241f-411d-b5af-b52c10cd1ef6 service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:44:18.796778 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 719/1444] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:44:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:44:20.294614 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763f369-8aeb-4b16-8462-6892011746c4 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:20.295521 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763f369-8aeb-4b16-8462-6892011746c4 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:20.295521 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763f369-8aeb-4b16-8462-6892011746c4 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:20.298527 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 726/1445] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 17:44:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:44:20.304553 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e66ce2-5d46-4810-a8bb-b016933cde8f None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:20.305276 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e66ce2-5d46-4810-a8bb-b016933cde8f None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:20.305470 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e66ce2-5d46-4810-a8bb-b016933cde8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:20.327070 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b5e66ce2-5d46-4810-a8bb-b016933cde8f None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:44:20.328261 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b5e66ce2-5d46-4810-a8bb-b016933cde8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:44:20.337225 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 720/1446] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 17:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:44:20.489257 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763f369-8aeb-4b16-8462-6892011746c4 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:44:20.513928 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763f369-8aeb-4b16-8462-6892011746c4 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:44:20.520286 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be1bd6-6127-4c8d-848b-5d6261e268ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:44:20.520943 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be1bd6-6127-4c8d-848b-5d6261e268ce service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:20.521227 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be1bd6-6127-4c8d-848b-5d6261e268ce service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:20.521500 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be1bd6-6127-4c8d-848b-5d6261e268ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:20.530255 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be1bd6-6127-4c8d-848b-5d6261e268ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:44:20.531824 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be1bd6-6127-4c8d-848b-5d6261e268ce service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:44:20.541146 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 727/1447] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:44:22.032433 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40851b77-5a9d-4280-b917-f38b2c1cef05 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:22.033346 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40851b77-5a9d-4280-b917-f38b2c1cef05 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:22.033346 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40851b77-5a9d-4280-b917-f38b2c1cef05 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:22.036172 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 721/1448] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 17:44:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:44:22.041537 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e9362-cf9f-4cc4-b5e8-25d38c5c5ce4 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:22.041988 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e9362-cf9f-4cc4-b5e8-25d38c5c5ce4 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:22.042103 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e9362-cf9f-4cc4-b5e8-25d38c5c5ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:22.060594 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-5d3e9362-cf9f-4cc4-b5e8-25d38c5c5ce4 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:44:22.061825 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-5d3e9362-cf9f-4cc4-b5e8-25d38c5c5ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:44:22.070299 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 728/1449] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 17:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:44:22.230598 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40851b77-5a9d-4280-b917-f38b2c1cef05 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:44:22.250710 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40851b77-5a9d-4280-b917-f38b2c1cef05 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:44:22.261159 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74a91f-609c-4d7f-8b5b-bd62dd2d9baf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:44:22.262150 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74a91f-609c-4d7f-8b5b-bd62dd2d9baf service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:22.262573 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74a91f-609c-4d7f-8b5b-bd62dd2d9baf service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:22.262912 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74a91f-609c-4d7f-8b5b-bd62dd2d9baf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:22.272023 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74a91f-609c-4d7f-8b5b-bd62dd2d9baf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:44:22.273654 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74a91f-609c-4d7f-8b5b-bd62dd2d9baf service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:44:22.283765 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 722/1450] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:44:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:44:23.810111 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c5aa4-3504-42a6-9dc8-c851b992416b None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:23.810958 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c5aa4-3504-42a6-9dc8-c851b992416b None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:23.810958 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c5aa4-3504-42a6-9dc8-c851b992416b None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:23.813183 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 729/1451] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 17:44:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:44:23.819085 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523b5c7-7da6-4b39-8eeb-159a9324cc81 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:23.819608 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523b5c7-7da6-4b39-8eeb-159a9324cc81 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:23.819704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523b5c7-7da6-4b39-8eeb-159a9324cc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:23.839542 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-6523b5c7-7da6-4b39-8eeb-159a9324cc81 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:44:23.840769 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-6523b5c7-7da6-4b39-8eeb-159a9324cc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:44:23.853720 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 723/1452] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 17:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:44:24.016762 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c5aa4-3504-42a6-9dc8-c851b992416b None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:44:24.037640 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c5aa4-3504-42a6-9dc8-c851b992416b None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:44:24.043716 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ef8db-dcce-4f9e-a068-39d4333c4ab5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:44:24.044355 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ef8db-dcce-4f9e-a068-39d4333c4ab5 service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:24.044628 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ef8db-dcce-4f9e-a068-39d4333c4ab5 service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:24.044885 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ef8db-dcce-4f9e-a068-39d4333c4ab5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:24.053592 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ef8db-dcce-4f9e-a068-39d4333c4ab5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:44:24.055184 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ef8db-dcce-4f9e-a068-39d4333c4ab5 service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:44:24.065214 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 730/1453] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:44:26.327929 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8bf8f-3985-4e78-81f2-d860292d6996 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:26.328806 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8bf8f-3985-4e78-81f2-d860292d6996 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:26.328806 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8bf8f-3985-4e78-81f2-d860292d6996 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:26.331733 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 724/1454] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 17:44:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:44:26.339571 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c03e3-3843-46d0-9f0b-79a02a042f02 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:26.340289 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c03e3-3843-46d0-9f0b-79a02a042f02 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:26.340445 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c03e3-3843-46d0-9f0b-79a02a042f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:26.360342 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-3c7c03e3-3843-46d0-9f0b-79a02a042f02 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:44:26.361559 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-3c7c03e3-3843-46d0-9f0b-79a02a042f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:44:26.370794 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 731/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 17:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:44:26.409589 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8bf8f-3985-4e78-81f2-d860292d6996 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:44:26.427743 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8bf8f-3985-4e78-81f2-d860292d6996 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:44:26.434265 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d32bb-ba87-4701-be3d-f75adcc38b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:44:26.435280 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d32bb-ba87-4701-be3d-f75adcc38b99 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:26.435659 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d32bb-ba87-4701-be3d-f75adcc38b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:26.435983 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d32bb-ba87-4701-be3d-f75adcc38b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:26.445926 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d32bb-ba87-4701-be3d-f75adcc38b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:44:26.447367 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d32bb-ba87-4701-be3d-f75adcc38b99 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:44:26.456878 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 725/1456] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:44:28.989474 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc25797-1676-4af3-9a66-c559e434d6b0 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:28.990117 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc25797-1676-4af3-9a66-c559e434d6b0 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:28.990117 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc25797-1676-4af3-9a66-c559e434d6b0 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:28.991721 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 732/1457] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 17:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:44:28.998145 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fd023-3aab-40c6-8894-52107b0852c1 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:28.998860 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fd023-3aab-40c6-8894-52107b0852c1 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:28.999058 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fd023-3aab-40c6-8894-52107b0852c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:29.024064 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-fd6fd023-3aab-40c6-8894-52107b0852c1 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:44:29.025649 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-fd6fd023-3aab-40c6-8894-52107b0852c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:44:29.035500 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 726/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 17:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:44:29.081947 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc25797-1676-4af3-9a66-c559e434d6b0 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:44:29.097436 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc25797-1676-4af3-9a66-c559e434d6b0 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:44:29.101852 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28582d06-958d-4bb6-815c-95f6c06959bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:44:29.102499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28582d06-958d-4bb6-815c-95f6c06959bc service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:29.102780 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28582d06-958d-4bb6-815c-95f6c06959bc service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:29.103056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28582d06-958d-4bb6-815c-95f6c06959bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:29.112594 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28582d06-958d-4bb6-815c-95f6c06959bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:44:29.114066 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28582d06-958d-4bb6-815c-95f6c06959bc service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:44:29.123349 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 733/1459] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:44:31.798676 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ce7a3-f3c7-4853-ab62-c3efb0ec5ccc None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:31.799215 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ce7a3-f3c7-4853-ab62-c3efb0ec5ccc None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:31.799332 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ce7a3-f3c7-4853-ab62-c3efb0ec5ccc None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:31.802109 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 727/1460] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 17:44:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:44:31.812613 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f248b3-4729-4891-99c5-68ae56984ee9 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:31.813152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f248b3-4729-4891-99c5-68ae56984ee9 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:31.813152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f248b3-4729-4891-99c5-68ae56984ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:31.833454 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-e6f248b3-4729-4891-99c5-68ae56984ee9 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:44:31.834680 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-e6f248b3-4729-4891-99c5-68ae56984ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:44:31.844210 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 734/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:44:31.882398 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ce7a3-f3c7-4853-ab62-c3efb0ec5ccc None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:44:31.894456 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ce7a3-f3c7-4853-ab62-c3efb0ec5ccc None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:44:31.898564 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a406f-6872-421c-89a1-f45d452aa078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:44:31.899206 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a406f-6872-421c-89a1-f45d452aa078 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:31.899494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a406f-6872-421c-89a1-f45d452aa078 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:31.900114 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a406f-6872-421c-89a1-f45d452aa078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:31.909128 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a406f-6872-421c-89a1-f45d452aa078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:44:31.910571 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a406f-6872-421c-89a1-f45d452aa078 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:44:31.919830 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 728/1462] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:44:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:44:34.423027 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90712b-568c-4a81-93b7-aee007ce0f7f None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:34.423655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90712b-568c-4a81-93b7-aee007ce0f7f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:34.423655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90712b-568c-4a81-93b7-aee007ce0f7f None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:34.425406 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 735/1463] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 17:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:44:34.433074 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345666f4-0f40-48c4-857c-a24926c1a8a8 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:34.433851 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345666f4-0f40-48c4-857c-a24926c1a8a8 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:34.434021 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345666f4-0f40-48c4-857c-a24926c1a8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:34.453168 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-345666f4-0f40-48c4-857c-a24926c1a8a8 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:44:34.454357 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-345666f4-0f40-48c4-857c-a24926c1a8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:44:34.463591 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 729/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 17:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:44:34.502872 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90712b-568c-4a81-93b7-aee007ce0f7f None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:44:34.518028 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90712b-568c-4a81-93b7-aee007ce0f7f None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:44:34.522779 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef29fca-5679-4451-9d38-08858accc3f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:44:34.523415 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef29fca-5679-4451-9d38-08858accc3f4 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:34.523787 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef29fca-5679-4451-9d38-08858accc3f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:34.524155 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef29fca-5679-4451-9d38-08858accc3f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:34.534655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef29fca-5679-4451-9d38-08858accc3f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:44:34.536080 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef29fca-5679-4451-9d38-08858accc3f4 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:44:34.545576 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 736/1465] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:44:37.027431 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a66b22-204a-427f-88b7-0f192c0bc37d None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:37.027979 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a66b22-204a-427f-88b7-0f192c0bc37d None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:37.027979 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a66b22-204a-427f-88b7-0f192c0bc37d None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:37.029696 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 730/1466] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 17:44:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:44:37.037407 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c6d1e-d9d7-4402-9c9e-4703d49c3681 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:37.038140 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c6d1e-d9d7-4402-9c9e-4703d49c3681 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:37.038332 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c6d1e-d9d7-4402-9c9e-4703d49c3681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:37.059830 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-e45c6d1e-d9d7-4402-9c9e-4703d49c3681 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:44:37.061033 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-e45c6d1e-d9d7-4402-9c9e-4703d49c3681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:44:37.069601 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 737/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 17:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:44:37.110346 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a66b22-204a-427f-88b7-0f192c0bc37d None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:44:37.127329 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a66b22-204a-427f-88b7-0f192c0bc37d None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:44:37.133779 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c360e3-d941-494f-adcd-3f8a2edbb6ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:44:37.134693 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c360e3-d941-494f-adcd-3f8a2edbb6ae service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:37.135074 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c360e3-d941-494f-adcd-3f8a2edbb6ae service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:37.135414 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c360e3-d941-494f-adcd-3f8a2edbb6ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:37.146226 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c360e3-d941-494f-adcd-3f8a2edbb6ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:44:37.147667 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c360e3-d941-494f-adcd-3f8a2edbb6ae service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:44:37.157530 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 731/1468] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:44:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:44:39.600148 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bb935-cef9-4326-921e-170fa0d9a27c None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:39.601087 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bb935-cef9-4326-921e-170fa0d9a27c None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:39.601087 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bb935-cef9-4326-921e-170fa0d9a27c None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:39.604033 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 738/1469] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 17:44:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:44:39.614599 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786644db-9757-461a-a0be-8811a29b92b3 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:39.615028 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786644db-9757-461a-a0be-8811a29b92b3 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:39.615153 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786644db-9757-461a-a0be-8811a29b92b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:39.637634 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-786644db-9757-461a-a0be-8811a29b92b3 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:44:39.638831 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-786644db-9757-461a-a0be-8811a29b92b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:44:39.647908 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 732/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 17:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:44:39.686376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bb935-cef9-4326-921e-170fa0d9a27c None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:44:39.697616 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bb935-cef9-4326-921e-170fa0d9a27c None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:44:39.701268 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0f994-f269-4f48-b29f-499a4bc345a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:44:39.701900 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0f994-f269-4f48-b29f-499a4bc345a2 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:39.702182 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0f994-f269-4f48-b29f-499a4bc345a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:39.702459 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0f994-f269-4f48-b29f-499a4bc345a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:39.712011 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0f994-f269-4f48-b29f-499a4bc345a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:44:39.713503 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0f994-f269-4f48-b29f-499a4bc345a2 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:44:39.723018 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 739/1471] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:44:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:44:42.129116 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff42a5-4d9f-416c-9e96-abe648ab4b3a None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:42.129780 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff42a5-4d9f-416c-9e96-abe648ab4b3a None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:42.129780 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff42a5-4d9f-416c-9e96-abe648ab4b3a None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:42.132730 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 733/1472] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 17:44:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:44:42.142587 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063cac6-9252-498c-a956-338c7a9af3b6 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:42.143065 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063cac6-9252-498c-a956-338c7a9af3b6 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:42.143174 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063cac6-9252-498c-a956-338c7a9af3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:42.162480 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-e063cac6-9252-498c-a956-338c7a9af3b6 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:44:42.163736 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-e063cac6-9252-498c-a956-338c7a9af3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:44:42.174671 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 740/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 17:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:44:42.226464 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff42a5-4d9f-416c-9e96-abe648ab4b3a None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:44:42.241492 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff42a5-4d9f-416c-9e96-abe648ab4b3a None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:44:42.250566 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a106a-4aef-4e7f-a239-92b51bbbe4ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:44:42.251210 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a106a-4aef-4e7f-a239-92b51bbbe4ff service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:42.251492 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a106a-4aef-4e7f-a239-92b51bbbe4ff service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:42.251760 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a106a-4aef-4e7f-a239-92b51bbbe4ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:42.262755 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a106a-4aef-4e7f-a239-92b51bbbe4ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:44:42.264203 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a106a-4aef-4e7f-a239-92b51bbbe4ff service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:44:42.273982 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 734/1474] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:44:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:44:44.714051 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce439b89-3ae3-4603-b52d-0c597f44e908 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:44.714975 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce439b89-3ae3-4603-b52d-0c597f44e908 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:44.714975 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce439b89-3ae3-4603-b52d-0c597f44e908 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:44.717810 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 741/1475] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 17:44:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:44:44.725728 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b73026-85e2-4571-a63c-1aa0c61207ea None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:44.726186 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b73026-85e2-4571-a63c-1aa0c61207ea None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:44.726310 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b73026-85e2-4571-a63c-1aa0c61207ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:44.747601 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-34b73026-85e2-4571-a63c-1aa0c61207ea None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:44:44.748802 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-34b73026-85e2-4571-a63c-1aa0c61207ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:44:44.758503 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 735/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 17:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:44:44.795965 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce439b89-3ae3-4603-b52d-0c597f44e908 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:44:44.807778 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce439b89-3ae3-4603-b52d-0c597f44e908 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:44:44.811987 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49188468-7abb-4fcf-bb9d-a38fb1431fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:44:44.812616 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49188468-7abb-4fcf-bb9d-a38fb1431fad service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:44.812896 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49188468-7abb-4fcf-bb9d-a38fb1431fad service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:44.813190 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49188468-7abb-4fcf-bb9d-a38fb1431fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:44.822794 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49188468-7abb-4fcf-bb9d-a38fb1431fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:44:44.824273 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49188468-7abb-4fcf-bb9d-a38fb1431fad service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:44:44.834355 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 742/1477] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:44:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:44:47.233111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4cb5d-1475-419f-81ee-a4b751c33b65 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:47.233970 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4cb5d-1475-419f-81ee-a4b751c33b65 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:47.233970 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4cb5d-1475-419f-81ee-a4b751c33b65 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:47.236913 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 736/1478] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 17:44:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:44:47.244687 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2221c-94dd-4f76-9896-8e83f3487cfe None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:47.245497 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2221c-94dd-4f76-9896-8e83f3487cfe None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:47.245692 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2221c-94dd-4f76-9896-8e83f3487cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:47.266787 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-a6d2221c-94dd-4f76-9896-8e83f3487cfe None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:44:47.267968 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a6d2221c-94dd-4f76-9896-8e83f3487cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:44:47.277074 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 743/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 17:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:44:47.313427 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4cb5d-1475-419f-81ee-a4b751c33b65 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:44:47.328913 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4cb5d-1475-419f-81ee-a4b751c33b65 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:44:47.336311 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee172f5-1b12-4411-a2b8-01bd31a50ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:44:47.337391 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee172f5-1b12-4411-a2b8-01bd31a50ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:47.337810 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee172f5-1b12-4411-a2b8-01bd31a50ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:47.338213 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee172f5-1b12-4411-a2b8-01bd31a50ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:47.350989 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee172f5-1b12-4411-a2b8-01bd31a50ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:44:47.352438 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee172f5-1b12-4411-a2b8-01bd31a50ed1 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:44:47.362235 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 737/1480] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:44:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:44:49.780455 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c091f0-e725-4eb4-b756-798712dd707f None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:49.781373 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c091f0-e725-4eb4-b756-798712dd707f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:49.781373 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c091f0-e725-4eb4-b756-798712dd707f None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:49.784212 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 744/1481] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 17:44:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:44:49.795232 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd791a1-9ae4-48f4-a0b8-a39d5a582c6d None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:49.795683 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd791a1-9ae4-48f4-a0b8-a39d5a582c6d None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:49.795788 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd791a1-9ae4-48f4-a0b8-a39d5a582c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:49.814970 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-cfd791a1-9ae4-48f4-a0b8-a39d5a582c6d None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:44:49.816164 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-cfd791a1-9ae4-48f4-a0b8-a39d5a582c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:44:49.824738 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 738/1482] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 17:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:44:49.861950 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c091f0-e725-4eb4-b756-798712dd707f None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:44:49.880929 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c091f0-e725-4eb4-b756-798712dd707f None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:44:49.887779 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a4439-00d5-4ec3-93b9-89b9a01f9a8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:44:49.888713 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a4439-00d5-4ec3-93b9-89b9a01f9a8d service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:44:49.889033 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a4439-00d5-4ec3-93b9-89b9a01f9a8d service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:44:49.889365 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a4439-00d5-4ec3-93b9-89b9a01f9a8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:44:49.900637 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a4439-00d5-4ec3-93b9-89b9a01f9a8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:44:49.902112 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a4439-00d5-4ec3-93b9-89b9a01f9a8d service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:44:49.911786 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 745/1483] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:44:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:45:06.903404 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac1f02-bb4b-4b86-805e-e974e204b168 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:06.904356 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac1f02-bb4b-4b86-805e-e974e204b168 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:06.904356 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac1f02-bb4b-4b86-805e-e974e204b168 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:06.907303 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 739/1484] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:45:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:45:06.912885 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7c67e-ed80-4378-92b9-3b3eab4cd7b1 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:06.913335 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7c67e-ed80-4378-92b9-3b3eab4cd7b1 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:06.913441 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7c67e-ed80-4378-92b9-3b3eab4cd7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:06.935913 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-8ae7c67e-ed80-4378-92b9-3b3eab4cd7b1 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:45:06.937142 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-8ae7c67e-ed80-4378-92b9-3b3eab4cd7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:45:06.946259 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 746/1485] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:45:06.994341 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3c601-4fce-4754-824d-1a57bac0265a None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:06.994628 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3c601-4fce-4754-824d-1a57bac0265a None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:06.994924 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3c601-4fce-4754-824d-1a57bac0265a None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:06.996697 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 740/1486] 10.222.0.31 () {54 vars in 962 bytes} [Mon Jan 10 17:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:45:07.001849 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e8b09-815c-4d15-a4c2-f080e572d40a None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:07.002168 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e8b09-815c-4d15-a4c2-f080e572d40a None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:07.002437 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e8b09-815c-4d15-a4c2-f080e572d40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:07.020736 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-107e8b09-815c-4d15-a4c2-f080e572d40a None None] MFA Rules not processed for user `15232a1930bc43e8bb5aa7310a709056`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:45:07.021926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-107e8b09-815c-4d15-a4c2-f080e572d40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:45:07.029267 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 747/1487] 10.222.0.31 () {58 vars in 1059 bytes} [Mon Jan 10 17:45:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:45:07.036812 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3c601-4fce-4754-824d-1a57bac0265a None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:45:07.048535 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3c601-4fce-4754-824d-1a57bac0265a None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:45:07.052462 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2fe93-85a5-4abc-a839-5cc81112181b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15232a1930bc43e8bb5aa7310a709056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:45:07.053129 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2fe93-85a5-4abc-a839-5cc81112181b service glance] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:07.053407 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2fe93-85a5-4abc-a839-5cc81112181b service glance] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:07.053707 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2fe93-85a5-4abc-a839-5cc81112181b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:07.062591 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2fe93-85a5-4abc-a839-5cc81112181b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:45:07.064111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2fe93-85a5-4abc-a839-5cc81112181b service glance] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:45:07.074355 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 741/1488] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:45:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:45:09.553676 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e8168-1354-4bd5-adbb-067fdb15a367 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:09.554618 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e8168-1354-4bd5-adbb-067fdb15a367 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:09.554618 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e8168-1354-4bd5-adbb-067fdb15a367 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:09.557560 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 748/1489] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:45:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:45:09.565164 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f529acc-6c3b-4773-955f-73adf863a4fc None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:09.565618 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f529acc-6c3b-4773-955f-73adf863a4fc None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:09.565722 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f529acc-6c3b-4773-955f-73adf863a4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:09.584899 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-3f529acc-6c3b-4773-955f-73adf863a4fc None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:45:09.586112 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-3f529acc-6c3b-4773-955f-73adf863a4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:45:09.594408 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 742/1490] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:45:09.618083 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e8168-1354-4bd5-adbb-067fdb15a367 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:45:09.631884 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e8168-1354-4bd5-adbb-067fdb15a367 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:45:09.637948 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d263915-fd85-4eff-9fe6-1cc0726d0c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:45:09.638582 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d263915-fd85-4eff-9fe6-1cc0726d0c95 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:09.638854 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d263915-fd85-4eff-9fe6-1cc0726d0c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:09.639135 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d263915-fd85-4eff-9fe6-1cc0726d0c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:09.639866 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d263915-fd85-4eff-9fe6-1cc0726d0c95 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:45:09.641771 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d263915-fd85-4eff-9fe6-1cc0726d0c95 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:45:09.655686 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 749/1491] 10.222.0.31 () {56 vars in 1108 bytes} [Mon Jan 10 17:45:09 2022] GET /identity/v3/projects => generated 2553 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:45:12.050752 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0c211-e0d0-44da-8886-95b37c71f3e7 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:12.051364 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0c211-e0d0-44da-8886-95b37c71f3e7 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:12.051364 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0c211-e0d0-44da-8886-95b37c71f3e7 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:12.053097 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 743/1492] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:45:12.060629 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63735772-f65a-41ed-be1b-807f7d27fce9 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:12.061098 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63735772-f65a-41ed-be1b-807f7d27fce9 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:12.061218 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63735772-f65a-41ed-be1b-807f7d27fce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:12.080966 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-63735772-f65a-41ed-be1b-807f7d27fce9 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:45:12.082139 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-63735772-f65a-41ed-be1b-807f7d27fce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:45:12.091550 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 750/1493] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:45:12.135813 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0c211-e0d0-44da-8886-95b37c71f3e7 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:45:12.154662 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0c211-e0d0-44da-8886-95b37c71f3e7 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:45:12.160597 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7856c-37f6-430d-a72c-ba588cd49960 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:45:12.161254 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7856c-37f6-430d-a72c-ba588cd49960 service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:12.161535 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7856c-37f6-430d-a72c-ba588cd49960 service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:12.161808 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7856c-37f6-430d-a72c-ba588cd49960 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:12.169938 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a7856c-37f6-430d-a72c-ba588cd49960 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:45:12.171511 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a7856c-37f6-430d-a72c-ba588cd49960 service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:45:12.182543 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 744/1494] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:45:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:45:14.738398 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24a159-0bbf-467f-b7b4-87e8c1d53189 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:14.738917 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24a159-0bbf-467f-b7b4-87e8c1d53189 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:14.738917 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24a159-0bbf-467f-b7b4-87e8c1d53189 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:14.740738 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 751/1495] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:45:14.746315 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2b764-5892-4002-858f-4134e4d44cea None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:14.746734 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2b764-5892-4002-858f-4134e4d44cea None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:14.746855 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2b764-5892-4002-858f-4134e4d44cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:14.765967 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-bff2b764-5892-4002-858f-4134e4d44cea None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:45:14.767162 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-bff2b764-5892-4002-858f-4134e4d44cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:45:14.775749 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 745/1496] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:45:14.813710 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24a159-0bbf-467f-b7b4-87e8c1d53189 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:45:14.825568 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24a159-0bbf-467f-b7b4-87e8c1d53189 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:45:14.829832 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdef04-b78c-498c-952f-07cc10380f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:45:14.830490 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdef04-b78c-498c-952f-07cc10380f3a service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:14.830767 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdef04-b78c-498c-952f-07cc10380f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:14.831032 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdef04-b78c-498c-952f-07cc10380f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:14.840712 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdef04-b78c-498c-952f-07cc10380f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:45:14.842182 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdef04-b78c-498c-952f-07cc10380f3a service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:45:14.851633 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 752/1497] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:45:17.269011 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e5c19-242e-4caf-8ce3-4bff3f9472e3 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:17.269950 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e5c19-242e-4caf-8ce3-4bff3f9472e3 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:17.269950 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e5c19-242e-4caf-8ce3-4bff3f9472e3 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:17.272783 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 746/1498] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:45:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:45:17.278467 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff672f3-efe4-4801-9027-66450e434c93 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:17.278938 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff672f3-efe4-4801-9027-66450e434c93 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:17.279044 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff672f3-efe4-4801-9027-66450e434c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:17.298179 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-9ff672f3-efe4-4801-9027-66450e434c93 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:45:17.299377 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-9ff672f3-efe4-4801-9027-66450e434c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:45:17.307902 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 753/1499] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:45:17.349950 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e5c19-242e-4caf-8ce3-4bff3f9472e3 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:45:17.366339 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e5c19-242e-4caf-8ce3-4bff3f9472e3 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:45:17.370459 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b8a3a-b07b-4b72-ac5e-257feda8ef3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:45:17.371117 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b8a3a-b07b-4b72-ac5e-257feda8ef3c service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:17.371379 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b8a3a-b07b-4b72-ac5e-257feda8ef3c service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:17.371648 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b8a3a-b07b-4b72-ac5e-257feda8ef3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:17.380504 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b8a3a-b07b-4b72-ac5e-257feda8ef3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:45:17.381970 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b8a3a-b07b-4b72-ac5e-257feda8ef3c service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:45:17.390891 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 747/1500] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:45:19.838988 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e0dc7-f1a5-4767-8223-66e6ed4faa17 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:19.839516 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e0dc7-f1a5-4767-8223-66e6ed4faa17 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:19.839516 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e0dc7-f1a5-4767-8223-66e6ed4faa17 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:19.841274 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 754/1501] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:45:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:45:19.847682 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3621862-edbb-4722-991a-1630e6c0efc6 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:19.848456 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3621862-edbb-4722-991a-1630e6c0efc6 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:19.848551 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3621862-edbb-4722-991a-1630e6c0efc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:19.878255 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b3621862-edbb-4722-991a-1630e6c0efc6 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:45:19.879442 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b3621862-edbb-4722-991a-1630e6c0efc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:45:19.888069 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 748/1502] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:45:19.924477 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e0dc7-f1a5-4767-8223-66e6ed4faa17 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:45:19.943932 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e0dc7-f1a5-4767-8223-66e6ed4faa17 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:45:19.949117 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3db8c9-73fb-4c12-bd42-a991b74fa115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:45:19.949972 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3db8c9-73fb-4c12-bd42-a991b74fa115 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:19.950259 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3db8c9-73fb-4c12-bd42-a991b74fa115 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:19.950532 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3db8c9-73fb-4c12-bd42-a991b74fa115 admin admin] PATH_INFO: `/v3/projects/ef5870ae6e4a4492ac99ab89391674b9` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:19.951731 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3db8c9-73fb-4c12-bd42-a991b74fa115 admin admin] RBAC: Authorizing `identity:get_project(project_id=ef5870ae6e4a4492ac99ab89391674b9)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:45:19.953567 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3db8c9-73fb-4c12-bd42-a991b74fa115 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:45:19.955214 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 755/1503] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:45:19 2022] GET /identity/v3/projects/ef5870ae6e4a4492ac99ab89391674b9 => generated 344 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:45:19.969886 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3621862-edbb-4722-991a-1630e6c0efc6 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:45:19.982828 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3621862-edbb-4722-991a-1630e6c0efc6 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:45:19.988367 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b03de-adb8-479a-a51e-b15b2d5984ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:45:19.989034 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b03de-adb8-479a-a51e-b15b2d5984ef service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:19.989307 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b03de-adb8-479a-a51e-b15b2d5984ef service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:19.989579 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b03de-adb8-479a-a51e-b15b2d5984ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:19.999147 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b03de-adb8-479a-a51e-b15b2d5984ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:45:20.000709 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b03de-adb8-479a-a51e-b15b2d5984ef service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:45:20.010081 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 749/1504] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:45:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:45:22.571461 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae008c09-6521-427f-b9e9-3761199309ef None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:22.572282 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae008c09-6521-427f-b9e9-3761199309ef None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:22.572282 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae008c09-6521-427f-b9e9-3761199309ef None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:22.575207 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 756/1505] 10.222.0.31 () {54 vars in 926 bytes} [Mon Jan 10 17:45:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:45:22.580886 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80251726-b2b7-4b2b-9f86-0d0baae2d88d None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:22.581301 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80251726-b2b7-4b2b-9f86-0d0baae2d88d None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:22.581433 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80251726-b2b7-4b2b-9f86-0d0baae2d88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:22.606639 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-80251726-b2b7-4b2b-9f86-0d0baae2d88d None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:45:22.608333 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-80251726-b2b7-4b2b-9f86-0d0baae2d88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:45:22.620440 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 750/1506] 10.222.0.31 () {58 vars in 1023 bytes} [Mon Jan 10 17:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:45:22.657123 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae008c09-6521-427f-b9e9-3761199309ef None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:45:22.673440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae008c09-6521-427f-b9e9-3761199309ef None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:45:22.679405 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b6056-924e-4f8c-a9ca-701471775fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:45:22.680260 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b6056-924e-4f8c-a9ca-701471775fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:22.680544 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b6056-924e-4f8c-a9ca-701471775fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:22.680817 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b6056-924e-4f8c-a9ca-701471775fa6 admin admin] PATH_INFO: `/v3/projects/ef5870ae6e4a4492ac99ab89391674b9` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:22.682143 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b6056-924e-4f8c-a9ca-701471775fa6 admin admin] RBAC: Authorizing `identity:get_project(project_id=ef5870ae6e4a4492ac99ab89391674b9)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:45:22.683961 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b6056-924e-4f8c-a9ca-701471775fa6 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:45:22.685646 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 757/1507] 10.222.0.31 () {56 vars in 1207 bytes} [Mon Jan 10 17:45:22 2022] GET /identity/v3/projects/ef5870ae6e4a4492ac99ab89391674b9 => generated 344 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:45:22.697348 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80251726-b2b7-4b2b-9f86-0d0baae2d88d None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:45:22.707420 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80251726-b2b7-4b2b-9f86-0d0baae2d88d None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:45:22.711511 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841b853-9885-4aa9-adf6-06558bf4f049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:45:22.712156 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841b853-9885-4aa9-adf6-06558bf4f049 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:45:22.712438 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841b853-9885-4aa9-adf6-06558bf4f049 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:45:22.712717 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841b853-9885-4aa9-adf6-06558bf4f049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:45:22.721968 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841b853-9885-4aa9-adf6-06558bf4f049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:45:22.723488 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841b853-9885-4aa9-adf6-06558bf4f049 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:45:22.733302 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 751/1508] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:45:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:46:37.293374 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0cef6-5c43-47af-a3b9-a8fc0b90b600 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:46:37.294004 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0cef6-5c43-47af-a3b9-a8fc0b90b600 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:46:37.294004 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0cef6-5c43-47af-a3b9-a8fc0b90b600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:46:37.313705 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-20e0cef6-5c43-47af-a3b9-a8fc0b90b600 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:46:37.314876 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-20e0cef6-5c43-47af-a3b9-a8fc0b90b600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:46:37.328355 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 758/1509] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:46:37.338101 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bcfef-7f33-4f6a-8e55-00d32699613d None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:46:37.338645 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bcfef-7f33-4f6a-8e55-00d32699613d None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:46:37.338645 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bcfef-7f33-4f6a-8e55-00d32699613d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:46:37.359418 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-118bcfef-7f33-4f6a-8e55-00d32699613d None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:46:37.360609 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-118bcfef-7f33-4f6a-8e55-00d32699613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:46:37.370462 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 752/1510] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:46:37.375223 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0cef6-5c43-47af-a3b9-a8fc0b90b600 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:46:37.384937 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0cef6-5c43-47af-a3b9-a8fc0b90b600 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:46:37.389973 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70b52a-7fee-43c0-85ff-eafd6f34e551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:46:37.390617 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70b52a-7fee-43c0-85ff-eafd6f34e551 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:46:37.390891 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70b52a-7fee-43c0-85ff-eafd6f34e551 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:46:37.391179 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70b52a-7fee-43c0-85ff-eafd6f34e551 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:46:37.391891 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70b52a-7fee-43c0-85ff-eafd6f34e551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:46:37.392192 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70b52a-7fee-43c0-85ff-eafd6f34e551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:46:37.393871 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70b52a-7fee-43c0-85ff-eafd6f34e551 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:46:37.405592 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 759/1511] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:46:37.413656 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bcfef-7f33-4f6a-8e55-00d32699613d None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:46:37.422661 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bcfef-7f33-4f6a-8e55-00d32699613d None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:46:37.427724 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c66c82-a382-4c17-b4b3-7df7fb1a9af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:46:37.428369 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c66c82-a382-4c17-b4b3-7df7fb1a9af6 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:46:37.428665 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c66c82-a382-4c17-b4b3-7df7fb1a9af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:46:37.428955 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c66c82-a382-4c17-b4b3-7df7fb1a9af6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:46:37.429671 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c66c82-a382-4c17-b4b3-7df7fb1a9af6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:46:37.431553 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c66c82-a382-4c17-b4b3-7df7fb1a9af6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:46:37.470866 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 753/1512] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:46:37 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:46:37.475634 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70b52a-7fee-43c0-85ff-eafd6f34e551 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:46:37.489430 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70b52a-7fee-43c0-85ff-eafd6f34e551 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:46:37.544715 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753418f-01ea-460a-b76a-a9bb7cb07e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:46:37.545358 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753418f-01ea-460a-b76a-a9bb7cb07e0b admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:46:37.545748 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753418f-01ea-460a-b76a-a9bb7cb07e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:46:37.546025 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753418f-01ea-460a-b76a-a9bb7cb07e0b admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:46:37.546763 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753418f-01ea-460a-b76a-a9bb7cb07e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:46:37.548678 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753418f-01ea-460a-b76a-a9bb7cb07e0b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:46:37.570787 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 760/1513] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:46:37 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:46:37.575728 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c66c82-a382-4c17-b4b3-7df7fb1a9af6 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:46:37.586302 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c66c82-a382-4c17-b4b3-7df7fb1a9af6 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:46:37.591515 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e2494-f700-41bb-98f8-a34df0802116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:46:37.592165 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e2494-f700-41bb-98f8-a34df0802116 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:46:37.592440 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e2494-f700-41bb-98f8-a34df0802116 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:46:37.592706 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e2494-f700-41bb-98f8-a34df0802116 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:46:37.593492 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e2494-f700-41bb-98f8-a34df0802116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:46:37.595134 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e2494-f700-41bb-98f8-a34df0802116 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:46:37.607503 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 754/1514] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:46:37.611669 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753418f-01ea-460a-b76a-a9bb7cb07e0b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:46:37.621507 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753418f-01ea-460a-b76a-a9bb7cb07e0b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:46:37.626747 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804486f8-c5c5-4677-a04e-1c01b6bfd425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:46:37.627452 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804486f8-c5c5-4677-a04e-1c01b6bfd425 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:46:37.627736 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804486f8-c5c5-4677-a04e-1c01b6bfd425 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:46:37.628006 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804486f8-c5c5-4677-a04e-1c01b6bfd425 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:46:37.628789 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804486f8-c5c5-4677-a04e-1c01b6bfd425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:46:37.630450 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804486f8-c5c5-4677-a04e-1c01b6bfd425 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:46:37.644121 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 761/1515] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:46:37.648363 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e2494-f700-41bb-98f8-a34df0802116 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:46:37.659023 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e2494-f700-41bb-98f8-a34df0802116 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:46:37.664603 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0439dfa-fae0-4395-a888-f101be75f539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:46:37.665524 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0439dfa-fae0-4395-a888-f101be75f539 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:46:37.665796 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0439dfa-fae0-4395-a888-f101be75f539 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:46:37.666078 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0439dfa-fae0-4395-a888-f101be75f539 admin admin] PATH_INFO: `/v3/projects/2e65b9991f4040ec9526b6ed251f4afd/users/9bbaaf5405f049058aae929fb3a5ad2f/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:46:37.680974 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0439dfa-fae0-4395-a888-f101be75f539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e65b9991f4040ec9526b6ed251f4afd, user_id=9bbaaf5405f049058aae929fb3a5ad2f, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:46:37.683650 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0439dfa-fae0-4395-a888-f101be75f539 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:46:37.699155 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 755/1516] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:46:37 2022] PUT /identity/v3/projects/2e65b9991f4040ec9526b6ed251f4afd/users/9bbaaf5405f049058aae929fb3a5ad2f/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:46:37.710513 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce4cb1-29f9-42d7-9c34-81a96e94cc3d None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:46:37.710812 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce4cb1-29f9-42d7-9c34-81a96e94cc3d None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:46:37.711088 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce4cb1-29f9-42d7-9c34-81a96e94cc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:46:37.738601 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-11ce4cb1-29f9-42d7-9c34-81a96e94cc3d None None] MFA Rules not processed for user `9bbaaf5405f049058aae929fb3a5ad2f`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:46:37.739826 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-11ce4cb1-29f9-42d7-9c34-81a96e94cc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:46:37.803632 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 762/1517] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:46:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:46:37.814877 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0439dfa-fae0-4395-a888-f101be75f539 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:46:37.887606 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0439dfa-fae0-4395-a888-f101be75f539 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:46:37.893844 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6c69d-aeb3-4b14-853b-92b0edb485e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:46:37.894490 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6c69d-aeb3-4b14-853b-92b0edb485e1 service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:46:37.894772 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6c69d-aeb3-4b14-853b-92b0edb485e1 service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:46:37.895053 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6c69d-aeb3-4b14-853b-92b0edb485e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:46:37.903312 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6c69d-aeb3-4b14-853b-92b0edb485e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:46:37.904928 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6c69d-aeb3-4b14-853b-92b0edb485e1 service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:46:37.913667 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 756/1518] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:46:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:46:37.982027 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365297b4-6eae-43fa-ac63-72de99f34af6 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:46:37.982315 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365297b4-6eae-43fa-ac63-72de99f34af6 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:46:37.982594 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365297b4-6eae-43fa-ac63-72de99f34af6 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:46:37.984289 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 763/1519] 10.222.0.31 () {52 vars in 829 bytes} [Mon Jan 10 17:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:46:37.989152 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6c69d-aeb3-4b14-853b-92b0edb485e1 service nova] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:46:38.054046 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6c69d-aeb3-4b14-853b-92b0edb485e1 service nova] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:46:38.059615 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e573fe-442b-4ef4-9528-dfd7ed817f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:46:38.060493 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e573fe-442b-4ef4-9528-dfd7ed817f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:46:38.060766 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e573fe-442b-4ef4-9528-dfd7ed817f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:46:38.061078 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e573fe-442b-4ef4-9528-dfd7ed817f91 admin admin] PATH_INFO: `/v3/users/9bbaaf5405f049058aae929fb3a5ad2f` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:46:38.062365 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e573fe-442b-4ef4-9528-dfd7ed817f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bbaaf5405f049058aae929fb3a5ad2f)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:46:38.063428 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING py.warnings [None req-51e573fe-442b-4ef4-9528-dfd7ed817f91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:46:38.063428 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: warnings.warn(msg) Jan 10 17:46:38.063428 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: Jan 10 17:46:38.064625 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e573fe-442b-4ef4-9528-dfd7ed817f91 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:46:38.141723 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-51e573fe-442b-4ef4-9528-dfd7ed817f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bbaaf5405f049058aae929fb3a5ad2f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:46:38.164259 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-51e573fe-442b-4ef4-9528-dfd7ed817f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bbaaf5405f049058aae929fb3a5ad2f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:46:38.175933 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-51e573fe-442b-4ef4-9528-dfd7ed817f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bbaaf5405f049058aae929fb3a5ad2f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:46:38.187420 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-51e573fe-442b-4ef4-9528-dfd7ed817f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bbaaf5405f049058aae929fb3a5ad2f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:46:38.188164 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-51e573fe-442b-4ef4-9528-dfd7ed817f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bbaaf5405f049058aae929fb3a5ad2f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:46:38.194722 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 757/1520] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:46:37 2022] DELETE /identity/v3/users/9bbaaf5405f049058aae929fb3a5ad2f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:46:38.199920 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdf693-9ad7-490b-924e-c520c07a7695 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:46:38.200215 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdf693-9ad7-490b-924e-c520c07a7695 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:46:38.200557 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdf693-9ad7-490b-924e-c520c07a7695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:46:38.221056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-bccdf693-9ad7-490b-924e-c520c07a7695 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:46:38.222489 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-bccdf693-9ad7-490b-924e-c520c07a7695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:46:38.286121 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 764/1521] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:46:38.299427 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e573fe-442b-4ef4-9528-dfd7ed817f91 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:46:38.301837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-51e573fe-442b-4ef4-9528-dfd7ed817f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:46:38.369943 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e573fe-442b-4ef4-9528-dfd7ed817f91 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:46:38.377430 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321931c-1035-47b1-9bcc-be4d9ce79fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:46:38.378560 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321931c-1035-47b1-9bcc-be4d9ce79fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:46:38.378845 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321931c-1035-47b1-9bcc-be4d9ce79fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:46:38.379124 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321931c-1035-47b1-9bcc-be4d9ce79fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:46:38.394793 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321931c-1035-47b1-9bcc-be4d9ce79fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:46:38.397105 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321931c-1035-47b1-9bcc-be4d9ce79fc6 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:46:38.411637 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 758/1522] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:46:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:46:38.756756 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdf693-9ad7-490b-924e-c520c07a7695 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:46:38.758398 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-bccdf693-9ad7-490b-924e-c520c07a7695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:46:38.770617 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdf693-9ad7-490b-924e-c520c07a7695 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:46:38.775642 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7c95c-6c57-470c-bb36-e37b3530c81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:46:38.776577 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7c95c-6c57-470c-bb36-e37b3530c81c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:46:38.776773 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7c95c-6c57-470c-bb36-e37b3530c81c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:46:38.777144 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7c95c-6c57-470c-bb36-e37b3530c81c admin admin] PATH_INFO: `/v3/projects/2e65b9991f4040ec9526b6ed251f4afd` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:46:38.778259 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7c95c-6c57-470c-bb36-e37b3530c81c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e65b9991f4040ec9526b6ed251f4afd)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:46:38.779430 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING py.warnings [None req-72e7c95c-6c57-470c-bb36-e37b3530c81c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:46:38.779430 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: warnings.warn(msg) Jan 10 17:46:38.779430 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: Jan 10 17:46:38.780488 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7c95c-6c57-470c-bb36-e37b3530c81c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:46:38.843786 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-72e7c95c-6c57-470c-bb36-e37b3530c81c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e65b9991f4040ec9526b6ed251f4afd', 'request_id': 'req-72e7c95c-6c57-470c-bb36-e37b3530c81c'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:46:38.850443 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-72e7c95c-6c57-470c-bb36-e37b3530c81c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e65b9991f4040ec9526b6ed251f4afd', 'request_id': 'req-72e7c95c-6c57-470c-bb36-e37b3530c81c'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:46:38.861364 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-72e7c95c-6c57-470c-bb36-e37b3530c81c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e65b9991f4040ec9526b6ed251f4afd', 'request_id': 'req-72e7c95c-6c57-470c-bb36-e37b3530c81c'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:46:38.879410 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-72e7c95c-6c57-470c-bb36-e37b3530c81c admin admin] The token cache is being invalidate because project 2e65b9991f4040ec9526b6ed251f4afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:46:38.879693 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-72e7c95c-6c57-470c-bb36-e37b3530c81c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:46:38.880333 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-72e7c95c-6c57-470c-bb36-e37b3530c81c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:46:38.881995 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 765/1523] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:46:38 2022] DELETE /identity/v3/projects/2e65b9991f4040ec9526b6ed251f4afd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:48:08.189429 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9492c-52d4-4e09-a25f-6ee3585916e8 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:08.190054 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9492c-52d4-4e09-a25f-6ee3585916e8 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:08.190054 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9492c-52d4-4e09-a25f-6ee3585916e8 None None] PATH_INFO: `/v3` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:08.191290 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 759/1524] 10.222.0.35 () {54 vars in 925 bytes} [Mon Jan 10 17:48:08 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:48:08.198401 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484279a0-bf82-49ef-976c-b6667c1a1cd9 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:08.198866 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484279a0-bf82-49ef-976c-b6667c1a1cd9 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:08.198968 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484279a0-bf82-49ef-976c-b6667c1a1cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:08.218665 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-484279a0-bf82-49ef-976c-b6667c1a1cd9 None None] MFA Rules not processed for user `3a3b8e620cfd42fe993c73dc83a246be`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:48:08.219873 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-484279a0-bf82-49ef-976c-b6667c1a1cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:48:08.283513 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 766/1525] 10.222.0.35 () {58 vars in 1015 bytes} [Mon Jan 10 17:48:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:48:09.191698 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7a515-de06-4be3-9b0a-0b145d24d72a None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:09.192516 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7a515-de06-4be3-9b0a-0b145d24d72a None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:09.192516 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7a515-de06-4be3-9b0a-0b145d24d72a None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:09.194986 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 760/1526] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 17:48:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:48:09.199967 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282b83d-cd58-452a-af25-726473c921e7 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:09.200407 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282b83d-cd58-452a-af25-726473c921e7 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:09.200514 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282b83d-cd58-452a-af25-726473c921e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:09.219647 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-8282b83d-cd58-452a-af25-726473c921e7 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:48:09.220835 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-8282b83d-cd58-452a-af25-726473c921e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:48:09.289125 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 767/1527] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 17:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:48:09.445931 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7a515-de06-4be3-9b0a-0b145d24d72a None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:48:09.449060 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-12c7a515-de06-4be3-9b0a-0b145d24d72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:48:09.534560 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7a515-de06-4be3-9b0a-0b145d24d72a None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:48:09.540042 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b96bf-4558-44c5-a832-c3de0c053d76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:48:09.540738 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b96bf-4558-44c5-a832-c3de0c053d76 service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:09.541054 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b96bf-4558-44c5-a832-c3de0c053d76 service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:09.541332 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b96bf-4558-44c5-a832-c3de0c053d76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:09.549514 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b96bf-4558-44c5-a832-c3de0c053d76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:48:09.551113 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b96bf-4558-44c5-a832-c3de0c053d76 service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:48:09.561123 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 761/1528] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:48:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:48:11.085207 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc69a7-1efc-47e3-9c92-1f027e5e46aa None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:11.086066 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc69a7-1efc-47e3-9c92-1f027e5e46aa None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:11.086066 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc69a7-1efc-47e3-9c92-1f027e5e46aa None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:11.088780 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 768/1529] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 17:48:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:48:11.093909 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a51d3-e07a-44bb-b3b2-1510e69b4969 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:11.094361 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a51d3-e07a-44bb-b3b2-1510e69b4969 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:11.094454 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a51d3-e07a-44bb-b3b2-1510e69b4969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:11.113343 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-c08a51d3-e07a-44bb-b3b2-1510e69b4969 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:48:11.114531 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-c08a51d3-e07a-44bb-b3b2-1510e69b4969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:48:11.123897 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 762/1530] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 17:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:48:11.274030 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc69a7-1efc-47e3-9c92-1f027e5e46aa None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:48:11.290139 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc69a7-1efc-47e3-9c92-1f027e5e46aa None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:48:11.296094 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19591da-2821-4a1b-82c0-750994bd969e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:48:11.296759 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19591da-2821-4a1b-82c0-750994bd969e service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:11.297068 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19591da-2821-4a1b-82c0-750994bd969e service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:11.297338 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19591da-2821-4a1b-82c0-750994bd969e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:11.305631 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19591da-2821-4a1b-82c0-750994bd969e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:48:11.307218 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19591da-2821-4a1b-82c0-750994bd969e service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:48:11.316269 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 769/1531] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:48:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:48:11.878896 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85ccdb-a32a-4ff1-821e-039ff143cdd7 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:11.879185 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85ccdb-a32a-4ff1-821e-039ff143cdd7 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:11.879451 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85ccdb-a32a-4ff1-821e-039ff143cdd7 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:11.881333 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 763/1532] 10.222.0.31 () {54 vars in 960 bytes} [Mon Jan 10 17:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:48:11.886454 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fce27-34f6-47c5-9d47-538e5bed1d4f None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:11.886750 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fce27-34f6-47c5-9d47-538e5bed1d4f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:11.887030 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fce27-34f6-47c5-9d47-538e5bed1d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:11.906626 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-488fce27-34f6-47c5-9d47-538e5bed1d4f None None] MFA Rules not processed for user `3a3b8e620cfd42fe993c73dc83a246be`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:48:11.907821 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-488fce27-34f6-47c5-9d47-538e5bed1d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:48:11.918478 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 770/1533] 10.222.0.31 () {58 vars in 1057 bytes} [Mon Jan 10 17:48:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:48:11.926460 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85ccdb-a32a-4ff1-821e-039ff143cdd7 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:48:11.943864 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85ccdb-a32a-4ff1-821e-039ff143cdd7 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:48:11.949703 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cb30a-19e8-4c8f-9a39-62816883773c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3b8e620cfd42fe993c73dc83a246be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:48:11.950369 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cb30a-19e8-4c8f-9a39-62816883773c service placement] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:11.950634 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cb30a-19e8-4c8f-9a39-62816883773c service placement] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:11.950910 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cb30a-19e8-4c8f-9a39-62816883773c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:11.959111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cb30a-19e8-4c8f-9a39-62816883773c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:48:11.960715 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cb30a-19e8-4c8f-9a39-62816883773c service placement] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:48:11.970390 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 764/1534] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:48:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:48:23.289377 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6d0e7-6de2-4594-9755-486c165494d9 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:23.290283 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6d0e7-6de2-4594-9755-486c165494d9 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:23.290283 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6d0e7-6de2-4594-9755-486c165494d9 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:23.293049 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 771/1535] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 17:48:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:48:23.298950 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a511af-7657-4eaf-8131-f63116c667ce None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:23.299722 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a511af-7657-4eaf-8131-f63116c667ce None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:23.299897 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a511af-7657-4eaf-8131-f63116c667ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:23.323737 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-d4a511af-7657-4eaf-8131-f63116c667ce None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:48:23.324952 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-d4a511af-7657-4eaf-8131-f63116c667ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:48:23.333772 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 765/1536] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 17:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:48:23.483857 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6d0e7-6de2-4594-9755-486c165494d9 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:48:23.508268 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6d0e7-6de2-4594-9755-486c165494d9 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:48:23.518275 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8851e2-a1c6-46bd-a2aa-3d5c24029e16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:48:23.518917 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8851e2-a1c6-46bd-a2aa-3d5c24029e16 service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:23.519195 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8851e2-a1c6-46bd-a2aa-3d5c24029e16 service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:23.519463 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8851e2-a1c6-46bd-a2aa-3d5c24029e16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:23.528610 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8851e2-a1c6-46bd-a2aa-3d5c24029e16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:48:23.530245 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8851e2-a1c6-46bd-a2aa-3d5c24029e16 service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:48:23.540661 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 772/1537] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:48:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:48:25.057738 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa036c-3c87-4088-b362-a19b0dec4119 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:25.058293 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa036c-3c87-4088-b362-a19b0dec4119 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:25.058293 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa036c-3c87-4088-b362-a19b0dec4119 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:25.060925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 766/1538] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 17:48:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:48:25.065991 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ceecd-8cf8-498b-bbee-f8a11c25bfa2 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:25.066433 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ceecd-8cf8-498b-bbee-f8a11c25bfa2 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:25.066546 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ceecd-8cf8-498b-bbee-f8a11c25bfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:25.089658 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-035ceecd-8cf8-498b-bbee-f8a11c25bfa2 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:48:25.090852 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-035ceecd-8cf8-498b-bbee-f8a11c25bfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:48:25.099932 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 773/1539] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 17:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:48:25.262269 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa036c-3c87-4088-b362-a19b0dec4119 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:48:25.279504 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa036c-3c87-4088-b362-a19b0dec4119 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:48:25.286835 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fc71f-b4f9-4e2e-9939-219c8e18fa58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:48:25.287512 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fc71f-b4f9-4e2e-9939-219c8e18fa58 service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:25.287788 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fc71f-b4f9-4e2e-9939-219c8e18fa58 service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:25.288057 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fc71f-b4f9-4e2e-9939-219c8e18fa58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:25.296747 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fc71f-b4f9-4e2e-9939-219c8e18fa58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:48:25.298457 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fc71f-b4f9-4e2e-9939-219c8e18fa58 service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:48:25.307949 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 767/1540] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:48:29.781526 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21568953-faba-4716-a3df-07020a8dce7f None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:29.782193 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21568953-faba-4716-a3df-07020a8dce7f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:29.782193 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21568953-faba-4716-a3df-07020a8dce7f None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:29.783926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 774/1541] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 17:48:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:48:29.789572 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69377baa-b982-40b1-907e-f8c9a5b5c359 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:29.789978 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69377baa-b982-40b1-907e-f8c9a5b5c359 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:29.790100 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69377baa-b982-40b1-907e-f8c9a5b5c359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:29.815654 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-69377baa-b982-40b1-907e-f8c9a5b5c359 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:48:29.816845 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-69377baa-b982-40b1-907e-f8c9a5b5c359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:48:29.825597 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 768/1542] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 17:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:48:29.862713 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21568953-faba-4716-a3df-07020a8dce7f None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:48:29.865020 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-21568953-faba-4716-a3df-07020a8dce7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:48:29.929716 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21568953-faba-4716-a3df-07020a8dce7f None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:48:29.936729 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6f2d7-ec26-4d0d-ab52-a6bc7e45c98b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:48:29.937723 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6f2d7-ec26-4d0d-ab52-a6bc7e45c98b service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:29.938092 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6f2d7-ec26-4d0d-ab52-a6bc7e45c98b service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:29.938373 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6f2d7-ec26-4d0d-ab52-a6bc7e45c98b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:29.948450 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6f2d7-ec26-4d0d-ab52-a6bc7e45c98b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:48:29.949919 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6f2d7-ec26-4d0d-ab52-a6bc7e45c98b service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:48:29.959650 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 775/1543] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:48:32.293653 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17813f-d48c-4172-8353-c08cf9b2e828 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:32.294551 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17813f-d48c-4172-8353-c08cf9b2e828 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:32.294551 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17813f-d48c-4172-8353-c08cf9b2e828 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:32.297459 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 769/1544] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 17:48:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:48:32.302715 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e864f-76c1-42c0-9465-adb9902de6d2 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:32.303134 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e864f-76c1-42c0-9465-adb9902de6d2 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:32.303252 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e864f-76c1-42c0-9465-adb9902de6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:32.325394 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-9c2e864f-76c1-42c0-9465-adb9902de6d2 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:48:32.326513 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-9c2e864f-76c1-42c0-9465-adb9902de6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:48:32.335807 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 776/1545] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 17:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:48:32.376525 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17813f-d48c-4172-8353-c08cf9b2e828 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:48:32.394372 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17813f-d48c-4172-8353-c08cf9b2e828 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:48:32.399538 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06876a6-fb82-4ce4-be3e-d53a053a50dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:48:32.400180 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06876a6-fb82-4ce4-be3e-d53a053a50dc service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:32.400461 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06876a6-fb82-4ce4-be3e-d53a053a50dc service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:32.400733 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06876a6-fb82-4ce4-be3e-d53a053a50dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:32.411285 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06876a6-fb82-4ce4-be3e-d53a053a50dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:48:32.412761 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06876a6-fb82-4ce4-be3e-d53a053a50dc service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:48:32.422726 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 770/1546] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:48:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:48:36.397952 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a1a62-142d-430a-a292-68472478daf7 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:36.398925 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a1a62-142d-430a-a292-68472478daf7 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:36.398925 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a1a62-142d-430a-a292-68472478daf7 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:36.400638 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 777/1547] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 17:48:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:48:36.407002 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce4959-a72e-45c7-bf60-c56ee6730a1d None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:36.407673 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce4959-a72e-45c7-bf60-c56ee6730a1d None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:36.407897 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce4959-a72e-45c7-bf60-c56ee6730a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:36.431667 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-c9ce4959-a72e-45c7-bf60-c56ee6730a1d None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:48:36.432873 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-c9ce4959-a72e-45c7-bf60-c56ee6730a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:48:36.441175 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 771/1548] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 17:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:48:36.492462 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a1a62-142d-430a-a292-68472478daf7 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:48:36.495592 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-af5a1a62-142d-430a-a292-68472478daf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:48:36.558980 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a1a62-142d-430a-a292-68472478daf7 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:48:36.563051 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560fca4-0b5e-429a-b2bf-5db73c71db9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:48:36.563690 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560fca4-0b5e-429a-b2bf-5db73c71db9a service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:36.563967 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560fca4-0b5e-429a-b2bf-5db73c71db9a service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:36.564240 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560fca4-0b5e-429a-b2bf-5db73c71db9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:36.573275 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560fca4-0b5e-429a-b2bf-5db73c71db9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:48:36.574705 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560fca4-0b5e-429a-b2bf-5db73c71db9a service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:48:36.584426 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 778/1549] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:48:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:48:38.951656 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f488e-35a7-4147-9f70-5336c1df3200 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:38.952584 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f488e-35a7-4147-9f70-5336c1df3200 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:38.952584 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f488e-35a7-4147-9f70-5336c1df3200 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:38.955431 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 772/1550] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 17:48:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:48:38.963158 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e6b9e-b21f-4fb4-a84d-9f6e41347001 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:38.963664 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e6b9e-b21f-4fb4-a84d-9f6e41347001 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:38.963664 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e6b9e-b21f-4fb4-a84d-9f6e41347001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:38.982407 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-3e0e6b9e-b21f-4fb4-a84d-9f6e41347001 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:48:38.983611 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-3e0e6b9e-b21f-4fb4-a84d-9f6e41347001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:48:38.992996 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 779/1551] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 17:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:48:39.043803 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbacc1d-e8ad-4823-aac9-39bb96fc26e9 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:39.044135 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbacc1d-e8ad-4823-aac9-39bb96fc26e9 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:39.044534 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbacc1d-e8ad-4823-aac9-39bb96fc26e9 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:39.047374 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 773/1552] 10.222.0.31 () {54 vars in 963 bytes} [Mon Jan 10 17:48:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:48:39.054790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0c8de-1c33-4431-8791-4bcb8456bbdc None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:39.055259 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0c8de-1c33-4431-8791-4bcb8456bbdc None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:39.055730 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0c8de-1c33-4431-8791-4bcb8456bbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:39.078165 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-5ef0c8de-1c33-4431-8791-4bcb8456bbdc None None] MFA Rules not processed for user `955fd3e0d82f416c99001bdc7f129017`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:48:39.079392 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-5ef0c8de-1c33-4431-8791-4bcb8456bbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:48:39.087515 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 780/1553] 10.222.0.31 () {58 vars in 1060 bytes} [Mon Jan 10 17:48:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:48:39.095437 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbacc1d-e8ad-4823-aac9-39bb96fc26e9 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:48:39.106843 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbacc1d-e8ad-4823-aac9-39bb96fc26e9 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:48:39.110576 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d97fc5-9b50-4b08-8772-72589aeb7d0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:48:39.111209 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d97fc5-9b50-4b08-8772-72589aeb7d0e service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:48:39.111486 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d97fc5-9b50-4b08-8772-72589aeb7d0e service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:48:39.111756 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d97fc5-9b50-4b08-8772-72589aeb7d0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:48:39.120914 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d97fc5-9b50-4b08-8772-72589aeb7d0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:48:39.122344 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d97fc5-9b50-4b08-8772-72589aeb7d0e service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:48:39.131332 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 774/1554] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:02.905706 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42b05b-eb44-4985-86c6-21b583443fa6 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:02.906343 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42b05b-eb44-4985-86c6-21b583443fa6 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:02.906343 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42b05b-eb44-4985-86c6-21b583443fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:02.927200 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-fa42b05b-eb44-4985-86c6-21b583443fa6 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:02.928587 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-fa42b05b-eb44-4985-86c6-21b583443fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:02.941978 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 781/1555] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:02.950605 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01e597-a9cd-4f72-aa93-9a6278165cc6 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:02.951600 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01e597-a9cd-4f72-aa93-9a6278165cc6 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:02.952038 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01e597-a9cd-4f72-aa93-9a6278165cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:02.977034 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-3f01e597-a9cd-4f72-aa93-9a6278165cc6 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:02.978514 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-3f01e597-a9cd-4f72-aa93-9a6278165cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:02.995468 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 775/1556] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:50:03.001167 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42b05b-eb44-4985-86c6-21b583443fa6 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:03.014090 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42b05b-eb44-4985-86c6-21b583443fa6 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:03.020463 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749ee16-24a5-462a-a23a-33c75830d1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:03.021160 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749ee16-24a5-462a-a23a-33c75830d1fe admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.021497 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749ee16-24a5-462a-a23a-33c75830d1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.021770 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749ee16-24a5-462a-a23a-33c75830d1fe admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.022503 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749ee16-24a5-462a-a23a-33c75830d1fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:50:03.022804 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749ee16-24a5-462a-a23a-33c75830d1fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:03.024713 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749ee16-24a5-462a-a23a-33c75830d1fe admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:03.044710 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 782/1557] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:50:03.053272 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01e597-a9cd-4f72-aa93-9a6278165cc6 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:03.063031 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01e597-a9cd-4f72-aa93-9a6278165cc6 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:03.073194 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43638f92-a139-4628-9333-0dcdaec6965c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:03.074159 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43638f92-a139-4628-9333-0dcdaec6965c admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.074643 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43638f92-a139-4628-9333-0dcdaec6965c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.075108 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43638f92-a139-4628-9333-0dcdaec6965c admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.076023 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43638f92-a139-4628-9333-0dcdaec6965c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:03.078166 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43638f92-a139-4628-9333-0dcdaec6965c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:03.122802 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 776/1558] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/projects => generated 389 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:03.127497 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749ee16-24a5-462a-a23a-33c75830d1fe admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:03.143135 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749ee16-24a5-462a-a23a-33c75830d1fe admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:03.165030 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d35e0-c1af-4f2b-8c29-bb5cce60283c None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.165687 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d35e0-c1af-4f2b-8c29-bb5cce60283c None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.166183 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d35e0-c1af-4f2b-8c29-bb5cce60283c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.188948 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b14d35e0-c1af-4f2b-8c29-bb5cce60283c None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:03.190510 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b14d35e0-c1af-4f2b-8c29-bb5cce60283c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:03.228879 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930288ba-75ca-4fba-95d6-0752bda801e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:03.228879 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930288ba-75ca-4fba-95d6-0752bda801e6 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.228879 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930288ba-75ca-4fba-95d6-0752bda801e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.228879 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930288ba-75ca-4fba-95d6-0752bda801e6 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.229368 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930288ba-75ca-4fba-95d6-0752bda801e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:03.232966 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930288ba-75ca-4fba-95d6-0752bda801e6 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:03.269977 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 783/1559] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:03.272494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 777/1560] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:50:03.277236 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930288ba-75ca-4fba-95d6-0752bda801e6 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:03.281235 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba310d9-bd5b-440a-bad4-01ce9d8ec9c6 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.281845 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba310d9-bd5b-440a-bad4-01ce9d8ec9c6 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.282335 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba310d9-bd5b-440a-bad4-01ce9d8ec9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.290235 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930288ba-75ca-4fba-95d6-0752bda801e6 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:03.302293 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a4872-ed5c-49fb-9e22-35bbd043b2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:03.303203 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a4872-ed5c-49fb-9e22-35bbd043b2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.303487 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a4872-ed5c-49fb-9e22-35bbd043b2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.303759 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a4872-ed5c-49fb-9e22-35bbd043b2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.304969 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a4872-ed5c-49fb-9e22-35bbd043b2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:03.306604 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a4872-ed5c-49fb-9e22-35bbd043b2b5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:03.307319 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-2ba310d9-bd5b-440a-bad4-01ce9d8ec9c6 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:03.308784 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-2ba310d9-bd5b-440a-bad4-01ce9d8ec9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:03.325182 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 784/1561] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:03.326533 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f2d8c-65ad-4546-8b9a-b0f81ee64ee7 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.326853 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f2d8c-65ad-4546-8b9a-b0f81ee64ee7 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.327087 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f2d8c-65ad-4546-8b9a-b0f81ee64ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.329457 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 778/1562] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:50:03.331041 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48cdad-e096-4eb5-aba4-57a7329cac27 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.331569 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48cdad-e096-4eb5-aba4-57a7329cac27 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.332048 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48cdad-e096-4eb5-aba4-57a7329cac27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.352132 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-bd48cdad-e096-4eb5-aba4-57a7329cac27 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:03.353711 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-bd48cdad-e096-4eb5-aba4-57a7329cac27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:03.359572 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-696f2d8c-65ad-4546-8b9a-b0f81ee64ee7 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:03.360790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-696f2d8c-65ad-4546-8b9a-b0f81ee64ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:03.366366 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 779/1563] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:03.367483 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48cdad-e096-4eb5-aba4-57a7329cac27 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:03.377686 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48cdad-e096-4eb5-aba4-57a7329cac27 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:03.378631 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 785/1564] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:03.380084 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc34345-b355-4845-b083-030ebea04e2f None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.380366 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc34345-b355-4845-b083-030ebea04e2f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.380639 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc34345-b355-4845-b083-030ebea04e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.383676 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3acc8-f686-43f4-870c-0b50b7ec2ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:03.384678 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3acc8-f686-43f4-870c-0b50b7ec2ebc admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.385205 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3acc8-f686-43f4-870c-0b50b7ec2ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.385690 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3acc8-f686-43f4-870c-0b50b7ec2ebc admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.386645 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3acc8-f686-43f4-870c-0b50b7ec2ebc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:50:03.387162 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3acc8-f686-43f4-870c-0b50b7ec2ebc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:03.389006 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3acc8-f686-43f4-870c-0b50b7ec2ebc admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:03.401908 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 780/1565] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:50:03.403136 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3acc8-f686-43f4-870c-0b50b7ec2ebc admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:03.413347 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3acc8-f686-43f4-870c-0b50b7ec2ebc admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:03.417925 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-bdc34345-b355-4845-b083-030ebea04e2f None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:03.418608 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e480da7-ce85-4ecb-a132-707499697bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:03.419283 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-bdc34345-b355-4845-b083-030ebea04e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:03.419755 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e480da7-ce85-4ecb-a132-707499697bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.420245 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e480da7-ce85-4ecb-a132-707499697bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.420732 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e480da7-ce85-4ecb-a132-707499697bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.421878 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e480da7-ce85-4ecb-a132-707499697bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:03.423806 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e480da7-ce85-4ecb-a132-707499697bd1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:03.431238 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 786/1566] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:03.432674 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c6442-4301-4858-bb28-5dffc870694c None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.432996 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c6442-4301-4858-bb28-5dffc870694c None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.433271 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c6442-4301-4858-bb28-5dffc870694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.437063 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 781/1567] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:03.438670 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a13c3-587a-4df4-b536-824465e58f39 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.439176 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a13c3-587a-4df4-b536-824465e58f39 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.444885 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a13c3-587a-4df4-b536-824465e58f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.453602 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-896c6442-4301-4858-bb28-5dffc870694c None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:03.454798 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-896c6442-4301-4858-bb28-5dffc870694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:03.467179 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 787/1568] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:03.467179 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c6442-4301-4858-bb28-5dffc870694c None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:03.468447 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-162a13c3-587a-4df4-b536-824465e58f39 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:03.470213 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-162a13c3-587a-4df4-b536-824465e58f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:03.479986 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c6442-4301-4858-bb28-5dffc870694c None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:03.480162 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 782/1569] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:03.481387 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114a0fb-b29e-48ef-bc7c-97e8a3bf08e9 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.481675 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114a0fb-b29e-48ef-bc7c-97e8a3bf08e9 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.481975 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114a0fb-b29e-48ef-bc7c-97e8a3bf08e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.484814 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b49bd9-a7fc-4e96-b2cb-64c2e7f221c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:03.485612 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b49bd9-a7fc-4e96-b2cb-64c2e7f221c7 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.485893 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b49bd9-a7fc-4e96-b2cb-64c2e7f221c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.486161 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b49bd9-a7fc-4e96-b2cb-64c2e7f221c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.486857 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b49bd9-a7fc-4e96-b2cb-64c2e7f221c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:03.488738 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b49bd9-a7fc-4e96-b2cb-64c2e7f221c7 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:03.499345 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b114a0fb-b29e-48ef-bc7c-97e8a3bf08e9 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:03.500562 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b114a0fb-b29e-48ef-bc7c-97e8a3bf08e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:03.508881 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 783/1570] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:03.509750 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114a0fb-b29e-48ef-bc7c-97e8a3bf08e9 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:03.515256 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 788/1571] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:03.516661 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b71486-d1c0-4c52-a6cd-0bf21f7482f1 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.516982 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b71486-d1c0-4c52-a6cd-0bf21f7482f1 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.517282 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b71486-d1c0-4c52-a6cd-0bf21f7482f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.519736 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114a0fb-b29e-48ef-bc7c-97e8a3bf08e9 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:03.535507 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-18b71486-d1c0-4c52-a6cd-0bf21f7482f1 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:03.536606 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-18b71486-d1c0-4c52-a6cd-0bf21f7482f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:03.571999 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9816bfb-2abe-4794-98b5-a97ac6cf4fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:03.572915 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9816bfb-2abe-4794-98b5-a97ac6cf4fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.573192 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9816bfb-2abe-4794-98b5-a97ac6cf4fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.573461 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9816bfb-2abe-4794-98b5-a97ac6cf4fa7 admin admin] PATH_INFO: `/v3/projects/a256dbcb3e024f32bd6f56fbc869046c/users/d0e34ddaca124f638fdf8e43fbb08437/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.587089 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9816bfb-2abe-4794-98b5-a97ac6cf4fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a256dbcb3e024f32bd6f56fbc869046c, user_id=d0e34ddaca124f638fdf8e43fbb08437, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:03.589803 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9816bfb-2abe-4794-98b5-a97ac6cf4fa7 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:03.591919 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 789/1572] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:03.593387 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2e564-d19d-4a33-9878-06fab1afb4cd None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.593892 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2e564-d19d-4a33-9878-06fab1afb4cd None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.594088 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2e564-d19d-4a33-9878-06fab1afb4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.604214 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 784/1573] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:50:03 2022] PUT /identity/v3/projects/a256dbcb3e024f32bd6f56fbc869046c/users/d0e34ddaca124f638fdf8e43fbb08437/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:03.605054 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9816bfb-2abe-4794-98b5-a97ac6cf4fa7 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:03.613994 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-4ab2e564-d19d-4a33-9878-06fab1afb4cd None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:03.615166 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-4ab2e564-d19d-4a33-9878-06fab1afb4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:03.662859 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9816bfb-2abe-4794-98b5-a97ac6cf4fa7 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:03.667382 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d5015-fdf6-4b09-950d-2a64a7a470fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:03.668035 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d5015-fdf6-4b09-950d-2a64a7a470fd admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.668311 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d5015-fdf6-4b09-950d-2a64a7a470fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.668583 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d5015-fdf6-4b09-950d-2a64a7a470fd admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.669348 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d5015-fdf6-4b09-950d-2a64a7a470fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:50:03.669650 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d5015-fdf6-4b09-950d-2a64a7a470fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:03.671250 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d5015-fdf6-4b09-950d-2a64a7a470fd admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:03.677145 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 790/1574] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:03.678411 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c675d1-20e4-4aee-8f7e-6366e3ac83ec None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.678700 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c675d1-20e4-4aee-8f7e-6366e3ac83ec None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.678978 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c675d1-20e4-4aee-8f7e-6366e3ac83ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.689463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 785/1575] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:50:03.689463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d5015-fdf6-4b09-950d-2a64a7a470fd admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:03.692879 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d5015-fdf6-4b09-950d-2a64a7a470fd admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:03.697297 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a1920-468f-42ef-96a6-2092a4db6e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:03.697931 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a1920-468f-42ef-96a6-2092a4db6e53 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.698207 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a1920-468f-42ef-96a6-2092a4db6e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.698475 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a1920-468f-42ef-96a6-2092a4db6e53 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.699202 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a1920-468f-42ef-96a6-2092a4db6e53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:50:03.699502 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a1920-468f-42ef-96a6-2092a4db6e53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:03.701105 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a1920-468f-42ef-96a6-2092a4db6e53 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:03.703962 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-62c675d1-20e4-4aee-8f7e-6366e3ac83ec None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:03.705176 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-62c675d1-20e4-4aee-8f7e-6366e3ac83ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:03.712611 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 786/1576] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:50:03.713216 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 791/1577] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:03.714248 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44334916-ab5e-4007-9600-b2ad1f3deab1 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.714534 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44334916-ab5e-4007-9600-b2ad1f3deab1 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.714810 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44334916-ab5e-4007-9600-b2ad1f3deab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.719095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a1920-468f-42ef-96a6-2092a4db6e53 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:03.730301 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a1920-468f-42ef-96a6-2092a4db6e53 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:03.735796 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff8871-4d6b-498f-bc42-9f1ea71380ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:03.736460 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff8871-4d6b-498f-bc42-9f1ea71380ae admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.736738 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff8871-4d6b-498f-bc42-9f1ea71380ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.737039 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff8871-4d6b-498f-bc42-9f1ea71380ae admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.737742 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff8871-4d6b-498f-bc42-9f1ea71380ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:03.737844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-44334916-ab5e-4007-9600-b2ad1f3deab1 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:03.738960 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-44334916-ab5e-4007-9600-b2ad1f3deab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:03.739660 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff8871-4d6b-498f-bc42-9f1ea71380ae admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:03.747042 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 792/1578] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:03.747799 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44334916-ab5e-4007-9600-b2ad1f3deab1 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:03.758397 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44334916-ab5e-4007-9600-b2ad1f3deab1 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:03.762925 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0db656-dcfe-4d72-b6fb-a8d9cb299900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:03.763596 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0db656-dcfe-4d72-b6fb-a8d9cb299900 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.763874 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0db656-dcfe-4d72-b6fb-a8d9cb299900 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.764147 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0db656-dcfe-4d72-b6fb-a8d9cb299900 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.764293 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 787/1579] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/users => generated 296 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:03.765771 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413666fe-4d23-474e-b5de-229bc8ba9b6f None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.765898 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0db656-dcfe-4d72-b6fb-a8d9cb299900 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:50:03.766132 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413666fe-4d23-474e-b5de-229bc8ba9b6f None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.766252 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0db656-dcfe-4d72-b6fb-a8d9cb299900 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:03.766412 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413666fe-4d23-474e-b5de-229bc8ba9b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.767929 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0db656-dcfe-4d72-b6fb-a8d9cb299900 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:03.780136 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 793/1580] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:50:03.782041 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed3978-69ad-4832-bfb3-ba2aa6f87de5 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.782328 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed3978-69ad-4832-bfb3-ba2aa6f87de5 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.782599 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed3978-69ad-4832-bfb3-ba2aa6f87de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.783517 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-413666fe-4d23-474e-b5de-229bc8ba9b6f None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:03.791412 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-413666fe-4d23-474e-b5de-229bc8ba9b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:03.794312 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 788/1581] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:03.795076 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413666fe-4d23-474e-b5de-229bc8ba9b6f None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:03.805026 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-e7ed3978-69ad-4832-bfb3-ba2aa6f87de5 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:03.806202 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-e7ed3978-69ad-4832-bfb3-ba2aa6f87de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:03.806313 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413666fe-4d23-474e-b5de-229bc8ba9b6f None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:03.811398 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0e7eb-b2de-45ee-8d03-856a5a052d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:03.812065 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0e7eb-b2de-45ee-8d03-856a5a052d78 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.812476 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0e7eb-b2de-45ee-8d03-856a5a052d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.812814 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0e7eb-b2de-45ee-8d03-856a5a052d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.813688 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0e7eb-b2de-45ee-8d03-856a5a052d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:03.814279 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 794/1582] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:03.815032 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed3978-69ad-4832-bfb3-ba2aa6f87de5 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:03.815622 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0e7eb-b2de-45ee-8d03-856a5a052d78 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:03.824989 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed3978-69ad-4832-bfb3-ba2aa6f87de5 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:03.829643 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b15bde-e715-42c0-a341-c76aacb3ec1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:03.830314 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b15bde-e715-42c0-a341-c76aacb3ec1a admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.830581 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b15bde-e715-42c0-a341-c76aacb3ec1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.830849 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b15bde-e715-42c0-a341-c76aacb3ec1a admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.831547 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b15bde-e715-42c0-a341-c76aacb3ec1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:03.833689 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b15bde-e715-42c0-a341-c76aacb3ec1a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:03.845800 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 789/1583] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:03.845800 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3f687-c368-48b7-89c3-d200a7a2d2d0 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.845800 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3f687-c368-48b7-89c3-d200a7a2d2d0 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.845800 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3f687-c368-48b7-89c3-d200a7a2d2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.862656 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-27e3f687-c368-48b7-89c3-d200a7a2d2d0 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:03.864184 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 795/1584] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:03.864330 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-27e3f687-c368-48b7-89c3-d200a7a2d2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:03.865051 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b15bde-e715-42c0-a341-c76aacb3ec1a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:03.922049 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 790/1585] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:03.922968 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3f687-c368-48b7-89c3-d200a7a2d2d0 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:03.925459 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b15bde-e715-42c0-a341-c76aacb3ec1a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:03.930482 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce9099-ce44-4dc1-9d06-760cff375697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:03.931145 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce9099-ce44-4dc1-9d06-760cff375697 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.931423 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce9099-ce44-4dc1-9d06-760cff375697 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.931696 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce9099-ce44-4dc1-9d06-760cff375697 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.931826 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3f687-c368-48b7-89c3-d200a7a2d2d0 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:03.932435 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce9099-ce44-4dc1-9d06-760cff375697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:50:03.932737 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce9099-ce44-4dc1-9d06-760cff375697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:03.934363 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce9099-ce44-4dc1-9d06-760cff375697 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:03.936329 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88396238-61e5-4105-8af4-54209eeed91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:03.937062 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88396238-61e5-4105-8af4-54209eeed91d admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.937344 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88396238-61e5-4105-8af4-54209eeed91d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.937617 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88396238-61e5-4105-8af4-54209eeed91d admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.938418 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88396238-61e5-4105-8af4-54209eeed91d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:03.939987 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88396238-61e5-4105-8af4-54209eeed91d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:03.945571 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 796/1586] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:50:03.946411 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce9099-ce44-4dc1-9d06-760cff375697 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:03.952423 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 791/1587] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:03.952423 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88396238-61e5-4105-8af4-54209eeed91d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:03.954263 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-88396238-61e5-4105-8af4-54209eeed91d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:03.961865 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce9099-ce44-4dc1-9d06-760cff375697 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:03.966282 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fc170-e01a-439a-ab4f-6980adfdb8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:03.966915 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fc170-e01a-439a-ab4f-6980adfdb8bd admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:03.967193 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fc170-e01a-439a-ab4f-6980adfdb8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:03.967470 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fc170-e01a-439a-ab4f-6980adfdb8bd admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:03.968158 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fc170-e01a-439a-ab4f-6980adfdb8bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:03.970133 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fc170-e01a-439a-ab4f-6980adfdb8bd admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:03.995288 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 797/1588] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:50:03 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:03.995288 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fc170-e01a-439a-ab4f-6980adfdb8bd admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.010123 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88396238-61e5-4105-8af4-54209eeed91d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.053764 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fc170-e01a-439a-ab4f-6980adfdb8bd admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.055700 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd19a36-7772-4abc-8fd0-0fda287b7053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.056346 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd19a36-7772-4abc-8fd0-0fda287b7053 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.056627 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd19a36-7772-4abc-8fd0-0fda287b7053 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.056931 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd19a36-7772-4abc-8fd0-0fda287b7053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.058342 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bc5de-e5fd-40e2-8213-36507bf68a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.058989 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bc5de-e5fd-40e2-8213-36507bf68a81 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.059267 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bc5de-e5fd-40e2-8213-36507bf68a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.059536 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bc5de-e5fd-40e2-8213-36507bf68a81 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.060260 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bc5de-e5fd-40e2-8213-36507bf68a81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:50:04.060559 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bc5de-e5fd-40e2-8213-36507bf68a81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.062178 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bc5de-e5fd-40e2-8213-36507bf68a81 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.065700 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd19a36-7772-4abc-8fd0-0fda287b7053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.067134 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd19a36-7772-4abc-8fd0-0fda287b7053 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.073096 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 798/1589] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:50:04.073844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bc5de-e5fd-40e2-8213-36507bf68a81 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.076414 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 792/1590] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:04.077069 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd19a36-7772-4abc-8fd0-0fda287b7053 service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.086896 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bc5de-e5fd-40e2-8213-36507bf68a81 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.087046 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd19a36-7772-4abc-8fd0-0fda287b7053 service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.091966 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf88b4-17c9-4c32-bd75-b50baa6fa5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.092114 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacaae47-838a-4f3e-a149-d56d45b5fcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.092955 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf88b4-17c9-4c32-bd75-b50baa6fa5ce admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.093085 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaae47-838a-4f3e-a149-d56d45b5fcdc admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.093178 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf88b4-17c9-4c32-bd75-b50baa6fa5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.093264 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaae47-838a-4f3e-a149-d56d45b5fcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.093348 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf88b4-17c9-4c32-bd75-b50baa6fa5ce admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.093439 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaae47-838a-4f3e-a149-d56d45b5fcdc admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.093884 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf88b4-17c9-4c32-bd75-b50baa6fa5ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.094015 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacaae47-838a-4f3e-a149-d56d45b5fcdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.095848 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf88b4-17c9-4c32-bd75-b50baa6fa5ce admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.096111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacaae47-838a-4f3e-a149-d56d45b5fcdc admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.118332 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 799/1591] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:50:04 2022] POST /identity/v3/users => generated 292 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:04.119409 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf88b4-17c9-4c32-bd75-b50baa6fa5ce admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.124521 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 793/1592] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:50:04 2022] POST /identity/v3/users => generated 287 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:04.125777 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacaae47-838a-4f3e-a149-d56d45b5fcdc admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.132292 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf88b4-17c9-4c32-bd75-b50baa6fa5ce admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.137171 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacaae47-838a-4f3e-a149-d56d45b5fcdc admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.138071 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcc39f-ac8a-4a51-b862-044ac9e1d20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.138879 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcc39f-ac8a-4a51-b862-044ac9e1d20b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.139162 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcc39f-ac8a-4a51-b862-044ac9e1d20b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.139461 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcc39f-ac8a-4a51-b862-044ac9e1d20b admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.140304 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcc39f-ac8a-4a51-b862-044ac9e1d20b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:50:04.140623 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcc39f-ac8a-4a51-b862-044ac9e1d20b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.142284 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcc39f-ac8a-4a51-b862-044ac9e1d20b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.142789 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9dfaee-46a8-48c7-8cd2-2cca0247bc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.143444 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9dfaee-46a8-48c7-8cd2-2cca0247bc1c admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.144016 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9dfaee-46a8-48c7-8cd2-2cca0247bc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.144016 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9dfaee-46a8-48c7-8cd2-2cca0247bc1c admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.145034 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9dfaee-46a8-48c7-8cd2-2cca0247bc1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.147020 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9dfaee-46a8-48c7-8cd2-2cca0247bc1c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.155412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 800/1593] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:50:04.156208 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcc39f-ac8a-4a51-b862-044ac9e1d20b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.167107 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcc39f-ac8a-4a51-b862-044ac9e1d20b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.172222 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb3e3f-d55b-4e89-a184-3fab4101deb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.172661 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb3e3f-d55b-4e89-a184-3fab4101deb9 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.172968 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb3e3f-d55b-4e89-a184-3fab4101deb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.173375 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb3e3f-d55b-4e89-a184-3fab4101deb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.174221 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb3e3f-d55b-4e89-a184-3fab4101deb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.175847 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb3e3f-d55b-4e89-a184-3fab4101deb9 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.176958 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 794/1594] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:50:04 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:04.177772 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9dfaee-46a8-48c7-8cd2-2cca0247bc1c admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.190703 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 801/1595] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:04.191832 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb3e3f-d55b-4e89-a184-3fab4101deb9 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.201815 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb3e3f-d55b-4e89-a184-3fab4101deb9 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.248479 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9dfaee-46a8-48c7-8cd2-2cca0247bc1c admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.253255 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbedac2-678b-4474-8d0c-93ed6fc39a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.253927 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbedac2-678b-4474-8d0c-93ed6fc39a9e admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.254208 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbedac2-678b-4474-8d0c-93ed6fc39a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.254605 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbedac2-678b-4474-8d0c-93ed6fc39a9e admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.255340 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbedac2-678b-4474-8d0c-93ed6fc39a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.257360 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbedac2-678b-4474-8d0c-93ed6fc39a9e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.261401 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2723fd1-c937-499b-b1a1-c9836d13cbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.262301 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2723fd1-c937-499b-b1a1-c9836d13cbb3 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.262768 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2723fd1-c937-499b-b1a1-c9836d13cbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.263230 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2723fd1-c937-499b-b1a1-c9836d13cbb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.264276 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2723fd1-c937-499b-b1a1-c9836d13cbb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.266815 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2723fd1-c937-499b-b1a1-c9836d13cbb3 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.283514 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 795/1596] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:50:04 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:04.284414 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbedac2-678b-4474-8d0c-93ed6fc39a9e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.296383 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbedac2-678b-4474-8d0c-93ed6fc39a9e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.302124 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857f751-81de-477e-9f75-4ab87f86d34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.302829 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857f751-81de-477e-9f75-4ab87f86d34c admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.303137 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857f751-81de-477e-9f75-4ab87f86d34c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.303506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857f751-81de-477e-9f75-4ab87f86d34c admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.304470 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857f751-81de-477e-9f75-4ab87f86d34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.306066 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857f751-81de-477e-9f75-4ab87f86d34c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.310653 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 802/1597] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:50:04 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:04.311318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2723fd1-c937-499b-b1a1-c9836d13cbb3 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.322192 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 796/1598] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:04.323393 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857f751-81de-477e-9f75-4ab87f86d34c admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.333636 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857f751-81de-477e-9f75-4ab87f86d34c admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.379705 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2723fd1-c937-499b-b1a1-c9836d13cbb3 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.384267 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818e09b-10a8-496f-9bc0-1e0785af516f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.384970 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818e09b-10a8-496f-9bc0-1e0785af516f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.385249 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818e09b-10a8-496f-9bc0-1e0785af516f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.385520 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818e09b-10a8-496f-9bc0-1e0785af516f admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.386248 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818e09b-10a8-496f-9bc0-1e0785af516f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.387914 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818e09b-10a8-496f-9bc0-1e0785af516f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.392335 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092ba92-1cd2-4099-b812-371e607da52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.393032 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092ba92-1cd2-4099-b812-371e607da52d admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.393311 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092ba92-1cd2-4099-b812-371e607da52d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.393590 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092ba92-1cd2-4099-b812-371e607da52d admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.394300 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092ba92-1cd2-4099-b812-371e607da52d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.396207 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092ba92-1cd2-4099-b812-371e607da52d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.401436 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 803/1599] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:04.401436 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818e09b-10a8-496f-9bc0-1e0785af516f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.422965 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818e09b-10a8-496f-9bc0-1e0785af516f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.431813 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0064d-2b08-49c8-9bdc-bad51d00a65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.432546 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0064d-2b08-49c8-9bdc-bad51d00a65b admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.432824 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0064d-2b08-49c8-9bdc-bad51d00a65b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.433137 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0064d-2b08-49c8-9bdc-bad51d00a65b admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.433836 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 797/1600] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:50:04 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:04.434002 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0064d-2b08-49c8-9bdc-bad51d00a65b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.434324 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092ba92-1cd2-4099-b812-371e607da52d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.436389 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0064d-2b08-49c8-9bdc-bad51d00a65b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.461461 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 804/1601] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:50:04 2022] POST /identity/v3/users => generated 289 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:04.462428 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0064d-2b08-49c8-9bdc-bad51d00a65b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.473047 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0064d-2b08-49c8-9bdc-bad51d00a65b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.508433 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092ba92-1cd2-4099-b812-371e607da52d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.513240 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06131c34-9ff5-44f1-bedd-6d9cb3c7aa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.514731 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06131c34-9ff5-44f1-bedd-6d9cb3c7aa83 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.515077 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06131c34-9ff5-44f1-bedd-6d9cb3c7aa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.515292 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06131c34-9ff5-44f1-bedd-6d9cb3c7aa83 admin admin] PATH_INFO: `/v3/projects/5b3ea1177c3241b5b730f359c367f44b/users/794281dc95a049b796164e866d3f2912/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.532222 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d0367-a618-439c-8fb3-cd56d69e2e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.533151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d0367-a618-439c-8fb3-cd56d69e2e67 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.533282 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d0367-a618-439c-8fb3-cd56d69e2e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.533478 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06131c34-9ff5-44f1-bedd-6d9cb3c7aa83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3ea1177c3241b5b730f359c367f44b, user_id=794281dc95a049b796164e866d3f2912, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.533585 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d0367-a618-439c-8fb3-cd56d69e2e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.534217 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d0367-a618-439c-8fb3-cd56d69e2e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.536074 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d0367-a618-439c-8fb3-cd56d69e2e67 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.536196 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06131c34-9ff5-44f1-bedd-6d9cb3c7aa83 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.549669 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 805/1602] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:04.550561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d0367-a618-439c-8fb3-cd56d69e2e67 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.551361 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 798/1603] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:50:04 2022] PUT /identity/v3/projects/5b3ea1177c3241b5b730f359c367f44b/users/794281dc95a049b796164e866d3f2912/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:04.552244 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06131c34-9ff5-44f1-bedd-6d9cb3c7aa83 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.561069 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d0367-a618-439c-8fb3-cd56d69e2e67 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.613329 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06131c34-9ff5-44f1-bedd-6d9cb3c7aa83 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.618234 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990368d-b637-4514-8aee-569d9b56a880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.618714 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72814208-69c9-4559-aecb-82ba7cca2dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.618982 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990368d-b637-4514-8aee-569d9b56a880 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.619197 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990368d-b637-4514-8aee-569d9b56a880 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.619383 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72814208-69c9-4559-aecb-82ba7cca2dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.619493 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990368d-b637-4514-8aee-569d9b56a880 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.620093 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72814208-69c9-4559-aecb-82ba7cca2dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.620229 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990368d-b637-4514-8aee-569d9b56a880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.620386 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72814208-69c9-4559-aecb-82ba7cca2dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.621136 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72814208-69c9-4559-aecb-82ba7cca2dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.622067 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990368d-b637-4514-8aee-569d9b56a880 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.622890 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72814208-69c9-4559-aecb-82ba7cca2dd7 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.634570 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 799/1604] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:04.635632 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72814208-69c9-4559-aecb-82ba7cca2dd7 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.649001 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 806/1605] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:50:04 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:04.649215 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72814208-69c9-4559-aecb-82ba7cca2dd7 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.650238 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990368d-b637-4514-8aee-569d9b56a880 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.653888 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c429b2-de23-42b4-91cb-b1592590d374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.654587 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c429b2-de23-42b4-91cb-b1592590d374 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.654858 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c429b2-de23-42b4-91cb-b1592590d374 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.655130 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c429b2-de23-42b4-91cb-b1592590d374 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.655957 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c429b2-de23-42b4-91cb-b1592590d374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.657608 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c429b2-de23-42b4-91cb-b1592590d374 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.661138 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990368d-b637-4514-8aee-569d9b56a880 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.666358 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501ed68-caca-4159-8e78-e36457c2f8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.667073 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501ed68-caca-4159-8e78-e36457c2f8e5 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.667356 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501ed68-caca-4159-8e78-e36457c2f8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.667630 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501ed68-caca-4159-8e78-e36457c2f8e5 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.668126 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 800/1606] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:04.669830 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c429b2-de23-42b4-91cb-b1592590d374 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.671859 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501ed68-caca-4159-8e78-e36457c2f8e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.674692 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501ed68-caca-4159-8e78-e36457c2f8e5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.681674 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c429b2-de23-42b4-91cb-b1592590d374 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.688454 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30576490-919c-4c93-9e43-52b840921a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.689160 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30576490-919c-4c93-9e43-52b840921a81 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.689334 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30576490-919c-4c93-9e43-52b840921a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.689681 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30576490-919c-4c93-9e43-52b840921a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.690505 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30576490-919c-4c93-9e43-52b840921a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.693214 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30576490-919c-4c93-9e43-52b840921a81 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.703415 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 807/1607] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:50:04 2022] POST /identity/v3/users => generated 287 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:04.704595 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501ed68-caca-4159-8e78-e36457c2f8e5 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.715524 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 801/1608] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:04.716987 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273da1f-beb0-4936-b8a9-abb9af7ee16c None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.717285 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273da1f-beb0-4936-b8a9-abb9af7ee16c None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.717563 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273da1f-beb0-4936-b8a9-abb9af7ee16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.718382 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501ed68-caca-4159-8e78-e36457c2f8e5 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.731536 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0a390-fe9d-435a-921c-2e857aeb43f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.732220 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0a390-fe9d-435a-921c-2e857aeb43f0 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.732502 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0a390-fe9d-435a-921c-2e857aeb43f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.732775 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0a390-fe9d-435a-921c-2e857aeb43f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.733561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0a390-fe9d-435a-921c-2e857aeb43f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.735283 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0a390-fe9d-435a-921c-2e857aeb43f0 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.738000 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-c273da1f-beb0-4936-b8a9-abb9af7ee16c None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:04.739206 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-c273da1f-beb0-4936-b8a9-abb9af7ee16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:04.746266 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 808/1609] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:04.746987 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0a390-fe9d-435a-921c-2e857aeb43f0 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.758508 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0a390-fe9d-435a-921c-2e857aeb43f0 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.762447 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 802/1610] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:04.763420 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273da1f-beb0-4936-b8a9-abb9af7ee16c None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.763562 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7f7bb-ba0f-4bec-804b-d15df03daf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.764463 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7f7bb-ba0f-4bec-804b-d15df03daf49 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.764870 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7f7bb-ba0f-4bec-804b-d15df03daf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.765039 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7f7bb-ba0f-4bec-804b-d15df03daf49 admin admin] PATH_INFO: `/v3/projects/42d38f874b484d32b9af29e66fbaf139/users/3284aee452cd4b0483a2044d36a3e357/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.773713 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273da1f-beb0-4936-b8a9-abb9af7ee16c None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.780191 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4102e7-62e5-400d-8d4c-68b82d80f2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.780624 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4102e7-62e5-400d-8d4c-68b82d80f2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.780947 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4102e7-62e5-400d-8d4c-68b82d80f2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.781224 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4102e7-62e5-400d-8d4c-68b82d80f2a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.782048 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4102e7-62e5-400d-8d4c-68b82d80f2a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.784022 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4102e7-62e5-400d-8d4c-68b82d80f2a6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.785053 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7f7bb-ba0f-4bec-804b-d15df03daf49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d38f874b484d32b9af29e66fbaf139, user_id=3284aee452cd4b0483a2044d36a3e357, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.788083 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7f7bb-ba0f-4bec-804b-d15df03daf49 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.795724 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 803/1611] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:04.796473 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4102e7-62e5-400d-8d4c-68b82d80f2a6 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.810783 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 809/1612] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:50:04 2022] PUT /identity/v3/projects/42d38f874b484d32b9af29e66fbaf139/users/3284aee452cd4b0483a2044d36a3e357/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:04.811604 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7f7bb-ba0f-4bec-804b-d15df03daf49 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.823251 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4102e7-62e5-400d-8d4c-68b82d80f2a6 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.894446 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26d3a4-eaa5-4c15-a156-3a878f6f1c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.894658 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7f7bb-ba0f-4bec-804b-d15df03daf49 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.896403 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26d3a4-eaa5-4c15-a156-3a878f6f1c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.897021 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26d3a4-eaa5-4c15-a156-3a878f6f1c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.897528 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26d3a4-eaa5-4c15-a156-3a878f6f1c48 admin admin] PATH_INFO: `/v3/projects/8334eac7c4ab4cbcb260b383197e865a/users/bcbfe00e8ca8465ba32d07379a771605/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.900270 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73703e-d53c-463b-bbe0-d6d6e4b71eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:04.901147 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73703e-d53c-463b-bbe0-d6d6e4b71eee admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:04.901427 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73703e-d53c-463b-bbe0-d6d6e4b71eee admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:04.901702 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73703e-d53c-463b-bbe0-d6d6e4b71eee admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:04.903299 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73703e-d53c-463b-bbe0-d6d6e4b71eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.904936 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73703e-d53c-463b-bbe0-d6d6e4b71eee admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.916198 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26d3a4-eaa5-4c15-a156-3a878f6f1c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8334eac7c4ab4cbcb260b383197e865a, user_id=bcbfe00e8ca8465ba32d07379a771605, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:04.919889 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 810/1613] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:04.919889 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73703e-d53c-463b-bbe0-d6d6e4b71eee admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:04.920133 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26d3a4-eaa5-4c15-a156-3a878f6f1c48 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:04.930667 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73703e-d53c-463b-bbe0-d6d6e4b71eee admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:04.935499 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 804/1614] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:50:04 2022] PUT /identity/v3/projects/8334eac7c4ab4cbcb260b383197e865a/users/bcbfe00e8ca8465ba32d07379a771605/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:04.941788 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26d3a4-eaa5-4c15-a156-3a878f6f1c48 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:05.004982 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bac22-d681-4af1-a4ca-8c35e6efeb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:05.005714 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bac22-d681-4af1-a4ca-8c35e6efeb1c admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:05.005981 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bac22-d681-4af1-a4ca-8c35e6efeb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:05.006258 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bac22-d681-4af1-a4ca-8c35e6efeb1c admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:05.007127 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390bac22-d681-4af1-a4ca-8c35e6efeb1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:05.009127 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390bac22-d681-4af1-a4ca-8c35e6efeb1c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:05.021311 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 811/1615] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:05.022207 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bac22-d681-4af1-a4ca-8c35e6efeb1c admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:05.025621 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26d3a4-eaa5-4c15-a156-3a878f6f1c48 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:05.031908 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521dd85-ac0e-4d27-be79-2dd0fde2c560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:05.032780 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521dd85-ac0e-4d27-be79-2dd0fde2c560 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:05.033099 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521dd85-ac0e-4d27-be79-2dd0fde2c560 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:05.033384 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521dd85-ac0e-4d27-be79-2dd0fde2c560 admin admin] PATH_INFO: `/v3/projects/08d4842074994421989ef7568b65aea9/users/947bc36861e64e31811cb898f46a72e1/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:05.051748 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521dd85-ac0e-4d27-be79-2dd0fde2c560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08d4842074994421989ef7568b65aea9, user_id=947bc36861e64e31811cb898f46a72e1, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:05.054503 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521dd85-ac0e-4d27-be79-2dd0fde2c560 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:05.075689 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 805/1616] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:50:04 2022] PUT /identity/v3/projects/08d4842074994421989ef7568b65aea9/users/947bc36861e64e31811cb898f46a72e1/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:05.075689 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521dd85-ac0e-4d27-be79-2dd0fde2c560 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:05.086118 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bac22-d681-4af1-a4ca-8c35e6efeb1c admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:05.144345 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa181a74-03f2-4118-9b80-7fa3c9eea0fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:05.145088 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa181a74-03f2-4118-9b80-7fa3c9eea0fc service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:05.145384 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa181a74-03f2-4118-9b80-7fa3c9eea0fc service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:05.145659 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa181a74-03f2-4118-9b80-7fa3c9eea0fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:05.153177 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521dd85-ac0e-4d27-be79-2dd0fde2c560 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:05.158025 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297a283-acab-46c5-808f-b63c338c4639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:05.158604 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa181a74-03f2-4118-9b80-7fa3c9eea0fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:05.158751 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297a283-acab-46c5-808f-b63c338c4639 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:05.158963 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297a283-acab-46c5-808f-b63c338c4639 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:05.159241 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297a283-acab-46c5-808f-b63c338c4639 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:05.160250 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297a283-acab-46c5-808f-b63c338c4639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:05.160934 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa181a74-03f2-4118-9b80-7fa3c9eea0fc service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:05.162360 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297a283-acab-46c5-808f-b63c338c4639 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:05.174416 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 812/1617] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:05.175813 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71db19a-a617-4b51-aeb2-b08ebcfe7083 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:05.176101 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71db19a-a617-4b51-aeb2-b08ebcfe7083 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:05.176378 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71db19a-a617-4b51-aeb2-b08ebcfe7083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:05.178472 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 806/1618] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:05.179428 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297a283-acab-46c5-808f-b63c338c4639 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:05.190658 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297a283-acab-46c5-808f-b63c338c4639 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:05.195431 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-f71db19a-a617-4b51-aeb2-b08ebcfe7083 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:05.195739 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b69f4-8dcb-4faf-a50e-3c35b267df73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:05.196390 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b69f4-8dcb-4faf-a50e-3c35b267df73 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:05.196659 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f71db19a-a617-4b51-aeb2-b08ebcfe7083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:05.196767 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b69f4-8dcb-4faf-a50e-3c35b267df73 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:05.196969 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b69f4-8dcb-4faf-a50e-3c35b267df73 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:05.197759 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b69f4-8dcb-4faf-a50e-3c35b267df73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:05.200776 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b69f4-8dcb-4faf-a50e-3c35b267df73 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:05.208633 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 813/1619] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:05.208633 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6a9bb-c4d7-4934-ac1b-cb90c18f65da None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:05.208633 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6a9bb-c4d7-4934-ac1b-cb90c18f65da None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:05.208633 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6a9bb-c4d7-4934-ac1b-cb90c18f65da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:05.223110 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 807/1620] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:05.223110 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b69f4-8dcb-4faf-a50e-3c35b267df73 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:05.237261 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b69f4-8dcb-4faf-a50e-3c35b267df73 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:05.243660 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790321b-c1a8-464a-b9ed-8a7db8423d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:05.244571 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790321b-c1a8-464a-b9ed-8a7db8423d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:05.244877 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790321b-c1a8-464a-b9ed-8a7db8423d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:05.245248 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790321b-c1a8-464a-b9ed-8a7db8423d87 admin admin] PATH_INFO: `/v3/projects/2c61bba037fc49bead261e835ebd4b56/users/1408f7946fad4d02932c89a1d1e7967d/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:05.248124 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-72a6a9bb-c4d7-4934-ac1b-cb90c18f65da None None] MFA Rules not processed for user `bcbfe00e8ca8465ba32d07379a771605`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:05.249714 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-72a6a9bb-c4d7-4934-ac1b-cb90c18f65da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:05.271032 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790321b-c1a8-464a-b9ed-8a7db8423d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c61bba037fc49bead261e835ebd4b56, user_id=1408f7946fad4d02932c89a1d1e7967d, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:05.275776 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790321b-c1a8-464a-b9ed-8a7db8423d87 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:05.300285 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 808/1621] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:50:05 2022] PUT /identity/v3/projects/2c61bba037fc49bead261e835ebd4b56/users/1408f7946fad4d02932c89a1d1e7967d/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:05.303059 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51424752-f923-49d1-bcda-4f7acb1c7425 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:05.303570 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51424752-f923-49d1-bcda-4f7acb1c7425 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:05.304310 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51424752-f923-49d1-bcda-4f7acb1c7425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:05.336472 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 814/1622] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:05.336472 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6a9bb-c4d7-4934-ac1b-cb90c18f65da None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:05.350442 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-51424752-f923-49d1-bcda-4f7acb1c7425 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:05.351109 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6a9bb-c4d7-4934-ac1b-cb90c18f65da None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:05.353226 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-51424752-f923-49d1-bcda-4f7acb1c7425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:05.432837 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b794e0d-eee2-463b-9be6-92ad6f7d1faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:05.433887 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b794e0d-eee2-463b-9be6-92ad6f7d1faf admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:05.434369 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b794e0d-eee2-463b-9be6-92ad6f7d1faf admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:05.434742 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b794e0d-eee2-463b-9be6-92ad6f7d1faf admin admin] PATH_INFO: `/v3/projects/a4a2de280d124b4da2a4b0a6aa63f363/users/d18658ed89f745718455f349887991d4/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:05.442306 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 809/1623] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:05.443544 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51424752-f923-49d1-bcda-4f7acb1c7425 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:05.456540 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b794e0d-eee2-463b-9be6-92ad6f7d1faf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4a2de280d124b4da2a4b0a6aa63f363, user_id=d18658ed89f745718455f349887991d4, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:05.460769 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b794e0d-eee2-463b-9be6-92ad6f7d1faf admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:05.492376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 815/1624] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:50:05 2022] PUT /identity/v3/projects/a4a2de280d124b4da2a4b0a6aa63f363/users/d18658ed89f745718455f349887991d4/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:05.492376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b794e0d-eee2-463b-9be6-92ad6f7d1faf admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:05.555443 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51424752-f923-49d1-bcda-4f7acb1c7425 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:05.592956 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b794e0d-eee2-463b-9be6-92ad6f7d1faf admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:05.598979 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315a494-56a3-47f0-9dd6-cbaa448c56d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:05.599904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315a494-56a3-47f0-9dd6-cbaa448c56d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:05.600190 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315a494-56a3-47f0-9dd6-cbaa448c56d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:05.600790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315a494-56a3-47f0-9dd6-cbaa448c56d7 admin admin] PATH_INFO: `/v3/projects/5e5e176c34574fb7b59313616ef863b3/users/9d60b23c00e74d0aa4e1c3e4fca7e88e/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:05.620994 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315a494-56a3-47f0-9dd6-cbaa448c56d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5e176c34574fb7b59313616ef863b3, user_id=9d60b23c00e74d0aa4e1c3e4fca7e88e, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:05.622213 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87548a67-01b2-462e-9393-ab34b24eb7f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:05.623111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87548a67-01b2-462e-9393-ab34b24eb7f1 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:05.623563 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87548a67-01b2-462e-9393-ab34b24eb7f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:05.624110 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87548a67-01b2-462e-9393-ab34b24eb7f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:05.624337 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315a494-56a3-47f0-9dd6-cbaa448c56d7 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:05.637141 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87548a67-01b2-462e-9393-ab34b24eb7f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:05.638933 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87548a67-01b2-462e-9393-ab34b24eb7f1 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:05.643517 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 816/1625] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:50:05 2022] PUT /identity/v3/projects/5e5e176c34574fb7b59313616ef863b3/users/9d60b23c00e74d0aa4e1c3e4fca7e88e/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:05.645053 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64743cf-af64-468f-b711-de6e96be5db4 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:05.647211 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64743cf-af64-468f-b711-de6e96be5db4 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:05.647494 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64743cf-af64-468f-b711-de6e96be5db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:05.659117 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 810/1626] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:05.660325 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87548a67-01b2-462e-9393-ab34b24eb7f1 service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:05.672668 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87548a67-01b2-462e-9393-ab34b24eb7f1 service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:05.710441 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-b64743cf-af64-468f-b711-de6e96be5db4 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:05.712556 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b64743cf-af64-468f-b711-de6e96be5db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:05.751656 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29557572-e353-4cd7-94af-5b8793d4fbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:05.752398 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29557572-e353-4cd7-94af-5b8793d4fbdf admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:05.752756 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29557572-e353-4cd7-94af-5b8793d4fbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:05.752994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29557572-e353-4cd7-94af-5b8793d4fbdf admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:05.754286 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29557572-e353-4cd7-94af-5b8793d4fbdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:05.764755 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29557572-e353-4cd7-94af-5b8793d4fbdf admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:05.832477 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 811/1627] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:50:05 2022] POST /identity/v3/projects => generated 371 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:05.832477 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29557572-e353-4cd7-94af-5b8793d4fbdf admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:05.888833 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 817/1628] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:05.888833 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06590b68-399e-42b4-9123-b652a55f5cc6 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:05.888833 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06590b68-399e-42b4-9123-b652a55f5cc6 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:05.888833 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06590b68-399e-42b4-9123-b652a55f5cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:05.912521 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-06590b68-399e-42b4-9123-b652a55f5cc6 None None] MFA Rules not processed for user `d18658ed89f745718455f349887991d4`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:05.914440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-06590b68-399e-42b4-9123-b652a55f5cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:05.952134 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29557572-e353-4cd7-94af-5b8793d4fbdf admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:05.965955 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc946e8a-fc53-4d45-9462-5d3bb1d7d2bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:05.966968 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc946e8a-fc53-4d45-9462-5d3bb1d7d2bd service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:05.967261 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc946e8a-fc53-4d45-9462-5d3bb1d7d2bd service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:05.967539 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc946e8a-fc53-4d45-9462-5d3bb1d7d2bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:06.020346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 818/1629] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:06.027717 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82741d68-3ce1-432e-9803-1723cab03b3d None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:06.028025 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82741d68-3ce1-432e-9803-1723cab03b3d None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:06.028348 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82741d68-3ce1-432e-9803-1723cab03b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:06.074859 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-82741d68-3ce1-432e-9803-1723cab03b3d None None] MFA Rules not processed for user `9d60b23c00e74d0aa4e1c3e4fca7e88e`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:06.078747 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-82741d68-3ce1-432e-9803-1723cab03b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:06.149217 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc946e8a-fc53-4d45-9462-5d3bb1d7d2bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:06.152360 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc946e8a-fc53-4d45-9462-5d3bb1d7d2bd service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:06.173661 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 812/1630] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:06.174510 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc946e8a-fc53-4d45-9462-5d3bb1d7d2bd service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:06.188666 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc946e8a-fc53-4d45-9462-5d3bb1d7d2bd service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:06.195370 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd6bb3-7e95-427f-82b8-a578ad0aabaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:06.196178 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd6bb3-7e95-427f-82b8-a578ad0aabaa admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:06.196449 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd6bb3-7e95-427f-82b8-a578ad0aabaa admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:06.196727 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd6bb3-7e95-427f-82b8-a578ad0aabaa admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:06.197590 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd6bb3-7e95-427f-82b8-a578ad0aabaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:06.199558 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd6bb3-7e95-427f-82b8-a578ad0aabaa admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:06.212404 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 819/1631] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:06.213858 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82741d68-3ce1-432e-9803-1723cab03b3d None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:06.229821 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82741d68-3ce1-432e-9803-1723cab03b3d None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:06.232643 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 813/1632] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:50:06 2022] POST /identity/v3/users => generated 292 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:06.233654 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd6bb3-7e95-427f-82b8-a578ad0aabaa admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:06.237350 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b201d2-e590-4a7b-80a5-2b0b91180cac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:06.238268 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b201d2-e590-4a7b-80a5-2b0b91180cac service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:06.238774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b201d2-e590-4a7b-80a5-2b0b91180cac service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:06.239248 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b201d2-e590-4a7b-80a5-2b0b91180cac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:06.253465 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b201d2-e590-4a7b-80a5-2b0b91180cac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:06.255384 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b201d2-e590-4a7b-80a5-2b0b91180cac service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:06.257218 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd6bb3-7e95-427f-82b8-a578ad0aabaa admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:06.267785 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8137bbe-0a55-41e8-b59a-a21e69ef0439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:06.268528 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8137bbe-0a55-41e8-b59a-a21e69ef0439 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:06.268926 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8137bbe-0a55-41e8-b59a-a21e69ef0439 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:06.269552 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8137bbe-0a55-41e8-b59a-a21e69ef0439 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:06.269760 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 820/1633] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:06.270973 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8137bbe-0a55-41e8-b59a-a21e69ef0439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:06.276575 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8137bbe-0a55-41e8-b59a-a21e69ef0439 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:06.280577 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b201d2-e590-4a7b-80a5-2b0b91180cac service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:06.299765 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b201d2-e590-4a7b-80a5-2b0b91180cac service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:06.310236 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4893c5-fe58-4af1-b1ca-254edaae280e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:06.311427 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4893c5-fe58-4af1-b1ca-254edaae280e admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:06.318850 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4893c5-fe58-4af1-b1ca-254edaae280e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:06.319321 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4893c5-fe58-4af1-b1ca-254edaae280e admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:06.320197 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4893c5-fe58-4af1-b1ca-254edaae280e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:06.322570 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4893c5-fe58-4af1-b1ca-254edaae280e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:06.326413 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 814/1634] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:50:06 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:06.328411 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c5995-3c3d-4dc3-867f-4079464034e7 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:06.328919 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c5995-3c3d-4dc3-867f-4079464034e7 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:06.329398 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c5995-3c3d-4dc3-867f-4079464034e7 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:06.331447 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 815/1635] 10.222.0.31 () {54 vars in 961 bytes} [Mon Jan 10 17:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:50:06.332487 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c5995-3c3d-4dc3-867f-4079464034e7 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:06.340513 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 821/1636] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:06.342373 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a0f81-30fe-450b-b6f1-460978321273 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:06.342778 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a0f81-30fe-450b-b6f1-460978321273 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:06.343127 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a0f81-30fe-450b-b6f1-460978321273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:06.364298 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-1d8a0f81-30fe-450b-b6f1-460978321273 None None] MFA Rules not processed for user `877acd6448214ef893d119e3b1043402`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:06.365699 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-1d8a0f81-30fe-450b-b6f1-460978321273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:06.426383 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c5995-3c3d-4dc3-867f-4079464034e7 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:06.433963 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b335ca3-0ee3-4818-a433-484efc357df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:06.435096 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335ca3-0ee3-4818-a433-484efc357df9 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:06.435567 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335ca3-0ee3-4818-a433-484efc357df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:06.436170 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335ca3-0ee3-4818-a433-484efc357df9 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:06.437166 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b335ca3-0ee3-4818-a433-484efc357df9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:06.440153 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b335ca3-0ee3-4818-a433-484efc357df9 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:06.463547 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 822/1637] 10.222.0.31 () {58 vars in 1058 bytes} [Mon Jan 10 17:50:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:06.466025 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a0f81-30fe-450b-b6f1-460978321273 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:06.481282 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 816/1638] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:50:06 2022] POST /identity/v3/users => generated 298 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:06.483272 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b335ca3-0ee3-4818-a433-484efc357df9 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:06.488521 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a0f81-30fe-450b-b6f1-460978321273 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:06.494149 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a086a-6702-42e1-8f7f-9293fcf50675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:06.495552 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a086a-6702-42e1-8f7f-9293fcf50675 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:06.495935 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a086a-6702-42e1-8f7f-9293fcf50675 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:06.496892 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a086a-6702-42e1-8f7f-9293fcf50675 admin admin] PATH_INFO: `/v3/projects/5199df0c4c1d407e9c47ce41d1f41955/users/cb1dba5062c54e15bccbecaec80e5a6e/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:06.519760 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b335ca3-0ee3-4818-a433-484efc357df9 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:06.524288 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a086a-6702-42e1-8f7f-9293fcf50675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5199df0c4c1d407e9c47ce41d1f41955, user_id=cb1dba5062c54e15bccbecaec80e5a6e, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:06.527230 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f920c-9ce8-478c-9193-b65174f14ff5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:06.527950 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a086a-6702-42e1-8f7f-9293fcf50675 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:06.529148 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f920c-9ce8-478c-9193-b65174f14ff5 service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:06.529603 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f920c-9ce8-478c-9193-b65174f14ff5 service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:06.530036 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f920c-9ce8-478c-9193-b65174f14ff5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:06.556465 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 823/1639] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:50:06 2022] PUT /identity/v3/projects/5199df0c4c1d407e9c47ce41d1f41955/users/cb1dba5062c54e15bccbecaec80e5a6e/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:06.557875 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a086a-6702-42e1-8f7f-9293fcf50675 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:06.611837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f920c-9ce8-478c-9193-b65174f14ff5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:06.614150 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f920c-9ce8-478c-9193-b65174f14ff5 service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:06.634490 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 817/1640] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:06.635363 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f920c-9ce8-478c-9193-b65174f14ff5 service nova] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:06.646706 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f920c-9ce8-478c-9193-b65174f14ff5 service nova] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:06.698566 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a086a-6702-42e1-8f7f-9293fcf50675 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:06.705249 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321df60-7fef-4e84-b68b-2e9173366942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:06.706207 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321df60-7fef-4e84-b68b-2e9173366942 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:06.707088 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321df60-7fef-4e84-b68b-2e9173366942 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:06.707687 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321df60-7fef-4e84-b68b-2e9173366942 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:06.708766 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321df60-7fef-4e84-b68b-2e9173366942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:06.712421 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321df60-7fef-4e84-b68b-2e9173366942 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:06.730692 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 824/1641] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:06.740478 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321df60-7fef-4e84-b68b-2e9173366942 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:06.757234 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321df60-7fef-4e84-b68b-2e9173366942 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:06.765232 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e7544-86fa-4047-89ed-b1b146572c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:06.767036 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e7544-86fa-4047-89ed-b1b146572c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:06.767295 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be09f4-6139-42af-bd62-5695a65eca0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:06.767832 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e7544-86fa-4047-89ed-b1b146572c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:06.768010 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be09f4-6139-42af-bd62-5695a65eca0c admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:06.768246 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be09f4-6139-42af-bd62-5695a65eca0c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:06.768567 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be09f4-6139-42af-bd62-5695a65eca0c admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:06.769240 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e7544-86fa-4047-89ed-b1b146572c73 admin admin] PATH_INFO: `/v3/projects/60fcb2ce43dc4ea1bbefcedee87adad3/users/2addccee9451442c9d4ba77e45e1c3eb/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:06.769364 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be09f4-6139-42af-bd62-5695a65eca0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:06.771073 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be09f4-6139-42af-bd62-5695a65eca0c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:06.795217 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e7544-86fa-4047-89ed-b1b146572c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60fcb2ce43dc4ea1bbefcedee87adad3, user_id=2addccee9451442c9d4ba77e45e1c3eb, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:06.801031 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 818/1642] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:06.802242 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be09f4-6139-42af-bd62-5695a65eca0c admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:06.803749 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e7544-86fa-4047-89ed-b1b146572c73 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:06.818004 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be09f4-6139-42af-bd62-5695a65eca0c admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:06.829349 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 825/1643] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:50:06 2022] PUT /identity/v3/projects/60fcb2ce43dc4ea1bbefcedee87adad3/users/2addccee9451442c9d4ba77e45e1c3eb/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:06.831466 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e7544-86fa-4047-89ed-b1b146572c73 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:06.959871 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b9475-bcfe-4416-afd2-bf94b8660dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:06.962122 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b9475-bcfe-4416-afd2-bf94b8660dac admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:06.963016 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b9475-bcfe-4416-afd2-bf94b8660dac admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:06.964649 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b9475-bcfe-4416-afd2-bf94b8660dac admin admin] PATH_INFO: `/v3/projects/5199df0c4c1d407e9c47ce41d1f41955/users/cb1dba5062c54e15bccbecaec80e5a6e/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:06.969758 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b9475-bcfe-4416-afd2-bf94b8660dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=5199df0c4c1d407e9c47ce41d1f41955, user_id=cb1dba5062c54e15bccbecaec80e5a6e, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:06.976613 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b9475-bcfe-4416-afd2-bf94b8660dac admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:06.989946 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 819/1644] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:50:06 2022] PUT /identity/v3/projects/5199df0c4c1d407e9c47ce41d1f41955/users/cb1dba5062c54e15bccbecaec80e5a6e/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:50:07.043295 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdce08-f3cd-457a-8f4e-5be23e228954 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:07.043665 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdce08-f3cd-457a-8f4e-5be23e228954 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:07.043951 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdce08-f3cd-457a-8f4e-5be23e228954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:07.050062 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e7544-86fa-4047-89ed-b1b146572c73 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:07.101505 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-6fcdce08-f3cd-457a-8f4e-5be23e228954 None None] MFA Rules not processed for user `cb1dba5062c54e15bccbecaec80e5a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:07.103099 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-6fcdce08-f3cd-457a-8f4e-5be23e228954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:07.218921 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cfe79-cadf-4b6a-9f30-8782c83830d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:07.222079 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cfe79-cadf-4b6a-9f30-8782c83830d2 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:07.222595 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cfe79-cadf-4b6a-9f30-8782c83830d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:07.223322 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cfe79-cadf-4b6a-9f30-8782c83830d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:07.227657 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27cfe79-cadf-4b6a-9f30-8782c83830d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:07.233833 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27cfe79-cadf-4b6a-9f30-8782c83830d2 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:07.264688 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 826/1645] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:07.265936 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cfe79-cadf-4b6a-9f30-8782c83830d2 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:07.278830 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cfe79-cadf-4b6a-9f30-8782c83830d2 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:07.284958 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51aa5a-f580-412a-8a1f-4b952d569c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:07.286006 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51aa5a-f580-412a-8a1f-4b952d569c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:07.286491 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51aa5a-f580-412a-8a1f-4b952d569c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:07.287461 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51aa5a-f580-412a-8a1f-4b952d569c20 admin admin] PATH_INFO: `/v3/projects/60fcb2ce43dc4ea1bbefcedee87adad3/users/2addccee9451442c9d4ba77e45e1c3eb/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:07.290468 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51aa5a-f580-412a-8a1f-4b952d569c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60fcb2ce43dc4ea1bbefcedee87adad3, user_id=2addccee9451442c9d4ba77e45e1c3eb, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:07.291536 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 820/1646] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:07 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:07.300449 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51aa5a-f580-412a-8a1f-4b952d569c20 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:07.303651 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdce08-f3cd-457a-8f4e-5be23e228954 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:07.330083 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 827/1647] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:50:07 2022] PUT /identity/v3/projects/60fcb2ce43dc4ea1bbefcedee87adad3/users/2addccee9451442c9d4ba77e45e1c3eb/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:07.383862 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d5133-9268-443d-b585-6040ca3cc169 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:07.384156 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d5133-9268-443d-b585-6040ca3cc169 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:07.384440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d5133-9268-443d-b585-6040ca3cc169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:07.455778 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-606d5133-9268-443d-b585-6040ca3cc169 None None] MFA Rules not processed for user `2addccee9451442c9d4ba77e45e1c3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:07.457470 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-606d5133-9268-443d-b585-6040ca3cc169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:07.468023 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdce08-f3cd-457a-8f4e-5be23e228954 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:07.569013 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 828/1648] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:07.570543 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6aff0-8b12-406d-bb4b-487292375c60 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:07.571423 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6aff0-8b12-406d-bb4b-487292375c60 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:07.571822 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6aff0-8b12-406d-bb4b-487292375c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:07.580568 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dafba1-afd2-41e7-a668-854d7a24c962 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:07.581266 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dafba1-afd2-41e7-a668-854d7a24c962 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:07.581548 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dafba1-afd2-41e7-a668-854d7a24c962 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:07.581819 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dafba1-afd2-41e7-a668-854d7a24c962 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:07.607908 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-cfc6aff0-8b12-406d-bb4b-487292375c60 None None] MFA Rules not processed for user `3284aee452cd4b0483a2044d36a3e357`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:07.609784 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-cfc6aff0-8b12-406d-bb4b-487292375c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:07.667902 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dafba1-afd2-41e7-a668-854d7a24c962 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:07.670001 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dafba1-afd2-41e7-a668-854d7a24c962 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:07.683908 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 821/1649] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:07 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:50:07.707675 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fa175-79dc-409e-b7c8-cc22e35b885f None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:07.712638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fa175-79dc-409e-b7c8-cc22e35b885f None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:07.713035 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fa175-79dc-409e-b7c8-cc22e35b885f None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:07.731859 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 822/1650] 10.222.0.31 () {54 vars in 961 bytes} [Mon Jan 10 17:50:07 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:50:07.732433 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fa175-79dc-409e-b7c8-cc22e35b885f None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:07.771779 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fa175-79dc-409e-b7c8-cc22e35b885f None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:07.792565 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df571e-3682-40a5-bc73-8edc38b53709 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:07.793740 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df571e-3682-40a5-bc73-8edc38b53709 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:07.794760 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df571e-3682-40a5-bc73-8edc38b53709 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:07.797170 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df571e-3682-40a5-bc73-8edc38b53709 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:07.812421 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 829/1651] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:07.813843 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6884d3b-8e91-409b-b343-ebacafaa1d0f None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:07.814134 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6884d3b-8e91-409b-b343-ebacafaa1d0f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:07.814415 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6884d3b-8e91-409b-b343-ebacafaa1d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:07.822580 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df571e-3682-40a5-bc73-8edc38b53709 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:07.825913 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df571e-3682-40a5-bc73-8edc38b53709 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:07.857191 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-e6884d3b-8e91-409b-b343-ebacafaa1d0f None None] MFA Rules not processed for user `877acd6448214ef893d119e3b1043402`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:07.859070 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-e6884d3b-8e91-409b-b343-ebacafaa1d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:07.865256 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 823/1652] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:07.892551 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85075a50-941d-4917-8287-646db45986f3 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:07.894003 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85075a50-941d-4917-8287-646db45986f3 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:07.894518 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85075a50-941d-4917-8287-646db45986f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:07.965209 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-85075a50-941d-4917-8287-646db45986f3 None None] MFA Rules not processed for user `3284aee452cd4b0483a2044d36a3e357`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:07.973192 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-85075a50-941d-4917-8287-646db45986f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:07.986508 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 824/1653] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:07.986508 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85075a50-941d-4917-8287-646db45986f3 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:08.041047 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85075a50-941d-4917-8287-646db45986f3 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:08.054090 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f2a7b-7fed-4163-a701-a6d7d3a7b27d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:08.054805 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f2a7b-7fed-4163-a701-a6d7d3a7b27d service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:08.055628 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f2a7b-7fed-4163-a701-a6d7d3a7b27d service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:08.055934 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f2a7b-7fed-4163-a701-a6d7d3a7b27d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:08.105646 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 830/1654] 10.222.0.31 () {58 vars in 1058 bytes} [Mon Jan 10 17:50:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:08.106774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6884d3b-8e91-409b-b343-ebacafaa1d0f None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:08.124681 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6884d3b-8e91-409b-b343-ebacafaa1d0f None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:08.142741 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc317e48-0b25-4541-918a-d4e472a1ef76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:08.143515 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc317e48-0b25-4541-918a-d4e472a1ef76 service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:08.143911 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc317e48-0b25-4541-918a-d4e472a1ef76 service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:08.144282 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc317e48-0b25-4541-918a-d4e472a1ef76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:08.167095 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc317e48-0b25-4541-918a-d4e472a1ef76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:08.169220 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc317e48-0b25-4541-918a-d4e472a1ef76 service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:08.189862 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f2a7b-7fed-4163-a701-a6d7d3a7b27d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:08.191349 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f2a7b-7fed-4163-a701-a6d7d3a7b27d service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:08.193581 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 831/1655] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:08.194609 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc317e48-0b25-4541-918a-d4e472a1ef76 service nova] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:08.208062 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc317e48-0b25-4541-918a-d4e472a1ef76 service nova] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:08.210734 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 825/1656] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:08.212339 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0bfb1-4922-45a9-9916-0495c2a768b2 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:08.212643 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0bfb1-4922-45a9-9916-0495c2a768b2 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:08.212951 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0bfb1-4922-45a9-9916-0495c2a768b2 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:08.213818 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd4e6a-dd5f-4a83-8596-c6b34ac095d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:08.214448 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd4e6a-dd5f-4a83-8596-c6b34ac095d7 service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:08.214726 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd4e6a-dd5f-4a83-8596-c6b34ac095d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:08.215028 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 826/1657] 10.222.0.31 () {54 vars in 912 bytes} [Mon Jan 10 17:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:50:08.219953 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd4e6a-dd5f-4a83-8596-c6b34ac095d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:08.221134 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2675ed5-196f-436a-82ef-14b13cb5d7a3 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:08.221420 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2675ed5-196f-436a-82ef-14b13cb5d7a3 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:08.221693 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2675ed5-196f-436a-82ef-14b13cb5d7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:08.261039 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b2675ed5-196f-436a-82ef-14b13cb5d7a3 None None] MFA Rules not processed for user `877acd6448214ef893d119e3b1043402`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:08.262280 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b2675ed5-196f-436a-82ef-14b13cb5d7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:08.279330 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 827/1658] 10.222.0.31 () {58 vars in 1009 bytes} [Mon Jan 10 17:50:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:08.313210 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd4e6a-dd5f-4a83-8596-c6b34ac095d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:08.314774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd4e6a-dd5f-4a83-8596-c6b34ac095d7 service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:08.341690 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 832/1659] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:08.373524 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deda8e-b619-412f-8672-a13e9117ce59 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:08.374136 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deda8e-b619-412f-8672-a13e9117ce59 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:08.374136 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deda8e-b619-412f-8672-a13e9117ce59 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:08.376282 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 828/1660] 10.222.0.31 () {54 vars in 912 bytes} [Mon Jan 10 17:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:50:08.383804 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520af12-8e14-4d27-b4b5-645d11a8fcc7 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:08.384437 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520af12-8e14-4d27-b4b5-645d11a8fcc7 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:08.384963 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520af12-8e14-4d27-b4b5-645d11a8fcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:08.422347 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-6520af12-8e14-4d27-b4b5-645d11a8fcc7 None None] MFA Rules not processed for user `877acd6448214ef893d119e3b1043402`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:08.423688 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-6520af12-8e14-4d27-b4b5-645d11a8fcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:08.441490 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 833/1661] 10.222.0.31 () {58 vars in 1009 bytes} [Mon Jan 10 17:50:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:08.458578 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78deda8e-b619-412f-8672-a13e9117ce59 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:08.462274 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-78deda8e-b619-412f-8672-a13e9117ce59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:08.610649 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78deda8e-b619-412f-8672-a13e9117ce59 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:08.615167 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f4f1a-2066-47ec-a2d7-9ded9b746023 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15232a1930bc43e8bb5aa7310a709056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:08.616027 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f4f1a-2066-47ec-a2d7-9ded9b746023 service glance] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:08.616712 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f4f1a-2066-47ec-a2d7-9ded9b746023 service glance] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:08.618114 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f4f1a-2066-47ec-a2d7-9ded9b746023 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:08.636117 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520af12-8e14-4d27-b4b5-645d11a8fcc7 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:08.647066 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f4f1a-2066-47ec-a2d7-9ded9b746023 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:08.648046 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520af12-8e14-4d27-b4b5-645d11a8fcc7 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:08.649692 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f4f1a-2066-47ec-a2d7-9ded9b746023 service glance] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:08.659327 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c269a-70b8-4617-8bb2-76a7f8c895bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:08.660146 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c269a-70b8-4617-8bb2-76a7f8c895bc service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:08.660544 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c269a-70b8-4617-8bb2-76a7f8c895bc service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:08.660947 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c269a-70b8-4617-8bb2-76a7f8c895bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:08.672043 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 829/1662] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:08.699680 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c269a-70b8-4617-8bb2-76a7f8c895bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:08.701264 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c269a-70b8-4617-8bb2-76a7f8c895bc service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:08.762240 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 834/1663] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:50:09.053541 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fdecd-c923-4aa2-91e0-97dce697d3e6 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:09.054002 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fdecd-c923-4aa2-91e0-97dce697d3e6 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:09.054447 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fdecd-c923-4aa2-91e0-97dce697d3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:09.125284 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-672fdecd-c923-4aa2-91e0-97dce697d3e6 None None] MFA Rules not processed for user `1408f7946fad4d02932c89a1d1e7967d`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:09.126599 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-672fdecd-c923-4aa2-91e0-97dce697d3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:09.265159 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c269a-70b8-4617-8bb2-76a7f8c895bc service cinder] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:09.359655 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 830/1664] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:09.404502 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc31d6-023b-491d-a0df-181cfcdff202 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:09.405245 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc31d6-023b-491d-a0df-181cfcdff202 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:09.405245 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc31d6-023b-491d-a0df-181cfcdff202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:09.427463 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c269a-70b8-4617-8bb2-76a7f8c895bc service cinder] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:09.442696 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afdb9e-6909-466a-9c4b-747ba73ddb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:09.443616 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afdb9e-6909-466a-9c4b-747ba73ddb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:09.443901 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afdb9e-6909-466a-9c4b-747ba73ddb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:09.444182 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afdb9e-6909-466a-9c4b-747ba73ddb59 admin admin] PATH_INFO: `/v3/users/9d60b23c00e74d0aa4e1c3e4fca7e88e` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:09.449186 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afdb9e-6909-466a-9c4b-747ba73ddb59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d60b23c00e74d0aa4e1c3e4fca7e88e)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:09.450728 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: WARNING py.warnings [None req-19afdb9e-6909-466a-9c4b-747ba73ddb59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:50:09.450728 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: warnings.warn(msg) Jan 10 17:50:09.450728 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: Jan 10 17:50:09.451853 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-75bc31d6-023b-491d-a0df-181cfcdff202 None None] MFA Rules not processed for user `1408f7946fad4d02932c89a1d1e7967d`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:09.453506 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afdb9e-6909-466a-9c4b-747ba73ddb59 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:09.455049 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-75bc31d6-023b-491d-a0df-181cfcdff202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:09.482572 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 831/1665] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:09.500671 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc31d6-023b-491d-a0df-181cfcdff202 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:09.545839 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc31d6-023b-491d-a0df-181cfcdff202 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:09.571577 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812396d1-d97d-46b1-9d97-f65a61314712 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:09.572797 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812396d1-d97d-46b1-9d97-f65a61314712 service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:09.573345 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812396d1-d97d-46b1-9d97-f65a61314712 service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:09.573833 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812396d1-d97d-46b1-9d97-f65a61314712 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:09.594467 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812396d1-d97d-46b1-9d97-f65a61314712 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:09.595583 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-19afdb9e-6909-466a-9c4b-747ba73ddb59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d60b23c00e74d0aa4e1c3e4fca7e88e'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:09.596323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812396d1-d97d-46b1-9d97-f65a61314712 service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:09.598833 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-19afdb9e-6909-466a-9c4b-747ba73ddb59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d60b23c00e74d0aa4e1c3e4fca7e88e'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:09.600924 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-19afdb9e-6909-466a-9c4b-747ba73ddb59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d60b23c00e74d0aa4e1c3e4fca7e88e'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:09.641671 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 832/1666] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:09.669213 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-19afdb9e-6909-466a-9c4b-747ba73ddb59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d60b23c00e74d0aa4e1c3e4fca7e88e'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:09.718120 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-19afdb9e-6909-466a-9c4b-747ba73ddb59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d60b23c00e74d0aa4e1c3e4fca7e88e'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:09.790564 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 835/1667] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:50:09 2022] DELETE /identity/v3/users/9d60b23c00e74d0aa4e1c3e4fca7e88e => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:09.793065 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880a01f-130a-4d6f-a1f9-bc80b2ae6adb None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:09.793813 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880a01f-130a-4d6f-a1f9-bc80b2ae6adb None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:09.793813 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880a01f-130a-4d6f-a1f9-bc80b2ae6adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:09.821225 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-f880a01f-130a-4d6f-a1f9-bc80b2ae6adb None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:09.823873 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-f880a01f-130a-4d6f-a1f9-bc80b2ae6adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:09.940498 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 833/1668] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:09.983962 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afdb9e-6909-466a-9c4b-747ba73ddb59 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:09.985654 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-19afdb9e-6909-466a-9c4b-747ba73ddb59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:10.120008 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afdb9e-6909-466a-9c4b-747ba73ddb59 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:10.124452 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3186f-1d4d-40c9-a1b4-315366581b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:10.125211 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3186f-1d4d-40c9-a1b4-315366581b44 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:10.125499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3186f-1d4d-40c9-a1b4-315366581b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:10.126791 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3186f-1d4d-40c9-a1b4-315366581b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:10.152956 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3186f-1d4d-40c9-a1b4-315366581b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:10.157758 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3186f-1d4d-40c9-a1b4-315366581b44 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:10.192904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 836/1669] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:10.304727 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced480e3-f4d0-45cf-b00b-1dfa2f567ac1 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:10.305056 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced480e3-f4d0-45cf-b00b-1dfa2f567ac1 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:10.306101 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced480e3-f4d0-45cf-b00b-1dfa2f567ac1 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:10.313083 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 834/1670] 10.222.0.31 () {54 vars in 912 bytes} [Mon Jan 10 17:50:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:50:10.323529 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66def826-fc25-4ddc-959e-96e897c946aa None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:10.324129 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66def826-fc25-4ddc-959e-96e897c946aa None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:10.324977 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66def826-fc25-4ddc-959e-96e897c946aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:10.379776 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb29ef-b594-4840-9aed-40f5a52df14a None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:10.380419 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb29ef-b594-4840-9aed-40f5a52df14a None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:10.380928 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb29ef-b594-4840-9aed-40f5a52df14a None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:10.383206 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 835/1671] 10.222.0.31 () {54 vars in 912 bytes} [Mon Jan 10 17:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:50:10.389448 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61259bd-f4c7-4d97-b808-0d32fd0d84b5 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:10.389867 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-66def826-fc25-4ddc-959e-96e897c946aa None None] MFA Rules not processed for user `2174a30e22c746589b3faaf4ccc8de3d`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:10.390168 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61259bd-f4c7-4d97-b808-0d32fd0d84b5 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:10.390535 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61259bd-f4c7-4d97-b808-0d32fd0d84b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:10.392878 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-66def826-fc25-4ddc-959e-96e897c946aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:10.422775 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 837/1672] 10.222.0.31 () {58 vars in 1009 bytes} [Mon Jan 10 17:50:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jan 10 17:50:10.423134 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b61259bd-f4c7-4d97-b808-0d32fd0d84b5 None None] MFA Rules not processed for user `2174a30e22c746589b3faaf4ccc8de3d`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:10.424956 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b61259bd-f4c7-4d97-b808-0d32fd0d84b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:10.450578 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 836/1673] 10.222.0.31 () {58 vars in 1009 bytes} [Mon Jan 10 17:50:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:50:10.461795 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66def826-fc25-4ddc-959e-96e897c946aa None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:10.465333 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-66def826-fc25-4ddc-959e-96e897c946aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:10.468528 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61259bd-f4c7-4d97-b808-0d32fd0d84b5 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:10.482677 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61259bd-f4c7-4d97-b808-0d32fd0d84b5 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:10.495363 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66def826-fc25-4ddc-959e-96e897c946aa None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:10.498095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b3be0-f1fd-4a10-906a-e019801d39a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:10.498829 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b3be0-f1fd-4a10-906a-e019801d39a4 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:10.499290 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b3be0-f1fd-4a10-906a-e019801d39a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:10.499918 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b3be0-f1fd-4a10-906a-e019801d39a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:10.505934 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f9f89-1197-44dc-9efb-69ed5159a27f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:10.507211 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f9f89-1197-44dc-9efb-69ed5159a27f service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:10.508627 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f9f89-1197-44dc-9efb-69ed5159a27f service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:10.509355 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f9f89-1197-44dc-9efb-69ed5159a27f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:10.517848 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b3be0-f1fd-4a10-906a-e019801d39a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:10.520127 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b3be0-f1fd-4a10-906a-e019801d39a4 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:10.530667 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f9f89-1197-44dc-9efb-69ed5159a27f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:10.536748 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f9f89-1197-44dc-9efb-69ed5159a27f service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:10.562733 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 837/1674] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:50:10.566673 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 838/1675] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:11.734271 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b3be0-f1fd-4a10-906a-e019801d39a4 service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:11.735834 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-6d2b3be0-f1fd-4a10-906a-e019801d39a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:11.780797 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b3be0-f1fd-4a10-906a-e019801d39a4 service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:11.805291 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827140e1-b86e-4c87-92e6-47482bc3f5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:11.806170 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827140e1-b86e-4c87-92e6-47482bc3f5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:11.810620 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827140e1-b86e-4c87-92e6-47482bc3f5da admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:11.810620 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827140e1-b86e-4c87-92e6-47482bc3f5da admin admin] PATH_INFO: `/v3/projects/5e5e176c34574fb7b59313616ef863b3` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:11.814964 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827140e1-b86e-4c87-92e6-47482bc3f5da admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5e176c34574fb7b59313616ef863b3)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:11.816008 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: WARNING py.warnings [None req-827140e1-b86e-4c87-92e6-47482bc3f5da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 17:50:11.816008 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: warnings.warn(msg) Jan 10 17:50:11.816008 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: Jan 10 17:50:11.829183 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827140e1-b86e-4c87-92e6-47482bc3f5da admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:11.986291 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f20cc3-a4cd-47f2-8761-7122a77b02b4 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:11.986774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f20cc3-a4cd-47f2-8761-7122a77b02b4 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:11.987213 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f20cc3-a4cd-47f2-8761-7122a77b02b4 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:11.990525 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 839/1676] 10.222.0.31 () {54 vars in 960 bytes} [Mon Jan 10 17:50:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 17:50:11.997515 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe014ef-23ff-4320-a7f3-93fb15df56ac None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:11.998276 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe014ef-23ff-4320-a7f3-93fb15df56ac None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:11.998933 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe014ef-23ff-4320-a7f3-93fb15df56ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:12.040354 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-827140e1-b86e-4c87-92e6-47482bc3f5da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5e176c34574fb7b59313616ef863b3', 'request_id': 'req-827140e1-b86e-4c87-92e6-47482bc3f5da'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:12.050144 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-fbe014ef-23ff-4320-a7f3-93fb15df56ac None None] MFA Rules not processed for user `3a3b8e620cfd42fe993c73dc83a246be`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:12.053390 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-fbe014ef-23ff-4320-a7f3-93fb15df56ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:12.119491 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-827140e1-b86e-4c87-92e6-47482bc3f5da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5e176c34574fb7b59313616ef863b3', 'request_id': 'req-827140e1-b86e-4c87-92e6-47482bc3f5da'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:12.154579 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-827140e1-b86e-4c87-92e6-47482bc3f5da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5e176c34574fb7b59313616ef863b3', 'request_id': 'req-827140e1-b86e-4c87-92e6-47482bc3f5da'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:12.177978 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-827140e1-b86e-4c87-92e6-47482bc3f5da admin admin] The token cache is being invalidate because project 5e5e176c34574fb7b59313616ef863b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:50:12.178522 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-827140e1-b86e-4c87-92e6-47482bc3f5da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:12.179682 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-827140e1-b86e-4c87-92e6-47482bc3f5da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:12.182204 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 838/1677] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:50:11 2022] DELETE /identity/v3/projects/5e5e176c34574fb7b59313616ef863b3 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:12.183340 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827140e1-b86e-4c87-92e6-47482bc3f5da admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:12.185171 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-827140e1-b86e-4c87-92e6-47482bc3f5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:12.301480 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 840/1678] 10.222.0.31 () {58 vars in 1057 bytes} [Mon Jan 10 17:50:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:12.302957 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827140e1-b86e-4c87-92e6-47482bc3f5da admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:12.309097 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdb40c-44cd-4e50-8cc9-3f65a14ead70 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:12.309878 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdb40c-44cd-4e50-8cc9-3f65a14ead70 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:12.310617 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdb40c-44cd-4e50-8cc9-3f65a14ead70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:12.310942 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fca89c-faa7-43d1-b608-0913165fd36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:12.312077 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fca89c-faa7-43d1-b608-0913165fd36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:12.312738 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fca89c-faa7-43d1-b608-0913165fd36c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:12.313235 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fca89c-faa7-43d1-b608-0913165fd36c admin admin] PATH_INFO: `/v3/users/d18658ed89f745718455f349887991d4` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:12.315091 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fca89c-faa7-43d1-b608-0913165fd36c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d18658ed89f745718455f349887991d4)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:12.325730 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fca89c-faa7-43d1-b608-0913165fd36c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:12.358205 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-28fdb40c-44cd-4e50-8cc9-3f65a14ead70 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:12.360280 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-28fdb40c-44cd-4e50-8cc9-3f65a14ead70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:12.392211 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 841/1679] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:12.392211 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdb40c-44cd-4e50-8cc9-3f65a14ead70 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:12.392211 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-28fdb40c-44cd-4e50-8cc9-3f65a14ead70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:12.417091 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdb40c-44cd-4e50-8cc9-3f65a14ead70 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:12.422723 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5900e0-e349-4cc5-8436-d7a56136c0b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3b8e620cfd42fe993c73dc83a246be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:12.423991 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5900e0-e349-4cc5-8436-d7a56136c0b6 service placement] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:12.424461 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5900e0-e349-4cc5-8436-d7a56136c0b6 service placement] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:12.424907 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5900e0-e349-4cc5-8436-d7a56136c0b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:12.426875 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-8f5900e0-e349-4cc5-8436-d7a56136c0b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:12.427489 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d8fca89c-faa7-43d1-b608-0913165fd36c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd18658ed89f745718455f349887991d4'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:12.441196 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5900e0-e349-4cc5-8436-d7a56136c0b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:12.445006 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5900e0-e349-4cc5-8436-d7a56136c0b6 service placement] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:12.458437 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d8fca89c-faa7-43d1-b608-0913165fd36c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd18658ed89f745718455f349887991d4'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:12.458670 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 842/1680] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:12.460020 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5900e0-e349-4cc5-8436-d7a56136c0b6 service placement] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:12.472128 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5900e0-e349-4cc5-8436-d7a56136c0b6 service placement] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:12.473394 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d8fca89c-faa7-43d1-b608-0913165fd36c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd18658ed89f745718455f349887991d4'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:12.480241 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6c7a6-6979-4634-bf07-ddd692196c81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3b8e620cfd42fe993c73dc83a246be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:12.481811 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6c7a6-6979-4634-bf07-ddd692196c81 service placement] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:12.482323 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6c7a6-6979-4634-bf07-ddd692196c81 service placement] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:12.483077 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6c7a6-6979-4634-bf07-ddd692196c81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:12.493092 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d8fca89c-faa7-43d1-b608-0913165fd36c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd18658ed89f745718455f349887991d4'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:12.493887 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d8fca89c-faa7-43d1-b608-0913165fd36c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd18658ed89f745718455f349887991d4'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:12.500238 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6c7a6-6979-4634-bf07-ddd692196c81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:12.501806 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 839/1681] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:50:12 2022] DELETE /identity/v3/users/d18658ed89f745718455f349887991d4 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:12.502722 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6c7a6-6979-4634-bf07-ddd692196c81 service placement] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:12.503147 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936911fb-4f31-4a9d-82f1-9736d2796f58 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:12.503441 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936911fb-4f31-4a9d-82f1-9736d2796f58 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:12.503884 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936911fb-4f31-4a9d-82f1-9736d2796f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:12.546072 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 843/1682] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:12.549526 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f96a1-426f-4bdb-9494-b2ecd4488584 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:12.549911 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f96a1-426f-4bdb-9494-b2ecd4488584 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:12.550386 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f96a1-426f-4bdb-9494-b2ecd4488584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:12.553934 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-936911fb-4f31-4a9d-82f1-9736d2796f58 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:12.555347 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-936911fb-4f31-4a9d-82f1-9736d2796f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:12.594873 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-9e8f96a1-426f-4bdb-9494-b2ecd4488584 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:12.598442 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-9e8f96a1-426f-4bdb-9494-b2ecd4488584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:12.705018 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 840/1683] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:12.706026 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936911fb-4f31-4a9d-82f1-9736d2796f58 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:12.721655 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936911fb-4f31-4a9d-82f1-9736d2796f58 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:12.736529 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc3e58-e0ff-4310-9892-b9e59bbfc652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:12.738419 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc3e58-e0ff-4310-9892-b9e59bbfc652 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:12.738889 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc3e58-e0ff-4310-9892-b9e59bbfc652 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:12.739350 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc3e58-e0ff-4310-9892-b9e59bbfc652 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:12.740334 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc3e58-e0ff-4310-9892-b9e59bbfc652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:50:12.740867 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc3e58-e0ff-4310-9892-b9e59bbfc652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:12.743830 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc3e58-e0ff-4310-9892-b9e59bbfc652 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:12.755960 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 844/1684] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:12.763897 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 841/1685] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:50:12.769904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f96a1-426f-4bdb-9494-b2ecd4488584 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:12.784233 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f96a1-426f-4bdb-9494-b2ecd4488584 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:12.790140 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c488b78-3670-4817-b42b-657e327c68e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:12.791116 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c488b78-3670-4817-b42b-657e327c68e8 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:12.791900 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c488b78-3670-4817-b42b-657e327c68e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:12.792352 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c488b78-3670-4817-b42b-657e327c68e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:12.793323 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c488b78-3670-4817-b42b-657e327c68e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:12.795728 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c488b78-3670-4817-b42b-657e327c68e8 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:12.835721 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 845/1686] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:50:12 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:12.839630 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc3e58-e0ff-4310-9892-b9e59bbfc652 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:12.862444 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc3e58-e0ff-4310-9892-b9e59bbfc652 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:12.871661 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c488b78-3670-4817-b42b-657e327c68e8 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:12.873479 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-5c488b78-3670-4817-b42b-657e327c68e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:13.067496 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c488b78-3670-4817-b42b-657e327c68e8 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:13.069092 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99a8bc-bf14-451b-ab4f-59aa07ec489d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:13.071282 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99a8bc-bf14-451b-ab4f-59aa07ec489d admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:13.080728 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99a8bc-bf14-451b-ab4f-59aa07ec489d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:13.082465 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99a8bc-bf14-451b-ab4f-59aa07ec489d admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:13.085514 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99a8bc-bf14-451b-ab4f-59aa07ec489d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:13.087624 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a91526-fc40-4dd5-a247-d68b32dc6eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:13.088685 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a91526-fc40-4dd5-a247-d68b32dc6eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:13.090496 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a91526-fc40-4dd5-a247-d68b32dc6eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:13.091216 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99a8bc-bf14-451b-ab4f-59aa07ec489d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:13.091592 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a91526-fc40-4dd5-a247-d68b32dc6eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:13.121459 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a91526-fc40-4dd5-a247-d68b32dc6eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:13.123260 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a91526-fc40-4dd5-a247-d68b32dc6eb2 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:13.140523 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 842/1687] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:50:12 2022] POST /identity/v3/users => generated 283 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:13.144622 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99a8bc-bf14-451b-ab4f-59aa07ec489d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:13.152497 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 846/1688] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:13.160974 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99a8bc-bf14-451b-ab4f-59aa07ec489d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:13.177445 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70890f9f-b341-4a53-b420-a4679deaaae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:13.181450 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70890f9f-b341-4a53-b420-a4679deaaae3 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:13.182014 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70890f9f-b341-4a53-b420-a4679deaaae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:13.184358 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70890f9f-b341-4a53-b420-a4679deaaae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:13.186109 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70890f9f-b341-4a53-b420-a4679deaaae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:13.209412 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70890f9f-b341-4a53-b420-a4679deaaae3 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:13.254528 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a91526-fc40-4dd5-a247-d68b32dc6eb2 service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:13.260912 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 843/1689] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:50:13.264784 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a91526-fc40-4dd5-a247-d68b32dc6eb2 service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:13.276652 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3845a4b-6ad3-4075-aad0-59e550f72f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:13.277377 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3845a4b-6ad3-4075-aad0-59e550f72f9a admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:13.277671 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3845a4b-6ad3-4075-aad0-59e550f72f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:13.278483 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3845a4b-6ad3-4075-aad0-59e550f72f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:13.278879 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3845a4b-6ad3-4075-aad0-59e550f72f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:13.280537 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3845a4b-6ad3-4075-aad0-59e550f72f9a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:13.308019 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 847/1690] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:50:13.309788 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70890f9f-b341-4a53-b420-a4679deaaae3 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:13.325557 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70890f9f-b341-4a53-b420-a4679deaaae3 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:13.363230 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c554640-e02c-482c-9039-566b4eceb01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:13.365053 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c554640-e02c-482c-9039-566b4eceb01c admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:13.365498 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c554640-e02c-482c-9039-566b4eceb01c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:13.365929 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c554640-e02c-482c-9039-566b4eceb01c admin admin] PATH_INFO: `/v3/projects/f6e04db2e05941038cef4a89ec8e0766/users/e982d400a431447684a46c6301de4e68/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:13.422199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c554640-e02c-482c-9039-566b4eceb01c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e04db2e05941038cef4a89ec8e0766, user_id=e982d400a431447684a46c6301de4e68, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:13.425405 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c554640-e02c-482c-9039-566b4eceb01c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:13.468602 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963363b8-63f0-4a39-b101-2f90c314d993 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:13.469110 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963363b8-63f0-4a39-b101-2f90c314d993 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:13.469232 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963363b8-63f0-4a39-b101-2f90c314d993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:13.470802 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 844/1691] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:50:13 2022] PUT /identity/v3/projects/f6e04db2e05941038cef4a89ec8e0766/users/e982d400a431447684a46c6301de4e68/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:13.516240 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-963363b8-63f0-4a39-b101-2f90c314d993 None None] MFA Rules not processed for user `e982d400a431447684a46c6301de4e68`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:13.517812 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-963363b8-63f0-4a39-b101-2f90c314d993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:13.632217 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 848/1692] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:13.637914 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c554640-e02c-482c-9039-566b4eceb01c admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:13.817753 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c554640-e02c-482c-9039-566b4eceb01c admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:13.828069 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b4ae0-d152-4dde-b649-507b17385bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:13.828967 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b4ae0-d152-4dde-b649-507b17385bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:13.829641 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b4ae0-d152-4dde-b649-507b17385bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:13.830356 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b4ae0-d152-4dde-b649-507b17385bb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:13.831212 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b4ae0-d152-4dde-b649-507b17385bb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:13.845247 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b4ae0-d152-4dde-b649-507b17385bb8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:13.900610 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 845/1693] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:50:13 2022] POST /identity/v3/projects => generated 365 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:13.906958 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963363b8-63f0-4a39-b101-2f90c314d993 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:13.934990 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963363b8-63f0-4a39-b101-2f90c314d993 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:14.129209 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72286261-d5e5-41a6-9075-64fbb8d02842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:14.129924 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72286261-d5e5-41a6-9075-64fbb8d02842 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:14.130780 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72286261-d5e5-41a6-9075-64fbb8d02842 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:14.132127 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72286261-d5e5-41a6-9075-64fbb8d02842 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:14.133541 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72286261-d5e5-41a6-9075-64fbb8d02842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:14.137379 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72286261-d5e5-41a6-9075-64fbb8d02842 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:14.184905 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 849/1694] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:50:13 2022] POST /identity/v3/users => generated 289 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:14.188802 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b4ae0-d152-4dde-b649-507b17385bb8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:14.203297 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b4ae0-d152-4dde-b649-507b17385bb8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:14.209304 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d556105-5d90-402e-998d-02bc2e42c153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:14.210561 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d556105-5d90-402e-998d-02bc2e42c153 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:14.211010 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d556105-5d90-402e-998d-02bc2e42c153 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:14.211431 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d556105-5d90-402e-998d-02bc2e42c153 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:14.212442 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d556105-5d90-402e-998d-02bc2e42c153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:14.214622 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d556105-5d90-402e-998d-02bc2e42c153 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:14.241985 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 846/1695] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:14.248572 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72286261-d5e5-41a6-9075-64fbb8d02842 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:14.280337 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72286261-d5e5-41a6-9075-64fbb8d02842 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:14.289188 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe20b6-e0d9-4ea8-bd80-564ccad07305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:14.290872 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe20b6-e0d9-4ea8-bd80-564ccad07305 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:14.292360 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe20b6-e0d9-4ea8-bd80-564ccad07305 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:14.292834 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe20b6-e0d9-4ea8-bd80-564ccad07305 admin admin] PATH_INFO: `/v3/projects/69587bd85a064d01abee10aa11bb6c26/users/c730c002593746a0aefa2e3a979789c3/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:14.321625 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe20b6-e0d9-4ea8-bd80-564ccad07305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69587bd85a064d01abee10aa11bb6c26, user_id=c730c002593746a0aefa2e3a979789c3, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:14.326088 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe20b6-e0d9-4ea8-bd80-564ccad07305 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:14.352140 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 850/1696] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:50:14 2022] PUT /identity/v3/projects/69587bd85a064d01abee10aa11bb6c26/users/c730c002593746a0aefa2e3a979789c3/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:14.356353 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d556105-5d90-402e-998d-02bc2e42c153 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:14.390965 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d556105-5d90-402e-998d-02bc2e42c153 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:14.446927 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe20b6-e0d9-4ea8-bd80-564ccad07305 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:14.448678 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-ecfe20b6-e0d9-4ea8-bd80-564ccad07305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:14.493336 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e4e09-b22a-4a27-99bb-58398c74a24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:14.493336 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e4e09-b22a-4a27-99bb-58398c74a24b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:14.493336 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e4e09-b22a-4a27-99bb-58398c74a24b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:14.503406 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e4e09-b22a-4a27-99bb-58398c74a24b admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:14.511373 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e4e09-b22a-4a27-99bb-58398c74a24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:14.513289 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e4e09-b22a-4a27-99bb-58398c74a24b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:14.547701 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 847/1697] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:14.552762 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e4e09-b22a-4a27-99bb-58398c74a24b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:14.574543 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e4e09-b22a-4a27-99bb-58398c74a24b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:14.591246 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd9faf-fd8a-44b6-bdff-aec866dfa15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:14.593110 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd9faf-fd8a-44b6-bdff-aec866dfa15b admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:14.593404 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd9faf-fd8a-44b6-bdff-aec866dfa15b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:14.593829 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd9faf-fd8a-44b6-bdff-aec866dfa15b admin admin] PATH_INFO: `/v3/projects/69587bd85a064d01abee10aa11bb6c26/users/c730c002593746a0aefa2e3a979789c3/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:14.597943 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd9faf-fd8a-44b6-bdff-aec866dfa15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=69587bd85a064d01abee10aa11bb6c26, user_id=c730c002593746a0aefa2e3a979789c3, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:14.602033 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd9faf-fd8a-44b6-bdff-aec866dfa15b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:14.624400 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe20b6-e0d9-4ea8-bd80-564ccad07305 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:14.649089 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 848/1698] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:50:14 2022] PUT /identity/v3/projects/69587bd85a064d01abee10aa11bb6c26/users/c730c002593746a0aefa2e3a979789c3/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:14.651255 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17959b0f-6078-43ac-9f5c-2581c2706e53 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:14.651514 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17959b0f-6078-43ac-9f5c-2581c2706e53 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:14.651805 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17959b0f-6078-43ac-9f5c-2581c2706e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:14.760330 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-17959b0f-6078-43ac-9f5c-2581c2706e53 None None] MFA Rules not processed for user `c730c002593746a0aefa2e3a979789c3`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:14.763768 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-17959b0f-6078-43ac-9f5c-2581c2706e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:14.814567 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e7ccd-9ef7-448a-a3e0-9d823b17acc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:14.815964 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e7ccd-9ef7-448a-a3e0-9d823b17acc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:14.816462 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e7ccd-9ef7-448a-a3e0-9d823b17acc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:14.816972 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e7ccd-9ef7-448a-a3e0-9d823b17acc9 admin admin] PATH_INFO: `/v3/projects/a4a2de280d124b4da2a4b0a6aa63f363` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:14.818506 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e7ccd-9ef7-448a-a3e0-9d823b17acc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4a2de280d124b4da2a4b0a6aa63f363)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:14.820662 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e7ccd-9ef7-448a-a3e0-9d823b17acc9 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:15.009272 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 849/1699] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:15.019104 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-309e7ccd-9ef7-448a-a3e0-9d823b17acc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4a2de280d124b4da2a4b0a6aa63f363', 'request_id': 'req-309e7ccd-9ef7-448a-a3e0-9d823b17acc9'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:15.022159 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17959b0f-6078-43ac-9f5c-2581c2706e53 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:15.029572 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-17959b0f-6078-43ac-9f5c-2581c2706e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:15.038835 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-309e7ccd-9ef7-448a-a3e0-9d823b17acc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4a2de280d124b4da2a4b0a6aa63f363', 'request_id': 'req-309e7ccd-9ef7-448a-a3e0-9d823b17acc9'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:15.077484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-309e7ccd-9ef7-448a-a3e0-9d823b17acc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4a2de280d124b4da2a4b0a6aa63f363', 'request_id': 'req-309e7ccd-9ef7-448a-a3e0-9d823b17acc9'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:15.130366 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-309e7ccd-9ef7-448a-a3e0-9d823b17acc9 admin admin] The token cache is being invalidate because project a4a2de280d124b4da2a4b0a6aa63f363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:50:15.131366 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-309e7ccd-9ef7-448a-a3e0-9d823b17acc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:15.134324 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-309e7ccd-9ef7-448a-a3e0-9d823b17acc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:15.138424 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 851/1700] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:50:14 2022] DELETE /identity/v3/projects/a4a2de280d124b4da2a4b0a6aa63f363 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:15.142215 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e7ccd-9ef7-448a-a3e0-9d823b17acc9 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:15.149756 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-309e7ccd-9ef7-448a-a3e0-9d823b17acc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:15.306965 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17959b0f-6078-43ac-9f5c-2581c2706e53 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:15.308320 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e7ccd-9ef7-448a-a3e0-9d823b17acc9 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:15.321047 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe7eaf-6844-4525-a58b-5325e5d7b55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:15.323974 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe7eaf-6844-4525-a58b-5325e5d7b55f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:15.324538 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe7eaf-6844-4525-a58b-5325e5d7b55f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:15.326725 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe7eaf-6844-4525-a58b-5325e5d7b55f admin admin] PATH_INFO: `/v3/users/2addccee9451442c9d4ba77e45e1c3eb` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:15.329925 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe7eaf-6844-4525-a58b-5325e5d7b55f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2addccee9451442c9d4ba77e45e1c3eb)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:15.334677 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe7eaf-6844-4525-a58b-5325e5d7b55f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:15.417923 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0958ab-ffa8-41dd-81ff-6b692473910b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:15.418824 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0958ab-ffa8-41dd-81ff-6b692473910b service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:15.419703 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0958ab-ffa8-41dd-81ff-6b692473910b service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:15.421173 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0958ab-ffa8-41dd-81ff-6b692473910b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:15.427221 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-1c0958ab-ffa8-41dd-81ff-6b692473910b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:15.488346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8bbe7eaf-6844-4525-a58b-5325e5d7b55f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2addccee9451442c9d4ba77e45e1c3eb'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:15.489082 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8bbe7eaf-6844-4525-a58b-5325e5d7b55f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2addccee9451442c9d4ba77e45e1c3eb'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:15.489845 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8bbe7eaf-6844-4525-a58b-5325e5d7b55f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2addccee9451442c9d4ba77e45e1c3eb'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:15.515363 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8bbe7eaf-6844-4525-a58b-5325e5d7b55f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2addccee9451442c9d4ba77e45e1c3eb'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:15.529928 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8bbe7eaf-6844-4525-a58b-5325e5d7b55f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2addccee9451442c9d4ba77e45e1c3eb'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:15.566769 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0958ab-ffa8-41dd-81ff-6b692473910b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:15.569446 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 852/1701] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:50:15 2022] DELETE /identity/v3/users/2addccee9451442c9d4ba77e45e1c3eb => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:15.573332 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0958ab-ffa8-41dd-81ff-6b692473910b service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:15.593993 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 850/1702] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:15 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:15.597937 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e2817-1c9b-4a59-9ad9-59cde7a92d35 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:15.598412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e2817-1c9b-4a59-9ad9-59cde7a92d35 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:15.598794 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e2817-1c9b-4a59-9ad9-59cde7a92d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:15.677233 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-0d9e2817-1c9b-4a59-9ad9-59cde7a92d35 None None] MFA Rules not processed for user `d0e34ddaca124f638fdf8e43fbb08437`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:15.679986 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-0d9e2817-1c9b-4a59-9ad9-59cde7a92d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:15.730281 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0958ab-ffa8-41dd-81ff-6b692473910b service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:15.732464 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-1c0958ab-ffa8-41dd-81ff-6b692473910b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:15.757682 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0958ab-ffa8-41dd-81ff-6b692473910b service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:15.805384 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 853/1703] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:15.827265 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e2817-1c9b-4a59-9ad9-59cde7a92d35 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:15.833178 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-0d9e2817-1c9b-4a59-9ad9-59cde7a92d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:15.953011 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24978d86-24ca-4779-9a08-719292cf74c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:15.953803 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24978d86-24ca-4779-9a08-719292cf74c1 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:15.954099 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24978d86-24ca-4779-9a08-719292cf74c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:15.954375 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24978d86-24ca-4779-9a08-719292cf74c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:15.969959 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-24978d86-24ca-4779-9a08-719292cf74c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:16.082473 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e2817-1c9b-4a59-9ad9-59cde7a92d35 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:16.103621 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eae8d1-75c1-48f5-a16c-02caf89240ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:16.104312 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eae8d1-75c1-48f5-a16c-02caf89240ac service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:16.104611 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eae8d1-75c1-48f5-a16c-02caf89240ac service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:16.104893 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eae8d1-75c1-48f5-a16c-02caf89240ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:16.125279 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eae8d1-75c1-48f5-a16c-02caf89240ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:16.127968 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24978d86-24ca-4779-9a08-719292cf74c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:16.131111 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eae8d1-75c1-48f5-a16c-02caf89240ac service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:16.134676 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24978d86-24ca-4779-9a08-719292cf74c1 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:16.153830 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 854/1704] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:16.154605 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 851/1705] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:16.726424 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0988c4-03a3-49e1-881c-d60b11b5a426 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:16.726887 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0988c4-03a3-49e1-881c-d60b11b5a426 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:16.727283 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0988c4-03a3-49e1-881c-d60b11b5a426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:16.771484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-0a0988c4-03a3-49e1-881c-d60b11b5a426 None None] MFA Rules not processed for user `3b3dbe4735a54de1825abc28ecf00b84`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:16.774588 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-0a0988c4-03a3-49e1-881c-d60b11b5a426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:16.929611 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 855/1706] 10.222.0.31 () {58 vars in 1009 bytes} [Mon Jan 10 17:50:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:17.290416 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24978d86-24ca-4779-9a08-719292cf74c1 service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:17.292706 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-24978d86-24ca-4779-9a08-719292cf74c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:17.410943 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0988c4-03a3-49e1-881c-d60b11b5a426 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:17.412967 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-0a0988c4-03a3-49e1-881c-d60b11b5a426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:17.456278 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24978d86-24ca-4779-9a08-719292cf74c1 service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:17.471651 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a84e9-895c-453c-9de9-f0f87a3501b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257a86ce85b4b4386cde32c8ed4b39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:17.472627 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a84e9-895c-453c-9de9-f0f87a3501b4 service swift] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:17.473146 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a84e9-895c-453c-9de9-f0f87a3501b4 service swift] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:17.473619 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a84e9-895c-453c-9de9-f0f87a3501b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:17.493634 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a84e9-895c-453c-9de9-f0f87a3501b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:17.495915 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a84e9-895c-453c-9de9-f0f87a3501b4 service swift] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:17.521261 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 852/1707] 10.222.0.31 () {60 vars in 1384 bytes} [Mon Jan 10 17:50:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:50:17.602427 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0988c4-03a3-49e1-881c-d60b11b5a426 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:17.618359 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261e2d1-aaae-49c4-81a8-d2e17953ff00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:17.619993 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261e2d1-aaae-49c4-81a8-d2e17953ff00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:17.620430 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261e2d1-aaae-49c4-81a8-d2e17953ff00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:17.620906 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261e2d1-aaae-49c4-81a8-d2e17953ff00 admin admin] PATH_INFO: `/v3/projects/60fcb2ce43dc4ea1bbefcedee87adad3` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:17.622861 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261e2d1-aaae-49c4-81a8-d2e17953ff00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60fcb2ce43dc4ea1bbefcedee87adad3)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:17.625175 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261e2d1-aaae-49c4-81a8-d2e17953ff00 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:17.781190 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f261e2d1-aaae-49c4-81a8-d2e17953ff00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60fcb2ce43dc4ea1bbefcedee87adad3', 'request_id': 'req-f261e2d1-aaae-49c4-81a8-d2e17953ff00'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:17.795702 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f261e2d1-aaae-49c4-81a8-d2e17953ff00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60fcb2ce43dc4ea1bbefcedee87adad3', 'request_id': 'req-f261e2d1-aaae-49c4-81a8-d2e17953ff00'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:17.817393 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f261e2d1-aaae-49c4-81a8-d2e17953ff00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60fcb2ce43dc4ea1bbefcedee87adad3', 'request_id': 'req-f261e2d1-aaae-49c4-81a8-d2e17953ff00'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:17.875578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f261e2d1-aaae-49c4-81a8-d2e17953ff00 admin admin] The token cache is being invalidate because project 60fcb2ce43dc4ea1bbefcedee87adad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:50:17.877264 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f261e2d1-aaae-49c4-81a8-d2e17953ff00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:17.882020 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f261e2d1-aaae-49c4-81a8-d2e17953ff00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:17.909594 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 856/1708] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:50:17 2022] DELETE /identity/v3/projects/60fcb2ce43dc4ea1bbefcedee87adad3 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:50:17.911820 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fa255-af8e-4833-881f-ce59433ee087 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:17.912882 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fa255-af8e-4833-881f-ce59433ee087 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:17.913267 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fa255-af8e-4833-881f-ce59433ee087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:17.954796 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-828fa255-af8e-4833-881f-ce59433ee087 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:17.958150 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-828fa255-af8e-4833-881f-ce59433ee087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:18.120825 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 853/1709] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:18.127851 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0c9fe-6ca4-4a7d-8b15-f846acdc871e None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:18.128298 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0c9fe-6ca4-4a7d-8b15-f846acdc871e None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:18.128692 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0c9fe-6ca4-4a7d-8b15-f846acdc871e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:18.178012 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-20d0c9fe-6ca4-4a7d-8b15-f846acdc871e None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:18.179391 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-20d0c9fe-6ca4-4a7d-8b15-f846acdc871e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:18.197133 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 857/1710] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:18.202448 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fa255-af8e-4833-881f-ce59433ee087 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:18.221212 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fa255-af8e-4833-881f-ce59433ee087 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:18.238849 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ed54d-4427-4fdb-9b91-49bc47399d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:18.240090 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ed54d-4427-4fdb-9b91-49bc47399d61 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:18.241633 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ed54d-4427-4fdb-9b91-49bc47399d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:18.242094 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ed54d-4427-4fdb-9b91-49bc47399d61 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:18.243836 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ed54d-4427-4fdb-9b91-49bc47399d61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:50:18.244882 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ed54d-4427-4fdb-9b91-49bc47399d61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:18.247333 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ed54d-4427-4fdb-9b91-49bc47399d61 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:18.280157 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 854/1711] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:50:18.284976 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0c9fe-6ca4-4a7d-8b15-f846acdc871e None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:18.294997 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0c9fe-6ca4-4a7d-8b15-f846acdc871e None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:18.302316 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f315410-ca99-40e0-ba01-257d23af49dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:18.303154 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f315410-ca99-40e0-ba01-257d23af49dd admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:18.303537 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f315410-ca99-40e0-ba01-257d23af49dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:18.303918 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f315410-ca99-40e0-ba01-257d23af49dd admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:18.304937 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f315410-ca99-40e0-ba01-257d23af49dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:18.307009 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f315410-ca99-40e0-ba01-257d23af49dd admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:18.365425 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 858/1712] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:50:18 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:18.367050 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ed54d-4427-4fdb-9b91-49bc47399d61 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:18.378518 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ed54d-4427-4fdb-9b91-49bc47399d61 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:18.685570 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b39ce-78b1-4ca2-a416-af1d4226d1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:18.686380 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b39ce-78b1-4ca2-a416-af1d4226d1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:18.686882 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b39ce-78b1-4ca2-a416-af1d4226d1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:18.687346 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b39ce-78b1-4ca2-a416-af1d4226d1a8 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:18.689190 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b39ce-78b1-4ca2-a416-af1d4226d1a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:18.692280 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b39ce-78b1-4ca2-a416-af1d4226d1a8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:18.781433 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f315410-ca99-40e0-ba01-257d23af49dd admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:18.793915 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f315410-ca99-40e0-ba01-257d23af49dd admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:18.796023 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 855/1713] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:50:18 2022] POST /identity/v3/users => generated 289 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:18.820514 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d22d80-1611-4899-a9f2-cd71b64ef288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:18.821401 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d22d80-1611-4899-a9f2-cd71b64ef288 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:18.821755 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d22d80-1611-4899-a9f2-cd71b64ef288 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:18.822132 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d22d80-1611-4899-a9f2-cd71b64ef288 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:18.823008 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d22d80-1611-4899-a9f2-cd71b64ef288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:18.828605 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d22d80-1611-4899-a9f2-cd71b64ef288 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:18.861773 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 859/1714] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:18.866368 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b39ce-78b1-4ca2-a416-af1d4226d1a8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:18.877606 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b39ce-78b1-4ca2-a416-af1d4226d1a8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:18.882962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fe354-897a-4463-8151-d40b5974818c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:18.883770 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fe354-897a-4463-8151-d40b5974818c admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:18.884162 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fe354-897a-4463-8151-d40b5974818c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:18.884532 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fe354-897a-4463-8151-d40b5974818c admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:18.885454 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fe354-897a-4463-8151-d40b5974818c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:18.887511 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fe354-897a-4463-8151-d40b5974818c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:18.911810 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 856/1715] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:18.913215 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d22d80-1611-4899-a9f2-cd71b64ef288 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:18.927104 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d22d80-1611-4899-a9f2-cd71b64ef288 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:18.938810 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea04dc0-566d-4383-bf5f-c72dd88219f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:18.939914 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea04dc0-566d-4383-bf5f-c72dd88219f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:18.940292 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea04dc0-566d-4383-bf5f-c72dd88219f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:18.940666 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea04dc0-566d-4383-bf5f-c72dd88219f8 admin admin] PATH_INFO: `/v3/projects/e5ef1868a7ef40faaad07b4cb60e6d1b/users/4258db085b7049aaa4d94ed99e3eb973/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:18.967348 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea04dc0-566d-4383-bf5f-c72dd88219f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ef1868a7ef40faaad07b4cb60e6d1b, user_id=4258db085b7049aaa4d94ed99e3eb973, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:18.974699 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea04dc0-566d-4383-bf5f-c72dd88219f8 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:19.040631 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 860/1716] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:50:18 2022] PUT /identity/v3/projects/e5ef1868a7ef40faaad07b4cb60e6d1b/users/4258db085b7049aaa4d94ed99e3eb973/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:19.043350 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9965c-3ea5-4541-931b-3842f0ee6610 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:19.043350 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9965c-3ea5-4541-931b-3842f0ee6610 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:19.043578 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9965c-3ea5-4541-931b-3842f0ee6610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:19.106042 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-fee9965c-3ea5-4541-931b-3842f0ee6610 None None] MFA Rules not processed for user `4258db085b7049aaa4d94ed99e3eb973`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:19.125502 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-fee9965c-3ea5-4541-931b-3842f0ee6610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:19.424352 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 857/1717] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:50:19.435954 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea04dc0-566d-4383-bf5f-c72dd88219f8 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:19.438472 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-bea04dc0-566d-4383-bf5f-c72dd88219f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:19.567926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea04dc0-566d-4383-bf5f-c72dd88219f8 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:19.579145 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcc249-05a1-4224-b282-22bd3a92ac6d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15232a1930bc43e8bb5aa7310a709056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:19.581162 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcc249-05a1-4224-b282-22bd3a92ac6d service glance] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:19.582336 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcc249-05a1-4224-b282-22bd3a92ac6d service glance] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:19.582823 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcc249-05a1-4224-b282-22bd3a92ac6d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:19.606913 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcc249-05a1-4224-b282-22bd3a92ac6d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:19.610433 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcc249-05a1-4224-b282-22bd3a92ac6d service glance] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:19.637518 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 861/1718] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:21.479758 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908d3d2-65b7-44aa-95d9-d54425504ea3 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:21.480256 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908d3d2-65b7-44aa-95d9-d54425504ea3 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:21.480511 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908d3d2-65b7-44aa-95d9-d54425504ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:21.561034 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-f908d3d2-65b7-44aa-95d9-d54425504ea3 None None] MFA Rules not processed for user `2174a30e22c746589b3faaf4ccc8de3d`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:21.567950 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4244d38-9b5b-4e99-a306-b8cbcaa4cccb None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:21.568449 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4244d38-9b5b-4e99-a306-b8cbcaa4cccb None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:21.568546 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-f908d3d2-65b7-44aa-95d9-d54425504ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:21.568938 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4244d38-9b5b-4e99-a306-b8cbcaa4cccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:21.613205 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-f4244d38-9b5b-4e99-a306-b8cbcaa4cccb None None] MFA Rules not processed for user `3b3dbe4735a54de1825abc28ecf00b84`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:21.614622 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f4244d38-9b5b-4e99-a306-b8cbcaa4cccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:21.745763 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 862/1719] 10.222.0.31 () {58 vars in 1009 bytes} [Mon Jan 10 17:50:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:21.761856 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4244d38-9b5b-4e99-a306-b8cbcaa4cccb None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:21.766106 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f4244d38-9b5b-4e99-a306-b8cbcaa4cccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:21.798547 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 858/1720] 10.222.0.35 () {58 vars in 1015 bytes} [Mon Jan 10 17:50:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:21.886607 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908d3d2-65b7-44aa-95d9-d54425504ea3 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:21.888805 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-f908d3d2-65b7-44aa-95d9-d54425504ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:21.904135 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908d3d2-65b7-44aa-95d9-d54425504ea3 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:21.938735 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdf610-7a0d-44b7-bc98-4fde5220baf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:21.942118 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdf610-7a0d-44b7-bc98-4fde5220baf8 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:21.942449 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdf610-7a0d-44b7-bc98-4fde5220baf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:21.944134 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdf610-7a0d-44b7-bc98-4fde5220baf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:21.973137 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdf610-7a0d-44b7-bc98-4fde5220baf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:21.973658 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4244d38-9b5b-4e99-a306-b8cbcaa4cccb None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:21.982465 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdf610-7a0d-44b7-bc98-4fde5220baf8 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:21.995408 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a5d9d-8fc0-48ad-a0fc-dfbdc7f8ce3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257a86ce85b4b4386cde32c8ed4b39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:21.996081 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a5d9d-8fc0-48ad-a0fc-dfbdc7f8ce3e service swift] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:21.996362 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a5d9d-8fc0-48ad-a0fc-dfbdc7f8ce3e service swift] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:21.996635 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a5d9d-8fc0-48ad-a0fc-dfbdc7f8ce3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:22.012782 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 859/1721] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:22.020916 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a5d9d-8fc0-48ad-a0fc-dfbdc7f8ce3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:22.023471 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a5d9d-8fc0-48ad-a0fc-dfbdc7f8ce3e service swift] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:22.038067 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 863/1722] 10.222.0.31 () {60 vars in 1384 bytes} [Mon Jan 10 17:50:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:50:24.181241 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf01c1-7767-4c42-a4ca-42266a42f145 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:24.181823 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf01c1-7767-4c42-a4ca-42266a42f145 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:24.182051 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf01c1-7767-4c42-a4ca-42266a42f145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:24.239496 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b1cf01c1-7767-4c42-a4ca-42266a42f145 None None] MFA Rules not processed for user `947bc36861e64e31811cb898f46a72e1`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:24.241813 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b1cf01c1-7767-4c42-a4ca-42266a42f145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:24.268408 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cd09b-7333-4700-91e8-942d38d6c696 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:24.269103 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cd09b-7333-4700-91e8-942d38d6c696 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:24.269283 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cd09b-7333-4700-91e8-942d38d6c696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:24.326193 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-2b7cd09b-7333-4700-91e8-942d38d6c696 None None] MFA Rules not processed for user `794281dc95a049b796164e866d3f2912`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:24.327531 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-2b7cd09b-7333-4700-91e8-942d38d6c696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:24.436522 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 860/1723] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:24.450615 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf01c1-7767-4c42-a4ca-42266a42f145 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:24.452186 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b1cf01c1-7767-4c42-a4ca-42266a42f145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:24.519410 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 864/1724] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:24.579497 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b8002-19dd-4d8a-a339-8e3869760130 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:24.579781 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b8002-19dd-4d8a-a339-8e3869760130 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:24.580065 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b8002-19dd-4d8a-a339-8e3869760130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:24.615056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-2f6b8002-19dd-4d8a-a339-8e3869760130 None None] MFA Rules not processed for user `794281dc95a049b796164e866d3f2912`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:24.620724 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-2f6b8002-19dd-4d8a-a339-8e3869760130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:24.644374 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 865/1725] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:24.652453 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b8002-19dd-4d8a-a339-8e3869760130 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:24.654797 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-2f6b8002-19dd-4d8a-a339-8e3869760130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:24.709446 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf01c1-7767-4c42-a4ca-42266a42f145 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:24.753004 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3906a08-6328-4249-84a5-0e2247f4835d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:24.754859 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3906a08-6328-4249-84a5-0e2247f4835d service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:24.754859 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3906a08-6328-4249-84a5-0e2247f4835d service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:24.754859 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3906a08-6328-4249-84a5-0e2247f4835d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:24.777993 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3906a08-6328-4249-84a5-0e2247f4835d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:24.779798 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3906a08-6328-4249-84a5-0e2247f4835d service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:24.808627 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 861/1726] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:24.855410 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b8002-19dd-4d8a-a339-8e3869760130 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:24.873962 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b0f31-c1b4-47bb-ac55-5ce9ec1a7554 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:24.874925 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b0f31-c1b4-47bb-ac55-5ce9ec1a7554 service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:24.875317 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b0f31-c1b4-47bb-ac55-5ce9ec1a7554 service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:24.875690 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b0f31-c1b4-47bb-ac55-5ce9ec1a7554 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:24.895087 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b0f31-c1b4-47bb-ac55-5ce9ec1a7554 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:24.900951 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b0f31-c1b4-47bb-ac55-5ce9ec1a7554 service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:24.926547 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 866/1727] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:25.243231 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e0a8f-834d-43cc-9f8e-1bdb3a2f3fec None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:25.244255 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e0a8f-834d-43cc-9f8e-1bdb3a2f3fec None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:25.244741 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e0a8f-834d-43cc-9f8e-1bdb3a2f3fec None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:25.247187 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 862/1728] 10.222.0.31 () {54 vars in 921 bytes} [Mon Jan 10 17:50:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:50:25.256064 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091455e-4d8a-4adf-a8cf-04c88f595520 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:25.256680 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091455e-4d8a-4adf-a8cf-04c88f595520 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:25.257493 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091455e-4d8a-4adf-a8cf-04c88f595520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:25.320188 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-3091455e-4d8a-4adf-a8cf-04c88f595520 None None] MFA Rules not processed for user `877acd6448214ef893d119e3b1043402`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:25.324244 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-3091455e-4d8a-4adf-a8cf-04c88f595520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:25.355015 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 867/1729] 10.222.0.31 () {58 vars in 1018 bytes} [Mon Jan 10 17:50:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:26.052231 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8f8fc-7dae-4add-b115-572b54bc24ef None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:26.052607 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8f8fc-7dae-4add-b115-572b54bc24ef None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:26.053016 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8f8fc-7dae-4add-b115-572b54bc24ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:26.094626 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-29c8f8fc-7dae-4add-b115-572b54bc24ef None None] MFA Rules not processed for user `d0e34ddaca124f638fdf8e43fbb08437`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:26.097222 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-29c8f8fc-7dae-4add-b115-572b54bc24ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:26.279340 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 863/1730] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:27.679873 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091455e-4d8a-4adf-a8cf-04c88f595520 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:27.708299 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091455e-4d8a-4adf-a8cf-04c88f595520 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:27.723472 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bdfdf-d74f-409c-ac46-9bee3f843ef4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:27.724154 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bdfdf-d74f-409c-ac46-9bee3f843ef4 service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:27.724441 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bdfdf-d74f-409c-ac46-9bee3f843ef4 service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:27.724731 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bdfdf-d74f-409c-ac46-9bee3f843ef4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:27.738688 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bdfdf-d74f-409c-ac46-9bee3f843ef4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:27.743026 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bdfdf-d74f-409c-ac46-9bee3f843ef4 service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:27.781315 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 868/1731] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:28.843143 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5c4a1-5f36-4a32-9430-43012ef2fbe4 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:28.844260 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5c4a1-5f36-4a32-9430-43012ef2fbe4 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:28.844677 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5c4a1-5f36-4a32-9430-43012ef2fbe4 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:28.847150 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 864/1732] 10.222.0.31 () {54 vars in 921 bytes} [Mon Jan 10 17:50:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:50:28.864289 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba64ffd-8342-4d7b-bb62-ca82b38a05b7 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:28.864755 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba64ffd-8342-4d7b-bb62-ca82b38a05b7 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:28.864837 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba64ffd-8342-4d7b-bb62-ca82b38a05b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:28.921049 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-bba64ffd-8342-4d7b-bb62-ca82b38a05b7 None None] MFA Rules not processed for user `877acd6448214ef893d119e3b1043402`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:28.929671 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-bba64ffd-8342-4d7b-bb62-ca82b38a05b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:28.951229 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 869/1733] 10.222.0.31 () {58 vars in 1018 bytes} [Mon Jan 10 17:50:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:29.916984 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5c4a1-5f36-4a32-9430-43012ef2fbe4 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:29.918826 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b2c5c4a1-5f36-4a32-9430-43012ef2fbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:30.033840 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5c4a1-5f36-4a32-9430-43012ef2fbe4 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:30.040433 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee9320-fb0e-47cf-adb5-01c097088f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:30.041611 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee9320-fb0e-47cf-adb5-01c097088f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:30.042337 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee9320-fb0e-47cf-adb5-01c097088f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:30.042774 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee9320-fb0e-47cf-adb5-01c097088f80 admin admin] PATH_INFO: `/v3/users/e982d400a431447684a46c6301de4e68` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:30.044279 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee9320-fb0e-47cf-adb5-01c097088f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e982d400a431447684a46c6301de4e68)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:30.046776 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee9320-fb0e-47cf-adb5-01c097088f80 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:30.114838 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-b3ee9320-fb0e-47cf-adb5-01c097088f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e982d400a431447684a46c6301de4e68'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:30.131601 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-b3ee9320-fb0e-47cf-adb5-01c097088f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e982d400a431447684a46c6301de4e68'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:30.148725 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-b3ee9320-fb0e-47cf-adb5-01c097088f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e982d400a431447684a46c6301de4e68'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:30.160286 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-b3ee9320-fb0e-47cf-adb5-01c097088f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e982d400a431447684a46c6301de4e68'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:30.161803 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-b3ee9320-fb0e-47cf-adb5-01c097088f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e982d400a431447684a46c6301de4e68'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:30.184465 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 865/1734] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:50:29 2022] DELETE /identity/v3/users/e982d400a431447684a46c6301de4e68 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:30.193210 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1641e-85ba-4fc3-bd81-39e102b4ac5f None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:30.194247 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1641e-85ba-4fc3-bd81-39e102b4ac5f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:30.194841 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1641e-85ba-4fc3-bd81-39e102b4ac5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:30.231119 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-d5a1641e-85ba-4fc3-bd81-39e102b4ac5f None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:30.233758 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-d5a1641e-85ba-4fc3-bd81-39e102b4ac5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:30.402077 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 870/1735] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:30.416635 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee9320-fb0e-47cf-adb5-01c097088f80 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:30.418229 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b3ee9320-fb0e-47cf-adb5-01c097088f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:30.602438 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee9320-fb0e-47cf-adb5-01c097088f80 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:30.609590 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c9e98-095d-4da3-9ebf-b9d7e941b7ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:30.610431 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c9e98-095d-4da3-9ebf-b9d7e941b7ad service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:30.610881 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c9e98-095d-4da3-9ebf-b9d7e941b7ad service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:30.611289 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c9e98-095d-4da3-9ebf-b9d7e941b7ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:30.630489 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c9e98-095d-4da3-9ebf-b9d7e941b7ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:30.633940 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c9e98-095d-4da3-9ebf-b9d7e941b7ad service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:30.652293 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 866/1736] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:31.301426 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bebed7-6951-4898-8f44-cf6a428d7543 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:31.302016 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bebed7-6951-4898-8f44-cf6a428d7543 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:31.302016 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bebed7-6951-4898-8f44-cf6a428d7543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:31.320285 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-b3bebed7-6951-4898-8f44-cf6a428d7543 None None] MFA Rules not processed for user `947bc36861e64e31811cb898f46a72e1`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:31.322064 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b3bebed7-6951-4898-8f44-cf6a428d7543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:31.388943 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 871/1737] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:31.615071 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c9e98-095d-4da3-9ebf-b9d7e941b7ad service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:31.616438 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-534c9e98-095d-4da3-9ebf-b9d7e941b7ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:31.636306 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c9e98-095d-4da3-9ebf-b9d7e941b7ad service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:31.641601 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88512c-7769-4f86-8622-5d32c4d60003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:31.642672 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88512c-7769-4f86-8622-5d32c4d60003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:31.643103 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88512c-7769-4f86-8622-5d32c4d60003 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:31.643534 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88512c-7769-4f86-8622-5d32c4d60003 admin admin] PATH_INFO: `/v3/projects/f6e04db2e05941038cef4a89ec8e0766` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:31.644998 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88512c-7769-4f86-8622-5d32c4d60003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e04db2e05941038cef4a89ec8e0766)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:31.653151 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88512c-7769-4f86-8622-5d32c4d60003 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:31.738777 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-2b88512c-7769-4f86-8622-5d32c4d60003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e04db2e05941038cef4a89ec8e0766', 'request_id': 'req-2b88512c-7769-4f86-8622-5d32c4d60003'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:31.753520 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-2b88512c-7769-4f86-8622-5d32c4d60003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e04db2e05941038cef4a89ec8e0766', 'request_id': 'req-2b88512c-7769-4f86-8622-5d32c4d60003'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:31.778428 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-2b88512c-7769-4f86-8622-5d32c4d60003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e04db2e05941038cef4a89ec8e0766', 'request_id': 'req-2b88512c-7769-4f86-8622-5d32c4d60003'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:31.798188 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-2b88512c-7769-4f86-8622-5d32c4d60003 admin admin] The token cache is being invalidate because project f6e04db2e05941038cef4a89ec8e0766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:50:31.798563 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-2b88512c-7769-4f86-8622-5d32c4d60003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:31.799375 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-2b88512c-7769-4f86-8622-5d32c4d60003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:31.805157 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 867/1738] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:50:31 2022] DELETE /identity/v3/projects/f6e04db2e05941038cef4a89ec8e0766 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:31.806953 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bebed7-6951-4898-8f44-cf6a428d7543 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:31.839693 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bebed7-6951-4898-8f44-cf6a428d7543 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:31.953516 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e4ec4-805d-47ac-b1f2-521af11afefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:31.954474 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e4ec4-805d-47ac-b1f2-521af11afefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:31.954982 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e4ec4-805d-47ac-b1f2-521af11afefb admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:31.955090 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e4ec4-805d-47ac-b1f2-521af11afefb admin admin] PATH_INFO: `/v3/users/c730c002593746a0aefa2e3a979789c3` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:31.961771 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e4ec4-805d-47ac-b1f2-521af11afefb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c730c002593746a0aefa2e3a979789c3)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:31.963874 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e4ec4-805d-47ac-b1f2-521af11afefb admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:32.082389 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-1b0e4ec4-805d-47ac-b1f2-521af11afefb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c730c002593746a0aefa2e3a979789c3'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:32.083219 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-1b0e4ec4-805d-47ac-b1f2-521af11afefb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c730c002593746a0aefa2e3a979789c3'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:32.084137 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-1b0e4ec4-805d-47ac-b1f2-521af11afefb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c730c002593746a0aefa2e3a979789c3'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:32.123887 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-1b0e4ec4-805d-47ac-b1f2-521af11afefb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c730c002593746a0aefa2e3a979789c3'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:32.163141 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88512c-7769-4f86-8622-5d32c4d60003 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:32.164745 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-2b88512c-7769-4f86-8622-5d32c4d60003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:32.169130 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-1b0e4ec4-805d-47ac-b1f2-521af11afefb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c730c002593746a0aefa2e3a979789c3'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:32.220233 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 872/1739] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:50:31 2022] DELETE /identity/v3/users/c730c002593746a0aefa2e3a979789c3 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:32.331182 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88512c-7769-4f86-8622-5d32c4d60003 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:32.499334 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11ce45-d33f-41a9-9af1-40e591e80439 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:32.500207 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11ce45-d33f-41a9-9af1-40e591e80439 service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:32.502462 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11ce45-d33f-41a9-9af1-40e591e80439 service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:32.503028 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11ce45-d33f-41a9-9af1-40e591e80439 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:32.506177 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-db11ce45-d33f-41a9-9af1-40e591e80439 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:32.528714 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11ce45-d33f-41a9-9af1-40e591e80439 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:32.534488 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11ce45-d33f-41a9-9af1-40e591e80439 service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:32.550238 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 868/1740] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:50:32.765487 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b2eb1-ebfa-41be-836e-c88945af6116 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:32.765989 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b2eb1-ebfa-41be-836e-c88945af6116 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:32.765989 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b2eb1-ebfa-41be-836e-c88945af6116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:32.805095 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-330b2eb1-ebfa-41be-836e-c88945af6116 None None] MFA Rules not processed for user `794281dc95a049b796164e866d3f2912`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:32.806324 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-330b2eb1-ebfa-41be-836e-c88945af6116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:32.848543 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11ce45-d33f-41a9-9af1-40e591e80439 service nova] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:32.852049 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-db11ce45-d33f-41a9-9af1-40e591e80439 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:32.940366 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 873/1741] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:32.991406 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11ce45-d33f-41a9-9af1-40e591e80439 service nova] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:33.004156 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb1201-9469-46ec-af2c-7800e2174efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:33.005548 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb1201-9469-46ec-af2c-7800e2174efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:33.005991 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb1201-9469-46ec-af2c-7800e2174efd admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:33.006406 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb1201-9469-46ec-af2c-7800e2174efd admin admin] PATH_INFO: `/v3/projects/69587bd85a064d01abee10aa11bb6c26` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:33.009959 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb1201-9469-46ec-af2c-7800e2174efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=69587bd85a064d01abee10aa11bb6c26)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:33.013370 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb1201-9469-46ec-af2c-7800e2174efd admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:33.084391 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-6bdb1201-9469-46ec-af2c-7800e2174efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69587bd85a064d01abee10aa11bb6c26', 'request_id': 'req-6bdb1201-9469-46ec-af2c-7800e2174efd'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:33.092466 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-6bdb1201-9469-46ec-af2c-7800e2174efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69587bd85a064d01abee10aa11bb6c26', 'request_id': 'req-6bdb1201-9469-46ec-af2c-7800e2174efd'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:33.105526 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-6bdb1201-9469-46ec-af2c-7800e2174efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69587bd85a064d01abee10aa11bb6c26', 'request_id': 'req-6bdb1201-9469-46ec-af2c-7800e2174efd'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:33.123804 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-6bdb1201-9469-46ec-af2c-7800e2174efd admin admin] The token cache is being invalidate because project 69587bd85a064d01abee10aa11bb6c26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:50:33.124377 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-6bdb1201-9469-46ec-af2c-7800e2174efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:33.125396 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-6bdb1201-9469-46ec-af2c-7800e2174efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:50:33.128945 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 869/1742] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:50:32 2022] DELETE /identity/v3/projects/69587bd85a064d01abee10aa11bb6c26 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:50:33.133790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebeb5cc-ddbf-4eef-bedf-084b7aed4e5f None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:33.134235 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebeb5cc-ddbf-4eef-bedf-084b7aed4e5f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:33.134652 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebeb5cc-ddbf-4eef-bedf-084b7aed4e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:33.178827 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-aebeb5cc-ddbf-4eef-bedf-084b7aed4e5f None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:33.180454 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-aebeb5cc-ddbf-4eef-bedf-084b7aed4e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:33.350215 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 874/1743] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:50:33.359138 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1da44-59af-4fca-b0cb-eab25815cd68 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:33.359559 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1da44-59af-4fca-b0cb-eab25815cd68 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:33.359931 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1da44-59af-4fca-b0cb-eab25815cd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:33.441902 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-89a1da44-59af-4fca-b0cb-eab25815cd68 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:33.443335 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-89a1da44-59af-4fca-b0cb-eab25815cd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:33.472823 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 870/1744] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:33.478656 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebeb5cc-ddbf-4eef-bedf-084b7aed4e5f None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:33.501318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebeb5cc-ddbf-4eef-bedf-084b7aed4e5f None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:33.514194 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb977f-ac19-42f8-8918-d90cead50174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:33.515336 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb977f-ac19-42f8-8918-d90cead50174 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:33.515968 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb977f-ac19-42f8-8918-d90cead50174 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:33.516584 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb977f-ac19-42f8-8918-d90cead50174 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:33.518442 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb977f-ac19-42f8-8918-d90cead50174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:50:33.519085 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb977f-ac19-42f8-8918-d90cead50174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:33.522116 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb977f-ac19-42f8-8918-d90cead50174 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:33.543331 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1da44-59af-4fca-b0cb-eab25815cd68 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:33.543591 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 875/1745] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:50:33.556058 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1da44-59af-4fca-b0cb-eab25815cd68 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:33.563552 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7d398-4ba5-40e2-bc0e-3cc0aec00b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:33.565655 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7d398-4ba5-40e2-bc0e-3cc0aec00b3f admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:33.566091 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7d398-4ba5-40e2-bc0e-3cc0aec00b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:33.566584 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7d398-4ba5-40e2-bc0e-3cc0aec00b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:33.568184 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7d398-4ba5-40e2-bc0e-3cc0aec00b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:33.570310 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7d398-4ba5-40e2-bc0e-3cc0aec00b3f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:33.619982 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb977f-ac19-42f8-8918-d90cead50174 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:33.630337 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 871/1746] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:50:33 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:33.636740 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb977f-ac19-42f8-8918-d90cead50174 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:33.798787 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa0afc-8d5c-48cb-be4e-ec8bd033d031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:33.799473 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa0afc-8d5c-48cb-be4e-ec8bd033d031 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:33.800023 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa0afc-8d5c-48cb-be4e-ec8bd033d031 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:33.800443 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa0afc-8d5c-48cb-be4e-ec8bd033d031 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:33.803509 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa0afc-8d5c-48cb-be4e-ec8bd033d031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:33.807611 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa0afc-8d5c-48cb-be4e-ec8bd033d031 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:33.844949 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 876/1747] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:50:33 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:33.847287 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7d398-4ba5-40e2-bc0e-3cc0aec00b3f admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:33.860243 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7d398-4ba5-40e2-bc0e-3cc0aec00b3f admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:33.873894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0812e-798e-43f4-9ea7-7c7169d862f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:33.875287 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0812e-798e-43f4-9ea7-7c7169d862f6 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:33.876381 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0812e-798e-43f4-9ea7-7c7169d862f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:33.877040 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0812e-798e-43f4-9ea7-7c7169d862f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:33.878035 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0812e-798e-43f4-9ea7-7c7169d862f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:33.880554 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0812e-798e-43f4-9ea7-7c7169d862f6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:33.895787 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 872/1748] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:50:33.900790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa0afc-8d5c-48cb-be4e-ec8bd033d031 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:33.913496 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa0afc-8d5c-48cb-be4e-ec8bd033d031 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:33.920977 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd440338-d513-462c-b5df-007d1a6c19b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:33.921851 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd440338-d513-462c-b5df-007d1a6c19b3 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:33.922383 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd440338-d513-462c-b5df-007d1a6c19b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:33.922816 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd440338-d513-462c-b5df-007d1a6c19b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:33.923874 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd440338-d513-462c-b5df-007d1a6c19b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:33.927252 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd440338-d513-462c-b5df-007d1a6c19b3 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:33.940892 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 877/1749] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:50:33.945284 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0812e-798e-43f4-9ea7-7c7169d862f6 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:33.956839 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0812e-798e-43f4-9ea7-7c7169d862f6 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:33.962351 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5efd5-b7c3-49fa-9966-4cc2b8c876e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:33.963530 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5efd5-b7c3-49fa-9966-4cc2b8c876e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:33.964324 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5efd5-b7c3-49fa-9966-4cc2b8c876e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:33.965066 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5efd5-b7c3-49fa-9966-4cc2b8c876e3 admin admin] PATH_INFO: `/v3/projects/f09f302d4fca4973829a01f187f7588d/users/f721572db3aa4479a38bcb1cc5453d44/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:34.012685 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5efd5-b7c3-49fa-9966-4cc2b8c876e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09f302d4fca4973829a01f187f7588d, user_id=f721572db3aa4479a38bcb1cc5453d44, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:34.027678 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5efd5-b7c3-49fa-9966-4cc2b8c876e3 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:34.072398 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 873/1750] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:50:33 2022] PUT /identity/v3/projects/f09f302d4fca4973829a01f187f7588d/users/f721572db3aa4479a38bcb1cc5453d44/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:34.083946 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42264e6-f8f8-4e08-aa8f-8f39c70fba60 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:34.084240 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42264e6-f8f8-4e08-aa8f-8f39c70fba60 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:34.084681 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42264e6-f8f8-4e08-aa8f-8f39c70fba60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:34.135441 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-f42264e6-f8f8-4e08-aa8f-8f39c70fba60 None None] MFA Rules not processed for user `f721572db3aa4479a38bcb1cc5453d44`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:34.138683 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f42264e6-f8f8-4e08-aa8f-8f39c70fba60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:34.281882 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 878/1751] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:34.282195 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5efd5-b7c3-49fa-9966-4cc2b8c876e3 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:34.393157 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5efd5-b7c3-49fa-9966-4cc2b8c876e3 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:34.411910 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ab832-7dbf-4c14-a65d-75bd21ab27e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:34.412771 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ab832-7dbf-4c14-a65d-75bd21ab27e6 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:34.413099 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ab832-7dbf-4c14-a65d-75bd21ab27e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:34.413368 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ab832-7dbf-4c14-a65d-75bd21ab27e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:34.414077 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ab832-7dbf-4c14-a65d-75bd21ab27e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:34.415990 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ab832-7dbf-4c14-a65d-75bd21ab27e6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:34.468457 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 874/1752] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:50:34 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:34.473069 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42264e6-f8f8-4e08-aa8f-8f39c70fba60 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:34.487986 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42264e6-f8f8-4e08-aa8f-8f39c70fba60 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:34.577817 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094a924-a922-4202-b941-1505eb966f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:34.578737 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094a924-a922-4202-b941-1505eb966f82 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:34.579128 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094a924-a922-4202-b941-1505eb966f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:34.579506 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094a924-a922-4202-b941-1505eb966f82 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:34.580397 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094a924-a922-4202-b941-1505eb966f82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:34.583961 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094a924-a922-4202-b941-1505eb966f82 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:34.618592 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 879/1753] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:50:34 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:50:34.619575 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ab832-7dbf-4c14-a65d-75bd21ab27e6 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:34.655968 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ab832-7dbf-4c14-a65d-75bd21ab27e6 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:34.707840 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dba29d-0673-4709-a198-90f4f7fb2d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:34.708546 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dba29d-0673-4709-a198-90f4f7fb2d35 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:34.708827 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dba29d-0673-4709-a198-90f4f7fb2d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:34.709127 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dba29d-0673-4709-a198-90f4f7fb2d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:34.714754 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dba29d-0673-4709-a198-90f4f7fb2d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:34.720018 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dba29d-0673-4709-a198-90f4f7fb2d35 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:34.769824 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094a924-a922-4202-b941-1505eb966f82 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:34.781711 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 875/1754] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:34.784053 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094a924-a922-4202-b941-1505eb966f82 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:34.793043 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09e5d8-50df-4222-a929-622ae59242f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:34.794316 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09e5d8-50df-4222-a929-622ae59242f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:34.794766 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09e5d8-50df-4222-a929-622ae59242f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:34.795195 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09e5d8-50df-4222-a929-622ae59242f2 admin admin] PATH_INFO: `/v3/projects/e3ae86f1be024a14ae49799f6335c7df/users/3e26f12d728241e6a31858c7b7363d04/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:34.850314 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09e5d8-50df-4222-a929-622ae59242f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ae86f1be024a14ae49799f6335c7df, user_id=3e26f12d728241e6a31858c7b7363d04, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:34.853664 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09e5d8-50df-4222-a929-622ae59242f2 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:34.882615 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 880/1755] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:50:34 2022] PUT /identity/v3/projects/e3ae86f1be024a14ae49799f6335c7df/users/3e26f12d728241e6a31858c7b7363d04/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:34.887635 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dba29d-0673-4709-a198-90f4f7fb2d35 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:34.901896 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dba29d-0673-4709-a198-90f4f7fb2d35 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:35.086462 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94569b1c-ac1c-446b-88b5-b61a84ad0854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:35.087629 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94569b1c-ac1c-446b-88b5-b61a84ad0854 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:35.088153 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94569b1c-ac1c-446b-88b5-b61a84ad0854 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:35.088655 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94569b1c-ac1c-446b-88b5-b61a84ad0854 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:35.092082 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94569b1c-ac1c-446b-88b5-b61a84ad0854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:35.097353 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94569b1c-ac1c-446b-88b5-b61a84ad0854 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:35.123239 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 876/1756] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:50:35.128099 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09e5d8-50df-4222-a929-622ae59242f2 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:35.147655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09e5d8-50df-4222-a929-622ae59242f2 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:35.153293 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714d67b-dfca-4d72-bd2b-d2d187e56e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:35.154202 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714d67b-dfca-4d72-bd2b-d2d187e56e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:35.154488 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714d67b-dfca-4d72-bd2b-d2d187e56e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:35.154770 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714d67b-dfca-4d72-bd2b-d2d187e56e6a admin admin] PATH_INFO: `/v3/projects/e3ae86f1be024a14ae49799f6335c7df/users/3e26f12d728241e6a31858c7b7363d04/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:35.158312 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714d67b-dfca-4d72-bd2b-d2d187e56e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ae86f1be024a14ae49799f6335c7df, user_id=3e26f12d728241e6a31858c7b7363d04, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:35.167317 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714d67b-dfca-4d72-bd2b-d2d187e56e6a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:35.220339 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 881/1757] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:50:35 2022] PUT /identity/v3/projects/e3ae86f1be024a14ae49799f6335c7df/users/3e26f12d728241e6a31858c7b7363d04/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:50:35.222144 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d9745-2570-4216-9814-30178b0deaa6 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:35.222684 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d9745-2570-4216-9814-30178b0deaa6 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:35.223207 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d9745-2570-4216-9814-30178b0deaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:35.308174 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-898d9745-2570-4216-9814-30178b0deaa6 None None] MFA Rules not processed for user `3e26f12d728241e6a31858c7b7363d04`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:35.309612 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-898d9745-2570-4216-9814-30178b0deaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:35.512510 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 877/1758] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:50:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:50:35.520665 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714d67b-dfca-4d72-bd2b-d2d187e56e6a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:35.522458 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-e714d67b-dfca-4d72-bd2b-d2d187e56e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:35.634842 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714d67b-dfca-4d72-bd2b-d2d187e56e6a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:35.645761 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b333f-455c-4785-8281-3323ceb4949b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:35.647588 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b333f-455c-4785-8281-3323ceb4949b service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:35.651041 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b333f-455c-4785-8281-3323ceb4949b service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:35.651468 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b333f-455c-4785-8281-3323ceb4949b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:35.784935 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b333f-455c-4785-8281-3323ceb4949b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:35.786940 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b333f-455c-4785-8281-3323ceb4949b service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:35.797272 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 882/1759] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:40.975777 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f774101-6c5c-404a-b010-08c6bbb063f8 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:40.976672 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f774101-6c5c-404a-b010-08c6bbb063f8 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:40.977138 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f774101-6c5c-404a-b010-08c6bbb063f8 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:40.979402 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 878/1760] 10.222.0.31 () {54 vars in 921 bytes} [Mon Jan 10 17:50:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:50:40.994054 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864db43-8a7c-4882-8530-10c56601333d None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:40.994601 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864db43-8a7c-4882-8530-10c56601333d None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:40.994601 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864db43-8a7c-4882-8530-10c56601333d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:41.041342 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-4864db43-8a7c-4882-8530-10c56601333d None None] MFA Rules not processed for user `877acd6448214ef893d119e3b1043402`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:50:41.042742 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-4864db43-8a7c-4882-8530-10c56601333d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:41.163050 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 883/1761] 10.222.0.31 () {58 vars in 1018 bytes} [Mon Jan 10 17:50:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:50:41.200228 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f774101-6c5c-404a-b010-08c6bbb063f8 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:41.202151 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-4f774101-6c5c-404a-b010-08c6bbb063f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:50:41.221506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f774101-6c5c-404a-b010-08c6bbb063f8 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:41.229925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01799175-35b1-42a8-8e8f-e0df34f99988 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:41.230935 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01799175-35b1-42a8-8e8f-e0df34f99988 service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:41.231601 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01799175-35b1-42a8-8e8f-e0df34f99988 service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:41.232332 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01799175-35b1-42a8-8e8f-e0df34f99988 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:41.246370 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01799175-35b1-42a8-8e8f-e0df34f99988 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:41.248680 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01799175-35b1-42a8-8e8f-e0df34f99988 service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:41.261235 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 879/1762] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:50:45.227826 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864db43-8a7c-4882-8530-10c56601333d None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:50:45.238471 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864db43-8a7c-4882-8530-10c56601333d None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:50:45.242081 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371605b-c54e-4e29-8eee-588f52f7b71b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:50:45.242757 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371605b-c54e-4e29-8eee-588f52f7b71b service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:50:45.243037 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371605b-c54e-4e29-8eee-588f52f7b71b service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:50:45.243308 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371605b-c54e-4e29-8eee-588f52f7b71b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:50:45.252465 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371605b-c54e-4e29-8eee-588f52f7b71b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:50:45.253938 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371605b-c54e-4e29-8eee-588f52f7b71b service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:50:45.265405 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 884/1763] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:50:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:10.472098 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01799175-35b1-42a8-8e8f-e0df34f99988 service nova] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:10.474205 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-01799175-35b1-42a8-8e8f-e0df34f99988 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:10.543928 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01799175-35b1-42a8-8e8f-e0df34f99988 service nova] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:10.553195 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6a3ad-f595-4ff2-bf2a-1b5519523e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:10.554106 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6a3ad-f595-4ff2-bf2a-1b5519523e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:10.554392 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6a3ad-f595-4ff2-bf2a-1b5519523e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:10.554676 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6a3ad-f595-4ff2-bf2a-1b5519523e80 admin admin] PATH_INFO: `/v3/users/bcbfe00e8ca8465ba32d07379a771605` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:10.555889 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6a3ad-f595-4ff2-bf2a-1b5519523e80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcbfe00e8ca8465ba32d07379a771605)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:10.557870 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6a3ad-f595-4ff2-bf2a-1b5519523e80 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:10.606297 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-fbb6a3ad-f595-4ff2-bf2a-1b5519523e80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcbfe00e8ca8465ba32d07379a771605'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:10.617959 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-fbb6a3ad-f595-4ff2-bf2a-1b5519523e80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcbfe00e8ca8465ba32d07379a771605'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:10.624515 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-fbb6a3ad-f595-4ff2-bf2a-1b5519523e80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcbfe00e8ca8465ba32d07379a771605'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:10.633925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-fbb6a3ad-f595-4ff2-bf2a-1b5519523e80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcbfe00e8ca8465ba32d07379a771605'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:10.634544 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-fbb6a3ad-f595-4ff2-bf2a-1b5519523e80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcbfe00e8ca8465ba32d07379a771605'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:10.640731 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 880/1764] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:10 2022] DELETE /identity/v3/users/bcbfe00e8ca8465ba32d07379a771605 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:10.646554 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d41a66-2ce7-4d9d-ac55-49d49b83a1bd None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:10.647578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d41a66-2ce7-4d9d-ac55-49d49b83a1bd None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:10.647866 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d41a66-2ce7-4d9d-ac55-49d49b83a1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:10.668318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-92d41a66-2ce7-4d9d-ac55-49d49b83a1bd None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:10.669586 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-92d41a66-2ce7-4d9d-ac55-49d49b83a1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:10.738152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 885/1765] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:10.747559 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6a3ad-f595-4ff2-bf2a-1b5519523e80 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:10.749024 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-fbb6a3ad-f595-4ff2-bf2a-1b5519523e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:10.823525 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6a3ad-f595-4ff2-bf2a-1b5519523e80 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:10.828111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c45c9-c0ad-41b4-a602-6d5ba0b883b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:10.828864 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c45c9-c0ad-41b4-a602-6d5ba0b883b0 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:10.829160 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c45c9-c0ad-41b4-a602-6d5ba0b883b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:10.829438 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c45c9-c0ad-41b4-a602-6d5ba0b883b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:10.855232 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c45c9-c0ad-41b4-a602-6d5ba0b883b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:10.856680 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c45c9-c0ad-41b4-a602-6d5ba0b883b0 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:10.869518 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 881/1766] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:11.326258 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d41a66-2ce7-4d9d-ac55-49d49b83a1bd None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:11.327883 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-92d41a66-2ce7-4d9d-ac55-49d49b83a1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:11.343049 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d41a66-2ce7-4d9d-ac55-49d49b83a1bd None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:11.349203 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d9449-c9df-4a3d-b4fe-a22645168164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:11.350253 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d9449-c9df-4a3d-b4fe-a22645168164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:11.350836 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d9449-c9df-4a3d-b4fe-a22645168164 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:11.351246 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d9449-c9df-4a3d-b4fe-a22645168164 admin admin] PATH_INFO: `/v3/projects/8334eac7c4ab4cbcb260b383197e865a` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:11.352623 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d9449-c9df-4a3d-b4fe-a22645168164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8334eac7c4ab4cbcb260b383197e865a)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:11.354750 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d9449-c9df-4a3d-b4fe-a22645168164 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:11.415803 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-203d9449-c9df-4a3d-b4fe-a22645168164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8334eac7c4ab4cbcb260b383197e865a', 'request_id': 'req-203d9449-c9df-4a3d-b4fe-a22645168164'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:11.423003 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-203d9449-c9df-4a3d-b4fe-a22645168164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8334eac7c4ab4cbcb260b383197e865a', 'request_id': 'req-203d9449-c9df-4a3d-b4fe-a22645168164'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:11.434049 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-203d9449-c9df-4a3d-b4fe-a22645168164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8334eac7c4ab4cbcb260b383197e865a', 'request_id': 'req-203d9449-c9df-4a3d-b4fe-a22645168164'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:11.448565 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-203d9449-c9df-4a3d-b4fe-a22645168164 admin admin] The token cache is being invalidate because project 8334eac7c4ab4cbcb260b383197e865a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:11.448963 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-203d9449-c9df-4a3d-b4fe-a22645168164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:11.449805 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-203d9449-c9df-4a3d-b4fe-a22645168164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:11.451539 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 886/1767] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:11 2022] DELETE /identity/v3/projects/8334eac7c4ab4cbcb260b383197e865a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:11.456646 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c45c9-c0ad-41b4-a602-6d5ba0b883b0 service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:11.468738 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c45c9-c0ad-41b4-a602-6d5ba0b883b0 service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:11.523923 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d22b50-d4de-4043-8842-562d7cbecc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:11.524803 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d22b50-d4de-4043-8842-562d7cbecc81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:11.525095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d22b50-d4de-4043-8842-562d7cbecc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:11.525367 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d22b50-d4de-4043-8842-562d7cbecc81 admin admin] PATH_INFO: `/v3/users/cb1dba5062c54e15bccbecaec80e5a6e` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:11.526826 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d22b50-d4de-4043-8842-562d7cbecc81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb1dba5062c54e15bccbecaec80e5a6e)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:11.528764 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d22b50-d4de-4043-8842-562d7cbecc81 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:11.609415 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-64d22b50-d4de-4043-8842-562d7cbecc81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb1dba5062c54e15bccbecaec80e5a6e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:11.625792 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-64d22b50-d4de-4043-8842-562d7cbecc81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb1dba5062c54e15bccbecaec80e5a6e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:11.634366 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-64d22b50-d4de-4043-8842-562d7cbecc81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb1dba5062c54e15bccbecaec80e5a6e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:11.642916 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-64d22b50-d4de-4043-8842-562d7cbecc81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb1dba5062c54e15bccbecaec80e5a6e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:11.643663 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-64d22b50-d4de-4043-8842-562d7cbecc81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb1dba5062c54e15bccbecaec80e5a6e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:11.650265 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 882/1768] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:11 2022] DELETE /identity/v3/users/cb1dba5062c54e15bccbecaec80e5a6e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:11.930894 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d9449-c9df-4a3d-b4fe-a22645168164 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:11.933539 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-203d9449-c9df-4a3d-b4fe-a22645168164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:11.952101 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d9449-c9df-4a3d-b4fe-a22645168164 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:12.053649 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df231fe-4fbc-40d3-9e1c-df84ad40815f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:12.055476 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df231fe-4fbc-40d3-9e1c-df84ad40815f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:12.055937 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df231fe-4fbc-40d3-9e1c-df84ad40815f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:12.056433 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df231fe-4fbc-40d3-9e1c-df84ad40815f admin admin] PATH_INFO: `/v3/projects/5199df0c4c1d407e9c47ce41d1f41955` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:12.058218 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df231fe-4fbc-40d3-9e1c-df84ad40815f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5199df0c4c1d407e9c47ce41d1f41955)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:12.060463 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df231fe-4fbc-40d3-9e1c-df84ad40815f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:12.119159 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-3df231fe-4fbc-40d3-9e1c-df84ad40815f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5199df0c4c1d407e9c47ce41d1f41955', 'request_id': 'req-3df231fe-4fbc-40d3-9e1c-df84ad40815f'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:12.128787 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-3df231fe-4fbc-40d3-9e1c-df84ad40815f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5199df0c4c1d407e9c47ce41d1f41955', 'request_id': 'req-3df231fe-4fbc-40d3-9e1c-df84ad40815f'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:12.140219 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-3df231fe-4fbc-40d3-9e1c-df84ad40815f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5199df0c4c1d407e9c47ce41d1f41955', 'request_id': 'req-3df231fe-4fbc-40d3-9e1c-df84ad40815f'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:12.181787 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-3df231fe-4fbc-40d3-9e1c-df84ad40815f admin admin] The token cache is being invalidate because project 5199df0c4c1d407e9c47ce41d1f41955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:12.182077 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-3df231fe-4fbc-40d3-9e1c-df84ad40815f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:12.182935 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-3df231fe-4fbc-40d3-9e1c-df84ad40815f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:12.184819 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 887/1769] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:11 2022] DELETE /identity/v3/projects/5199df0c4c1d407e9c47ce41d1f41955 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:12.191012 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8d8c4-3970-4770-a933-28f980eb0575 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:12.191303 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8d8c4-3970-4770-a933-28f980eb0575 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:12.191592 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8d8c4-3970-4770-a933-28f980eb0575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:12.226269 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-00a8d8c4-3970-4770-a933-28f980eb0575 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:12.228116 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-00a8d8c4-3970-4770-a933-28f980eb0575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:12.321009 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 883/1770] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:12.322049 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a6376-08d3-4160-acf4-77454fb5cbfa None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:12.322340 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a6376-08d3-4160-acf4-77454fb5cbfa None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:12.322781 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a6376-08d3-4160-acf4-77454fb5cbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:12.342352 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-0a0a6376-08d3-4160-acf4-77454fb5cbfa None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:12.343550 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-0a0a6376-08d3-4160-acf4-77454fb5cbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:12.352401 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 888/1771] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:12.360330 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8d8c4-3970-4770-a933-28f980eb0575 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:12.379750 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8d8c4-3970-4770-a933-28f980eb0575 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:12.384528 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfb066-db68-48ca-9395-e670a040b906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:12.385222 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfb066-db68-48ca-9395-e670a040b906 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:12.385501 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfb066-db68-48ca-9395-e670a040b906 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:12.385776 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfb066-db68-48ca-9395-e670a040b906 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:12.386519 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfb066-db68-48ca-9395-e670a040b906 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:51:12.386822 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfb066-db68-48ca-9395-e670a040b906 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:12.388493 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfb066-db68-48ca-9395-e670a040b906 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:12.400610 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 884/1772] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:51:12.404770 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a6376-08d3-4160-acf4-77454fb5cbfa None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:12.413857 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a6376-08d3-4160-acf4-77454fb5cbfa None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:12.418617 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a18b3-f85e-4c4a-ae28-7a72bc95e37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:12.419283 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a18b3-f85e-4c4a-ae28-7a72bc95e37e admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:12.419723 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a18b3-f85e-4c4a-ae28-7a72bc95e37e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:12.420140 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a18b3-f85e-4c4a-ae28-7a72bc95e37e admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:12.421031 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a18b3-f85e-4c4a-ae28-7a72bc95e37e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:12.423149 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a18b3-f85e-4c4a-ae28-7a72bc95e37e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:12.476336 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 889/1773] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:12 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:12.480294 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfb066-db68-48ca-9395-e670a040b906 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:12.491194 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfb066-db68-48ca-9395-e670a040b906 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:12.556571 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11178f-6887-48a2-8a30-421ab707bc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:12.558472 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11178f-6887-48a2-8a30-421ab707bc34 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:12.558472 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11178f-6887-48a2-8a30-421ab707bc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:12.558682 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11178f-6887-48a2-8a30-421ab707bc34 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:12.559421 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11178f-6887-48a2-8a30-421ab707bc34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:12.561960 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11178f-6887-48a2-8a30-421ab707bc34 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:12.590465 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 885/1774] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:12 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:51:12.594564 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a18b3-f85e-4c4a-ae28-7a72bc95e37e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:12.610213 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a18b3-f85e-4c4a-ae28-7a72bc95e37e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:12.616101 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddae25-8815-455c-8a1f-1e793e492431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:12.618693 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddae25-8815-455c-8a1f-1e793e492431 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:12.619047 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddae25-8815-455c-8a1f-1e793e492431 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:12.619455 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddae25-8815-455c-8a1f-1e793e492431 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:12.620346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddae25-8815-455c-8a1f-1e793e492431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:12.622345 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddae25-8815-455c-8a1f-1e793e492431 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:12.635875 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 890/1775] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:51:12.640411 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11178f-6887-48a2-8a30-421ab707bc34 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:12.651956 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11178f-6887-48a2-8a30-421ab707bc34 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:12.657485 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ac01c-7106-4a91-ac4e-7de944367d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:12.658409 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ac01c-7106-4a91-ac4e-7de944367d75 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:12.659116 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ac01c-7106-4a91-ac4e-7de944367d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:12.659496 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ac01c-7106-4a91-ac4e-7de944367d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:12.660354 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ac01c-7106-4a91-ac4e-7de944367d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:12.662084 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ac01c-7106-4a91-ac4e-7de944367d75 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:12.673986 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 886/1776] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:12.677751 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddae25-8815-455c-8a1f-1e793e492431 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:12.689735 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddae25-8815-455c-8a1f-1e793e492431 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:12.695048 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2116e-9adf-4bea-893c-cc1da148f979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:12.696215 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2116e-9adf-4bea-893c-cc1da148f979 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:12.696600 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2116e-9adf-4bea-893c-cc1da148f979 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:12.697055 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2116e-9adf-4bea-893c-cc1da148f979 admin admin] PATH_INFO: `/v3/projects/49da6d91c4704b85978cb2fe20e0f6e5/users/db40c36dd09744a5a0f0a4155c871877/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:12.718372 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2116e-9adf-4bea-893c-cc1da148f979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49da6d91c4704b85978cb2fe20e0f6e5, user_id=db40c36dd09744a5a0f0a4155c871877, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:12.728919 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2116e-9adf-4bea-893c-cc1da148f979 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:12.760804 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 891/1777] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:12 2022] PUT /identity/v3/projects/49da6d91c4704b85978cb2fe20e0f6e5/users/db40c36dd09744a5a0f0a4155c871877/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:12.762903 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd24486-34a5-4ab5-8d41-890c70612866 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:12.763293 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd24486-34a5-4ab5-8d41-890c70612866 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:12.763546 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd24486-34a5-4ab5-8d41-890c70612866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:12.811580 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-cdd24486-34a5-4ab5-8d41-890c70612866 None None] MFA Rules not processed for user `db40c36dd09744a5a0f0a4155c871877`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:12.814003 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-cdd24486-34a5-4ab5-8d41-890c70612866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:12.901142 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 887/1778] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:12.905745 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2116e-9adf-4bea-893c-cc1da148f979 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:12.980044 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2116e-9adf-4bea-893c-cc1da148f979 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:12.988540 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d2994-1225-4d0d-bf5a-386c61470122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:12.989271 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d2994-1225-4d0d-bf5a-386c61470122 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:12.989654 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d2994-1225-4d0d-bf5a-386c61470122 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:12.990213 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d2994-1225-4d0d-bf5a-386c61470122 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:12.992233 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d2994-1225-4d0d-bf5a-386c61470122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:12.998552 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d2994-1225-4d0d-bf5a-386c61470122 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:13.060356 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 892/1779] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:12 2022] POST /identity/v3/projects => generated 379 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:13.061432 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd24486-34a5-4ab5-8d41-890c70612866 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:13.079033 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd24486-34a5-4ab5-8d41-890c70612866 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:13.158541 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61c2d7-8d60-43a9-a387-dd38b735a593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:13.159349 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61c2d7-8d60-43a9-a387-dd38b735a593 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:13.160676 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61c2d7-8d60-43a9-a387-dd38b735a593 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:13.161040 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61c2d7-8d60-43a9-a387-dd38b735a593 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:13.161716 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61c2d7-8d60-43a9-a387-dd38b735a593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:13.168379 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61c2d7-8d60-43a9-a387-dd38b735a593 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:13.199770 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 888/1780] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:13 2022] POST /identity/v3/users => generated 296 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:51:13.205639 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d2994-1225-4d0d-bf5a-386c61470122 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:13.227006 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d2994-1225-4d0d-bf5a-386c61470122 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:13.234493 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13e18f-7953-465e-a569-679e623565bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:13.235811 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13e18f-7953-465e-a569-679e623565bb admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:13.236245 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13e18f-7953-465e-a569-679e623565bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:13.236674 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13e18f-7953-465e-a569-679e623565bb admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:13.241789 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13e18f-7953-465e-a569-679e623565bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:13.243425 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13e18f-7953-465e-a569-679e623565bb admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:13.259555 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 893/1781] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:13.263845 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61c2d7-8d60-43a9-a387-dd38b735a593 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:13.275607 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61c2d7-8d60-43a9-a387-dd38b735a593 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:13.280630 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba6d77-db60-458f-825f-2c39b37d6e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:13.281709 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba6d77-db60-458f-825f-2c39b37d6e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:13.282143 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba6d77-db60-458f-825f-2c39b37d6e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:13.282515 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba6d77-db60-458f-825f-2c39b37d6e30 admin admin] PATH_INFO: `/v3/projects/145a5f86c4a34f96b571eebc41cdc401/users/7299bd3568ca49b58a5885bdb63718cb/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:13.297729 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba6d77-db60-458f-825f-2c39b37d6e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=145a5f86c4a34f96b571eebc41cdc401, user_id=7299bd3568ca49b58a5885bdb63718cb, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:13.300654 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba6d77-db60-458f-825f-2c39b37d6e30 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:13.316892 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 889/1782] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:13 2022] PUT /identity/v3/projects/145a5f86c4a34f96b571eebc41cdc401/users/7299bd3568ca49b58a5885bdb63718cb/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:13.321101 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13e18f-7953-465e-a569-679e623565bb admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:13.331150 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13e18f-7953-465e-a569-679e623565bb admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:13.385991 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0c6a5-c5e1-4c5e-a888-1bc8a6e1d967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:13.386679 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0c6a5-c5e1-4c5e-a888-1bc8a6e1d967 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:13.386962 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0c6a5-c5e1-4c5e-a888-1bc8a6e1d967 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:13.387246 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0c6a5-c5e1-4c5e-a888-1bc8a6e1d967 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:13.387993 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0c6a5-c5e1-4c5e-a888-1bc8a6e1d967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:13.389655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0c6a5-c5e1-4c5e-a888-1bc8a6e1d967 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:13.403737 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 894/1783] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:13.404940 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba6d77-db60-458f-825f-2c39b37d6e30 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:13.415458 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba6d77-db60-458f-825f-2c39b37d6e30 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:13.420420 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66966d-150d-4c17-ad2f-d71460efa6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:13.421435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66966d-150d-4c17-ad2f-d71460efa6e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:13.421807 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66966d-150d-4c17-ad2f-d71460efa6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:13.422140 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66966d-150d-4c17-ad2f-d71460efa6e3 admin admin] PATH_INFO: `/v3/projects/145a5f86c4a34f96b571eebc41cdc401/users/7299bd3568ca49b58a5885bdb63718cb/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:13.424201 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66966d-150d-4c17-ad2f-d71460efa6e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=145a5f86c4a34f96b571eebc41cdc401, user_id=7299bd3568ca49b58a5885bdb63718cb, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:13.427116 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66966d-150d-4c17-ad2f-d71460efa6e3 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:13.438031 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 890/1784] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:13 2022] PUT /identity/v3/projects/145a5f86c4a34f96b571eebc41cdc401/users/7299bd3568ca49b58a5885bdb63718cb/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:13.449457 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb296805-42bc-4ae9-9286-b258fe9b682e None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:13.449794 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb296805-42bc-4ae9-9286-b258fe9b682e None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:13.450094 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb296805-42bc-4ae9-9286-b258fe9b682e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:13.476824 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-fb296805-42bc-4ae9-9286-b258fe9b682e None None] MFA Rules not processed for user `7299bd3568ca49b58a5885bdb63718cb`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:13.478076 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-fb296805-42bc-4ae9-9286-b258fe9b682e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:13.547819 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 895/1785] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:13.558594 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66966d-150d-4c17-ad2f-d71460efa6e3 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:13.561096 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-6a66966d-150d-4c17-ad2f-d71460efa6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:13.618190 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66966d-150d-4c17-ad2f-d71460efa6e3 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:13.622192 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7bf10-de4d-4e98-bb10-3db3f7c8428d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:13.622368 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb296805-42bc-4ae9-9286-b258fe9b682e None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:13.622932 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7bf10-de4d-4e98-bb10-3db3f7c8428d service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:13.623245 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7bf10-de4d-4e98-bb10-3db3f7c8428d service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:13.623636 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7bf10-de4d-4e98-bb10-3db3f7c8428d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:13.623870 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-fb296805-42bc-4ae9-9286-b258fe9b682e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:13.633095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7bf10-de4d-4e98-bb10-3db3f7c8428d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:13.634587 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7bf10-de4d-4e98-bb10-3db3f7c8428d service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:13.643856 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 891/1786] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:13.696117 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb296805-42bc-4ae9-9286-b258fe9b682e None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:13.707440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe34a4-9493-4c0a-a516-209d49d7da2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:13.708626 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe34a4-9493-4c0a-a516-209d49d7da2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:13.709111 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe34a4-9493-4c0a-a516-209d49d7da2c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:13.709398 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe34a4-9493-4c0a-a516-209d49d7da2c admin admin] PATH_INFO: `/v3/users/f721572db3aa4479a38bcb1cc5453d44` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:13.710707 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe34a4-9493-4c0a-a516-209d49d7da2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f721572db3aa4479a38bcb1cc5453d44)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:13.712767 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe34a4-9493-4c0a-a516-209d49d7da2c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:13.723692 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7bf10-de4d-4e98-bb10-3db3f7c8428d service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:13.725647 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-77f7bf10-de4d-4e98-bb10-3db3f7c8428d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:13.743148 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7bf10-de4d-4e98-bb10-3db3f7c8428d service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:13.753519 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248d923-dd6c-4c3a-b2f1-a89e9a3f6151 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:13.754219 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248d923-dd6c-4c3a-b2f1-a89e9a3f6151 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:13.754585 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248d923-dd6c-4c3a-b2f1-a89e9a3f6151 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:13.754857 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248d923-dd6c-4c3a-b2f1-a89e9a3f6151 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:13.783256 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b6fe34a4-9493-4c0a-a516-209d49d7da2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f721572db3aa4479a38bcb1cc5453d44'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:13.783912 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b6fe34a4-9493-4c0a-a516-209d49d7da2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f721572db3aa4479a38bcb1cc5453d44'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:13.784524 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b6fe34a4-9493-4c0a-a516-209d49d7da2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f721572db3aa4479a38bcb1cc5453d44'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:13.798365 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b6fe34a4-9493-4c0a-a516-209d49d7da2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f721572db3aa4479a38bcb1cc5453d44'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:13.805480 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b6fe34a4-9493-4c0a-a516-209d49d7da2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f721572db3aa4479a38bcb1cc5453d44'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:13.820900 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 896/1787] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:13 2022] DELETE /identity/v3/users/f721572db3aa4479a38bcb1cc5453d44 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:13.824656 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a84d42-6730-453e-a5ca-39a58b658c35 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:13.824972 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a84d42-6730-453e-a5ca-39a58b658c35 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:13.825247 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a84d42-6730-453e-a5ca-39a58b658c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:13.840822 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248d923-dd6c-4c3a-b2f1-a89e9a3f6151 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:13.842704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248d923-dd6c-4c3a-b2f1-a89e9a3f6151 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:13.843096 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-b2a84d42-6730-453e-a5ca-39a58b658c35 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:13.844325 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b2a84d42-6730-453e-a5ca-39a58b658c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:13.853169 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 892/1788] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:13.944013 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 897/1789] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:13.963156 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248d923-dd6c-4c3a-b2f1-a89e9a3f6151 service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:13.965115 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-d248d923-dd6c-4c3a-b2f1-a89e9a3f6151 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:14.035368 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248d923-dd6c-4c3a-b2f1-a89e9a3f6151 service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:14.105069 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019b6a1-70ee-4a16-8255-273deae88f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:14.105868 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019b6a1-70ee-4a16-8255-273deae88f42 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:14.106210 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019b6a1-70ee-4a16-8255-273deae88f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:14.106546 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019b6a1-70ee-4a16-8255-273deae88f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:14.130811 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019b6a1-70ee-4a16-8255-273deae88f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:14.132276 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019b6a1-70ee-4a16-8255-273deae88f42 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:14.145378 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 893/1790] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:51:14.597358 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a84d42-6730-453e-a5ca-39a58b658c35 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:14.599315 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b2a84d42-6730-453e-a5ca-39a58b658c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:14.611817 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a84d42-6730-453e-a5ca-39a58b658c35 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:14.621886 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44953dd7-ae3f-4a52-ab36-5ddd869127f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:14.623226 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44953dd7-ae3f-4a52-ab36-5ddd869127f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:14.623620 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44953dd7-ae3f-4a52-ab36-5ddd869127f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:14.624121 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44953dd7-ae3f-4a52-ab36-5ddd869127f9 admin admin] PATH_INFO: `/v3/projects/f09f302d4fca4973829a01f187f7588d` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:14.626283 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44953dd7-ae3f-4a52-ab36-5ddd869127f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f09f302d4fca4973829a01f187f7588d)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:14.629244 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44953dd7-ae3f-4a52-ab36-5ddd869127f9 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:14.675701 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-44953dd7-ae3f-4a52-ab36-5ddd869127f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f09f302d4fca4973829a01f187f7588d', 'request_id': 'req-44953dd7-ae3f-4a52-ab36-5ddd869127f9'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:14.680924 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-44953dd7-ae3f-4a52-ab36-5ddd869127f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f09f302d4fca4973829a01f187f7588d', 'request_id': 'req-44953dd7-ae3f-4a52-ab36-5ddd869127f9'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:14.689350 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-44953dd7-ae3f-4a52-ab36-5ddd869127f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f09f302d4fca4973829a01f187f7588d', 'request_id': 'req-44953dd7-ae3f-4a52-ab36-5ddd869127f9'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:14.700218 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-44953dd7-ae3f-4a52-ab36-5ddd869127f9 admin admin] The token cache is being invalidate because project f09f302d4fca4973829a01f187f7588d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:14.700499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-44953dd7-ae3f-4a52-ab36-5ddd869127f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:14.701139 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-44953dd7-ae3f-4a52-ab36-5ddd869127f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:14.702793 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 898/1791] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:14 2022] DELETE /identity/v3/projects/f09f302d4fca4973829a01f187f7588d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:14.707090 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019b6a1-70ee-4a16-8255-273deae88f42 service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:14.716746 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019b6a1-70ee-4a16-8255-273deae88f42 service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:14.780678 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e962923-3fbc-42c5-a733-911f150c3dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:14.781605 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e962923-3fbc-42c5-a733-911f150c3dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:14.781949 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e962923-3fbc-42c5-a733-911f150c3dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:14.782245 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e962923-3fbc-42c5-a733-911f150c3dd2 admin admin] PATH_INFO: `/v3/users/3e26f12d728241e6a31858c7b7363d04` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:14.783479 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e962923-3fbc-42c5-a733-911f150c3dd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e26f12d728241e6a31858c7b7363d04)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:14.785459 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e962923-3fbc-42c5-a733-911f150c3dd2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:14.832151 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-6e962923-3fbc-42c5-a733-911f150c3dd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e26f12d728241e6a31858c7b7363d04'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:14.843929 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-6e962923-3fbc-42c5-a733-911f150c3dd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e26f12d728241e6a31858c7b7363d04'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:14.850698 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-6e962923-3fbc-42c5-a733-911f150c3dd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e26f12d728241e6a31858c7b7363d04'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:14.858672 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-6e962923-3fbc-42c5-a733-911f150c3dd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e26f12d728241e6a31858c7b7363d04'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:14.859462 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-6e962923-3fbc-42c5-a733-911f150c3dd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e26f12d728241e6a31858c7b7363d04'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:14.865504 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 894/1792] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:14 2022] DELETE /identity/v3/users/3e26f12d728241e6a31858c7b7363d04 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:15.174840 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44953dd7-ae3f-4a52-ab36-5ddd869127f9 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:15.176516 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-44953dd7-ae3f-4a52-ab36-5ddd869127f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:15.192515 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44953dd7-ae3f-4a52-ab36-5ddd869127f9 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:15.283407 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8638fd3-66fa-4371-871b-ed486aee7b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:15.284382 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8638fd3-66fa-4371-871b-ed486aee7b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:15.284730 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8638fd3-66fa-4371-871b-ed486aee7b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:15.285099 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8638fd3-66fa-4371-871b-ed486aee7b19 admin admin] PATH_INFO: `/v3/projects/e3ae86f1be024a14ae49799f6335c7df` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:15.286364 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8638fd3-66fa-4371-871b-ed486aee7b19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ae86f1be024a14ae49799f6335c7df)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:15.289931 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8638fd3-66fa-4371-871b-ed486aee7b19 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:15.346291 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-c8638fd3-66fa-4371-871b-ed486aee7b19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ae86f1be024a14ae49799f6335c7df', 'request_id': 'req-c8638fd3-66fa-4371-871b-ed486aee7b19'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:15.367302 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-c8638fd3-66fa-4371-871b-ed486aee7b19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ae86f1be024a14ae49799f6335c7df', 'request_id': 'req-c8638fd3-66fa-4371-871b-ed486aee7b19'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:15.382923 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-c8638fd3-66fa-4371-871b-ed486aee7b19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ae86f1be024a14ae49799f6335c7df', 'request_id': 'req-c8638fd3-66fa-4371-871b-ed486aee7b19'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:15.397587 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-c8638fd3-66fa-4371-871b-ed486aee7b19 admin admin] The token cache is being invalidate because project e3ae86f1be024a14ae49799f6335c7df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:15.397880 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-c8638fd3-66fa-4371-871b-ed486aee7b19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:15.399030 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-c8638fd3-66fa-4371-871b-ed486aee7b19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:15.400690 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 899/1793] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:15 2022] DELETE /identity/v3/projects/e3ae86f1be024a14ae49799f6335c7df => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:15.406534 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d6e60-6460-4ff7-b2b5-362a001cb186 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:15.406871 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d6e60-6460-4ff7-b2b5-362a001cb186 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:15.407148 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d6e60-6460-4ff7-b2b5-362a001cb186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:15.427781 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-627d6e60-6460-4ff7-b2b5-362a001cb186 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:15.429169 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-627d6e60-6460-4ff7-b2b5-362a001cb186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:15.518364 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 895/1794] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:15.526891 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1ae0a-6451-42d1-b8cd-3c09e130bd88 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:15.526990 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1ae0a-6451-42d1-b8cd-3c09e130bd88 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:15.527258 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1ae0a-6451-42d1-b8cd-3c09e130bd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:15.556201 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-07d1ae0a-6451-42d1-b8cd-3c09e130bd88 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:15.560018 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-07d1ae0a-6451-42d1-b8cd-3c09e130bd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:15.569769 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 900/1795] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:15.574130 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d6e60-6460-4ff7-b2b5-362a001cb186 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:15.584615 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d6e60-6460-4ff7-b2b5-362a001cb186 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:15.589463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23788875-a254-4623-b300-cead6d4dd36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:15.590303 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23788875-a254-4623-b300-cead6d4dd36e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:15.590585 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23788875-a254-4623-b300-cead6d4dd36e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:15.590857 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23788875-a254-4623-b300-cead6d4dd36e admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:15.591602 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23788875-a254-4623-b300-cead6d4dd36e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:51:15.592099 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23788875-a254-4623-b300-cead6d4dd36e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:15.593837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23788875-a254-4623-b300-cead6d4dd36e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:15.607239 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 896/1796] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:51:15.611820 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1ae0a-6451-42d1-b8cd-3c09e130bd88 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:15.621288 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1ae0a-6451-42d1-b8cd-3c09e130bd88 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:15.625920 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cc795-e4ac-4509-8f71-51497accc9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:15.626581 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cc795-e4ac-4509-8f71-51497accc9b8 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:15.626859 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cc795-e4ac-4509-8f71-51497accc9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:15.627129 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cc795-e4ac-4509-8f71-51497accc9b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:15.627842 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cc795-e4ac-4509-8f71-51497accc9b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:15.629915 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cc795-e4ac-4509-8f71-51497accc9b8 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:15.655375 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 901/1797] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:15 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:51:15.659581 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23788875-a254-4623-b300-cead6d4dd36e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:15.670022 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23788875-a254-4623-b300-cead6d4dd36e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:15.729468 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd7706-084c-47c7-86f3-1dccbff2cb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:15.730127 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd7706-084c-47c7-86f3-1dccbff2cb5a admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:15.730333 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd7706-084c-47c7-86f3-1dccbff2cb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:15.730611 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd7706-084c-47c7-86f3-1dccbff2cb5a admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:15.731332 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd7706-084c-47c7-86f3-1dccbff2cb5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:15.733288 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd7706-084c-47c7-86f3-1dccbff2cb5a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:15.755659 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 897/1798] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:15 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:51:15.759775 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cc795-e4ac-4509-8f71-51497accc9b8 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:15.769883 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cc795-e4ac-4509-8f71-51497accc9b8 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:15.775213 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583ca20-a319-4d34-91ff-5d6b4b97399d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:15.775884 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583ca20-a319-4d34-91ff-5d6b4b97399d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:15.776174 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583ca20-a319-4d34-91ff-5d6b4b97399d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:15.776464 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583ca20-a319-4d34-91ff-5d6b4b97399d admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:15.777252 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583ca20-a319-4d34-91ff-5d6b4b97399d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:15.778821 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583ca20-a319-4d34-91ff-5d6b4b97399d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:15.789766 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 902/1799] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:15.793786 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd7706-084c-47c7-86f3-1dccbff2cb5a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:15.803902 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd7706-084c-47c7-86f3-1dccbff2cb5a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:15.809068 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13491953-0563-4b28-868c-96e01e85b1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:15.809740 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13491953-0563-4b28-868c-96e01e85b1ee admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:15.810022 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13491953-0563-4b28-868c-96e01e85b1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:15.810299 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13491953-0563-4b28-868c-96e01e85b1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:15.811049 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13491953-0563-4b28-868c-96e01e85b1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:15.812648 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13491953-0563-4b28-868c-96e01e85b1ee admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:15.822725 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 898/1800] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:15.826973 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583ca20-a319-4d34-91ff-5d6b4b97399d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:15.838075 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583ca20-a319-4d34-91ff-5d6b4b97399d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:15.845643 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fccb4-6fd7-4be6-8e42-61fa47ed7494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:15.846777 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fccb4-6fd7-4be6-8e42-61fa47ed7494 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:15.847287 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fccb4-6fd7-4be6-8e42-61fa47ed7494 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:15.847595 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fccb4-6fd7-4be6-8e42-61fa47ed7494 admin admin] PATH_INFO: `/v3/projects/7a671927a3224c72889f52af023062f6/users/410014ca6a334d7eb837fdd742e1dd05/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:15.863530 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fccb4-6fd7-4be6-8e42-61fa47ed7494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a671927a3224c72889f52af023062f6, user_id=410014ca6a334d7eb837fdd742e1dd05, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:15.866445 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fccb4-6fd7-4be6-8e42-61fa47ed7494 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:15.879877 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 903/1801] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:15 2022] PUT /identity/v3/projects/7a671927a3224c72889f52af023062f6/users/410014ca6a334d7eb837fdd742e1dd05/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:15.891205 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271d945-47ae-4259-9597-933a87b687ca None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:15.891496 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271d945-47ae-4259-9597-933a87b687ca None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:15.891770 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271d945-47ae-4259-9597-933a87b687ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:15.917720 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b271d945-47ae-4259-9597-933a87b687ca None None] MFA Rules not processed for user `410014ca6a334d7eb837fdd742e1dd05`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:15.918894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b271d945-47ae-4259-9597-933a87b687ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:15.981854 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 899/1802] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:15.986424 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fccb4-6fd7-4be6-8e42-61fa47ed7494 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:16.056215 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fccb4-6fd7-4be6-8e42-61fa47ed7494 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:16.061911 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75db75-b125-4dd2-8263-87fbba054f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:16.062578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75db75-b125-4dd2-8263-87fbba054f88 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:16.062855 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75db75-b125-4dd2-8263-87fbba054f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:16.063146 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75db75-b125-4dd2-8263-87fbba054f88 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:16.063847 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75db75-b125-4dd2-8263-87fbba054f88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:16.065800 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75db75-b125-4dd2-8263-87fbba054f88 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:16.092879 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 904/1803] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:15 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:16.098786 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271d945-47ae-4259-9597-933a87b687ca None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:16.110246 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271d945-47ae-4259-9597-933a87b687ca None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:16.173067 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064987b-d5a2-4bfc-84ca-7a6a63eee416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:16.173971 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064987b-d5a2-4bfc-84ca-7a6a63eee416 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:16.174329 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064987b-d5a2-4bfc-84ca-7a6a63eee416 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:16.174628 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064987b-d5a2-4bfc-84ca-7a6a63eee416 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:16.175675 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064987b-d5a2-4bfc-84ca-7a6a63eee416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:16.178589 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064987b-d5a2-4bfc-84ca-7a6a63eee416 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:16.201928 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 900/1804] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:16 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:51:16.205986 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75db75-b125-4dd2-8263-87fbba054f88 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:16.216504 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75db75-b125-4dd2-8263-87fbba054f88 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:16.222216 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38de1b-00e2-4873-9380-8c769645e932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:16.222915 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38de1b-00e2-4873-9380-8c769645e932 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:16.223200 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38de1b-00e2-4873-9380-8c769645e932 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:16.223471 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38de1b-00e2-4873-9380-8c769645e932 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:16.224241 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38de1b-00e2-4873-9380-8c769645e932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:16.225877 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38de1b-00e2-4873-9380-8c769645e932 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:16.238268 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 905/1805] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:16.243145 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064987b-d5a2-4bfc-84ca-7a6a63eee416 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:16.255038 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064987b-d5a2-4bfc-84ca-7a6a63eee416 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:16.261043 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f2948-c7c7-46de-a339-f2f25dfd26dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:16.261901 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f2948-c7c7-46de-a339-f2f25dfd26dc admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:16.262176 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f2948-c7c7-46de-a339-f2f25dfd26dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:16.262446 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f2948-c7c7-46de-a339-f2f25dfd26dc admin admin] PATH_INFO: `/v3/projects/dc1be22005d8470aaa611863d478b500/users/61f439a6bf9d472ba2f32fa8ef7a67e1/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:16.278696 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f2948-c7c7-46de-a339-f2f25dfd26dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1be22005d8470aaa611863d478b500, user_id=61f439a6bf9d472ba2f32fa8ef7a67e1, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:16.281463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f2948-c7c7-46de-a339-f2f25dfd26dc admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:16.299007 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 901/1806] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:16 2022] PUT /identity/v3/projects/dc1be22005d8470aaa611863d478b500/users/61f439a6bf9d472ba2f32fa8ef7a67e1/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:16.304475 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38de1b-00e2-4873-9380-8c769645e932 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:16.314879 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38de1b-00e2-4873-9380-8c769645e932 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:16.386505 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bb31c-2070-4270-938e-ec4e316f5727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:16.387181 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bb31c-2070-4270-938e-ec4e316f5727 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:16.387462 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bb31c-2070-4270-938e-ec4e316f5727 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:16.387743 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bb31c-2070-4270-938e-ec4e316f5727 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:16.388477 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7bb31c-2070-4270-938e-ec4e316f5727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:16.390107 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7bb31c-2070-4270-938e-ec4e316f5727 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:16.401901 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 906/1807] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:51:16.406388 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f2948-c7c7-46de-a339-f2f25dfd26dc admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:16.418121 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f2948-c7c7-46de-a339-f2f25dfd26dc admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:16.427316 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadddeda-ea7c-4572-8b46-ac8f8cc532de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:16.427316 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadddeda-ea7c-4572-8b46-ac8f8cc532de admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:16.427316 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadddeda-ea7c-4572-8b46-ac8f8cc532de admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:16.427316 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadddeda-ea7c-4572-8b46-ac8f8cc532de admin admin] PATH_INFO: `/v3/projects/dc1be22005d8470aaa611863d478b500/users/61f439a6bf9d472ba2f32fa8ef7a67e1/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:16.429183 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadddeda-ea7c-4572-8b46-ac8f8cc532de admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1be22005d8470aaa611863d478b500, user_id=61f439a6bf9d472ba2f32fa8ef7a67e1, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:16.431905 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadddeda-ea7c-4572-8b46-ac8f8cc532de admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:16.455214 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494c255-53ce-45d9-ab6e-f283b878a157 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:16.455497 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494c255-53ce-45d9-ab6e-f283b878a157 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:16.456144 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494c255-53ce-45d9-ab6e-f283b878a157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:16.464477 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 902/1808] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:16 2022] PUT /identity/v3/projects/dc1be22005d8470aaa611863d478b500/users/61f439a6bf9d472ba2f32fa8ef7a67e1/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:16.504154 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-c494c255-53ce-45d9-ab6e-f283b878a157 None None] MFA Rules not processed for user `61f439a6bf9d472ba2f32fa8ef7a67e1`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:16.505590 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-c494c255-53ce-45d9-ab6e-f283b878a157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:16.604612 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 907/1809] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:16 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:16.616373 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadddeda-ea7c-4572-8b46-ac8f8cc532de admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:16.619298 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-cadddeda-ea7c-4572-8b46-ac8f8cc532de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:16.678727 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadddeda-ea7c-4572-8b46-ac8f8cc532de admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:16.682610 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f04f37-b786-49d3-9367-580a8a8b767e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:16.683255 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f04f37-b786-49d3-9367-580a8a8b767e service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:16.683513 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f04f37-b786-49d3-9367-580a8a8b767e service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:16.683793 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f04f37-b786-49d3-9367-580a8a8b767e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:16.693048 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f04f37-b786-49d3-9367-580a8a8b767e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:16.694956 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f04f37-b786-49d3-9367-580a8a8b767e service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:16.704064 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 903/1810] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:16 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:16.749737 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494c255-53ce-45d9-ab6e-f283b878a157 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:16.758896 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494c255-53ce-45d9-ab6e-f283b878a157 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:16.763827 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a9cf8-837d-4334-8415-f784335446ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:16.764491 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a9cf8-837d-4334-8415-f784335446ba service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:16.764978 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a9cf8-837d-4334-8415-f784335446ba service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:16.765256 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a9cf8-837d-4334-8415-f784335446ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:16.826029 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a9cf8-837d-4334-8415-f784335446ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:16.827484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a9cf8-837d-4334-8415-f784335446ba service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:16.836228 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 908/1811] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:16 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:17.599235 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348153c-3f25-4fe7-97c5-84361502173f None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:17.599701 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348153c-3f25-4fe7-97c5-84361502173f None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:17.599810 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348153c-3f25-4fe7-97c5-84361502173f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:17.619797 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-1348153c-3f25-4fe7-97c5-84361502173f None None] MFA Rules not processed for user `3284aee452cd4b0483a2044d36a3e357`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:17.621497 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-1348153c-3f25-4fe7-97c5-84361502173f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:17.688145 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 904/1812] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:20.112738 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a9cf8-837d-4334-8415-f784335446ba service cinder] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:20.192340 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a9cf8-837d-4334-8415-f784335446ba service cinder] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:20.197836 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f8f79-a462-4886-8883-fb1b30df176a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:20.198722 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f8f79-a462-4886-8883-fb1b30df176a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:20.199009 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f8f79-a462-4886-8883-fb1b30df176a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:20.199439 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f8f79-a462-4886-8883-fb1b30df176a admin admin] PATH_INFO: `/v3/users/410014ca6a334d7eb837fdd742e1dd05` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:20.202003 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f8f79-a462-4886-8883-fb1b30df176a admin admin] RBAC: Authorizing `identity:delete_user(user_id=410014ca6a334d7eb837fdd742e1dd05)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:20.202637 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f8f79-a462-4886-8883-fb1b30df176a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:20.258760 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f75f8f79-a462-4886-8883-fb1b30df176a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '410014ca6a334d7eb837fdd742e1dd05'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:20.259663 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f75f8f79-a462-4886-8883-fb1b30df176a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '410014ca6a334d7eb837fdd742e1dd05'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:20.260025 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f75f8f79-a462-4886-8883-fb1b30df176a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '410014ca6a334d7eb837fdd742e1dd05'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:20.277465 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f75f8f79-a462-4886-8883-fb1b30df176a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '410014ca6a334d7eb837fdd742e1dd05'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:20.284409 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f75f8f79-a462-4886-8883-fb1b30df176a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '410014ca6a334d7eb837fdd742e1dd05'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:20.302480 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 909/1813] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:20 2022] DELETE /identity/v3/users/410014ca6a334d7eb837fdd742e1dd05 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:20.307177 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec174c-ee3e-477d-9f7c-35d4091f8be1 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:20.307977 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec174c-ee3e-477d-9f7c-35d4091f8be1 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:20.308255 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec174c-ee3e-477d-9f7c-35d4091f8be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:20.336923 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-cdec174c-ee3e-477d-9f7c-35d4091f8be1 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:20.338244 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-cdec174c-ee3e-477d-9f7c-35d4091f8be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:20.401552 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 905/1814] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:20.415970 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f8f79-a462-4886-8883-fb1b30df176a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:20.417494 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f75f8f79-a462-4886-8883-fb1b30df176a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:20.478518 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f8f79-a462-4886-8883-fb1b30df176a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:20.482774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c640e-fb60-4afa-b5a4-ea0455575c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:20.483434 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c640e-fb60-4afa-b5a4-ea0455575c85 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:20.483715 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c640e-fb60-4afa-b5a4-ea0455575c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:20.484415 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c640e-fb60-4afa-b5a4-ea0455575c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:20.494853 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c640e-fb60-4afa-b5a4-ea0455575c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:20.496603 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c640e-fb60-4afa-b5a4-ea0455575c85 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:20.507369 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 910/1815] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:20.871706 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec174c-ee3e-477d-9f7c-35d4091f8be1 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:20.873309 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-cdec174c-ee3e-477d-9f7c-35d4091f8be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:20.901103 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec174c-ee3e-477d-9f7c-35d4091f8be1 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:20.907839 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd91f4-de89-4dc3-a158-3a19055192ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:20.908694 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd91f4-de89-4dc3-a158-3a19055192ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:20.909715 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd91f4-de89-4dc3-a158-3a19055192ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:20.909715 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd91f4-de89-4dc3-a158-3a19055192ab admin admin] PATH_INFO: `/v3/projects/7a671927a3224c72889f52af023062f6` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:20.910991 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd91f4-de89-4dc3-a158-3a19055192ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a671927a3224c72889f52af023062f6)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:20.912947 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd91f4-de89-4dc3-a158-3a19055192ab admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:20.980881 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-62cd91f4-de89-4dc3-a158-3a19055192ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a671927a3224c72889f52af023062f6', 'request_id': 'req-62cd91f4-de89-4dc3-a158-3a19055192ab'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:20.988398 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-62cd91f4-de89-4dc3-a158-3a19055192ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a671927a3224c72889f52af023062f6', 'request_id': 'req-62cd91f4-de89-4dc3-a158-3a19055192ab'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:20.999105 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-62cd91f4-de89-4dc3-a158-3a19055192ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a671927a3224c72889f52af023062f6', 'request_id': 'req-62cd91f4-de89-4dc3-a158-3a19055192ab'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.015173 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-62cd91f4-de89-4dc3-a158-3a19055192ab admin admin] The token cache is being invalidate because project 7a671927a3224c72889f52af023062f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:21.015832 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-62cd91f4-de89-4dc3-a158-3a19055192ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.016523 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-62cd91f4-de89-4dc3-a158-3a19055192ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.018400 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 906/1816] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:20 2022] DELETE /identity/v3/projects/7a671927a3224c72889f52af023062f6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:21.022244 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c640e-fb60-4afa-b5a4-ea0455575c85 service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:21.032792 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c640e-fb60-4afa-b5a4-ea0455575c85 service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:21.136217 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de179276-bff6-4728-9625-a3cdb42349fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:21.137152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de179276-bff6-4728-9625-a3cdb42349fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:21.137412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de179276-bff6-4728-9625-a3cdb42349fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:21.137684 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de179276-bff6-4728-9625-a3cdb42349fb admin admin] PATH_INFO: `/v3/users/61f439a6bf9d472ba2f32fa8ef7a67e1` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:21.139512 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de179276-bff6-4728-9625-a3cdb42349fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=61f439a6bf9d472ba2f32fa8ef7a67e1)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:21.141864 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de179276-bff6-4728-9625-a3cdb42349fb admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:21.206337 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-de179276-bff6-4728-9625-a3cdb42349fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61f439a6bf9d472ba2f32fa8ef7a67e1'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.206999 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-de179276-bff6-4728-9625-a3cdb42349fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61f439a6bf9d472ba2f32fa8ef7a67e1'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.207591 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-de179276-bff6-4728-9625-a3cdb42349fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61f439a6bf9d472ba2f32fa8ef7a67e1'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.219215 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd91f4-de89-4dc3-a158-3a19055192ab admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:21.221567 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-62cd91f4-de89-4dc3-a158-3a19055192ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:21.234591 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-de179276-bff6-4728-9625-a3cdb42349fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61f439a6bf9d472ba2f32fa8ef7a67e1'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.243970 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-de179276-bff6-4728-9625-a3cdb42349fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61f439a6bf9d472ba2f32fa8ef7a67e1'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.250291 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd91f4-de89-4dc3-a158-3a19055192ab admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:21.256273 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6af56-79e4-4cee-adcf-00b7040cc3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:21.257260 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6af56-79e4-4cee-adcf-00b7040cc3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:21.257754 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6af56-79e4-4cee-adcf-00b7040cc3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:21.258119 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6af56-79e4-4cee-adcf-00b7040cc3cc admin admin] PATH_INFO: `/v3/users/1408f7946fad4d02932c89a1d1e7967d` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:21.259416 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6af56-79e4-4cee-adcf-00b7040cc3cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1408f7946fad4d02932c89a1d1e7967d)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:21.261474 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6af56-79e4-4cee-adcf-00b7040cc3cc admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:21.274047 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 911/1817] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:21 2022] DELETE /identity/v3/users/61f439a6bf9d472ba2f32fa8ef7a67e1 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:21.332018 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-acf6af56-79e4-4cee-adcf-00b7040cc3cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1408f7946fad4d02932c89a1d1e7967d'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.356439 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-acf6af56-79e4-4cee-adcf-00b7040cc3cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1408f7946fad4d02932c89a1d1e7967d'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.367226 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-acf6af56-79e4-4cee-adcf-00b7040cc3cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1408f7946fad4d02932c89a1d1e7967d'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.376163 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-acf6af56-79e4-4cee-adcf-00b7040cc3cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1408f7946fad4d02932c89a1d1e7967d'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.377273 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-acf6af56-79e4-4cee-adcf-00b7040cc3cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1408f7946fad4d02932c89a1d1e7967d'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.393359 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 907/1818] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:21 2022] DELETE /identity/v3/users/1408f7946fad4d02932c89a1d1e7967d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:21.617674 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de179276-bff6-4728-9625-a3cdb42349fb admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:21.619243 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-de179276-bff6-4728-9625-a3cdb42349fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:21.691082 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de179276-bff6-4728-9625-a3cdb42349fb admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:21.699362 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6af56-79e4-4cee-adcf-00b7040cc3cc admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:21.701278 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-acf6af56-79e4-4cee-adcf-00b7040cc3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:21.760789 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d028d0a-24c9-48d1-a825-b94ec8022809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:21.761708 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d028d0a-24c9-48d1-a825-b94ec8022809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:21.761989 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d028d0a-24c9-48d1-a825-b94ec8022809 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:21.762268 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d028d0a-24c9-48d1-a825-b94ec8022809 admin admin] PATH_INFO: `/v3/projects/2c61bba037fc49bead261e835ebd4b56` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:21.763455 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d028d0a-24c9-48d1-a825-b94ec8022809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c61bba037fc49bead261e835ebd4b56)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:21.765412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d028d0a-24c9-48d1-a825-b94ec8022809 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:21.776285 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6af56-79e4-4cee-adcf-00b7040cc3cc admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:21.780873 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079ada4-4b67-465c-b8b9-ea6da7572569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:21.781825 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079ada4-4b67-465c-b8b9-ea6da7572569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:21.782139 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079ada4-4b67-465c-b8b9-ea6da7572569 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:21.782395 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079ada4-4b67-465c-b8b9-ea6da7572569 admin admin] PATH_INFO: `/v3/projects/dc1be22005d8470aaa611863d478b500` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:21.783639 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079ada4-4b67-465c-b8b9-ea6da7572569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc1be22005d8470aaa611863d478b500)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:21.785634 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079ada4-4b67-465c-b8b9-ea6da7572569 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:21.814346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-7d028d0a-24c9-48d1-a825-b94ec8022809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c61bba037fc49bead261e835ebd4b56', 'request_id': 'req-7d028d0a-24c9-48d1-a825-b94ec8022809'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.821274 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-7d028d0a-24c9-48d1-a825-b94ec8022809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c61bba037fc49bead261e835ebd4b56', 'request_id': 'req-7d028d0a-24c9-48d1-a825-b94ec8022809'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.829820 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-7d028d0a-24c9-48d1-a825-b94ec8022809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c61bba037fc49bead261e835ebd4b56', 'request_id': 'req-7d028d0a-24c9-48d1-a825-b94ec8022809'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.834812 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c079ada4-4b67-465c-b8b9-ea6da7572569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc1be22005d8470aaa611863d478b500', 'request_id': 'req-c079ada4-4b67-465c-b8b9-ea6da7572569'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.841337 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c079ada4-4b67-465c-b8b9-ea6da7572569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc1be22005d8470aaa611863d478b500', 'request_id': 'req-c079ada4-4b67-465c-b8b9-ea6da7572569'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.845167 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-7d028d0a-24c9-48d1-a825-b94ec8022809 admin admin] The token cache is being invalidate because project 2c61bba037fc49bead261e835ebd4b56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:21.845605 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-7d028d0a-24c9-48d1-a825-b94ec8022809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.846412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-7d028d0a-24c9-48d1-a825-b94ec8022809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.847982 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 912/1819] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:21 2022] DELETE /identity/v3/projects/2c61bba037fc49bead261e835ebd4b56 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:21.850262 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c079ada4-4b67-465c-b8b9-ea6da7572569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc1be22005d8470aaa611863d478b500', 'request_id': 'req-c079ada4-4b67-465c-b8b9-ea6da7572569'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.856330 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40148e89-493e-4ef2-87cc-4fb15444659e None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:21.857065 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40148e89-493e-4ef2-87cc-4fb15444659e None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:21.857355 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40148e89-493e-4ef2-87cc-4fb15444659e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:21.861892 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c079ada4-4b67-465c-b8b9-ea6da7572569 admin admin] The token cache is being invalidate because project dc1be22005d8470aaa611863d478b500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:21.862170 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c079ada4-4b67-465c-b8b9-ea6da7572569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.863040 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c079ada4-4b67-465c-b8b9-ea6da7572569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:21.869092 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 908/1820] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:21 2022] DELETE /identity/v3/projects/dc1be22005d8470aaa611863d478b500 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:21.871465 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261b9c9-46e6-4482-91a0-94d11c27ad38 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:21.871465 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261b9c9-46e6-4482-91a0-94d11c27ad38 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:21.871677 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261b9c9-46e6-4482-91a0-94d11c27ad38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:21.889321 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-40148e89-493e-4ef2-87cc-4fb15444659e None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:21.890533 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-40148e89-493e-4ef2-87cc-4fb15444659e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:21.895300 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b261b9c9-46e6-4482-91a0-94d11c27ad38 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:21.896607 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b261b9c9-46e6-4482-91a0-94d11c27ad38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:21.951685 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 913/1821] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:21.962475 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b27d0-6173-42bf-9344-3090435088bc None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:21.962732 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b27d0-6173-42bf-9344-3090435088bc None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:21.962959 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b27d0-6173-42bf-9344-3090435088bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:21.966371 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 909/1822] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:21.975591 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f4f14-f667-4147-a57d-182eed77ea44 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:21.975939 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f4f14-f667-4147-a57d-182eed77ea44 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:21.976232 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f4f14-f667-4147-a57d-182eed77ea44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:21.987177 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-510b27d0-6173-42bf-9344-3090435088bc None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:21.988410 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-510b27d0-6173-42bf-9344-3090435088bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:21.995868 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-9f1f4f14-f667-4147-a57d-182eed77ea44 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:21.997109 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-9f1f4f14-f667-4147-a57d-182eed77ea44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:21.999707 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 914/1823] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:22.000638 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b27d0-6173-42bf-9344-3090435088bc None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:22.008895 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 910/1824] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:22.010483 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f4f14-f667-4147-a57d-182eed77ea44 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:22.010823 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b27d0-6173-42bf-9344-3090435088bc None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:22.015495 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98c56a-690a-4eba-9ac5-46629b65ae1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:22.016805 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98c56a-690a-4eba-9ac5-46629b65ae1b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:22.017116 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98c56a-690a-4eba-9ac5-46629b65ae1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:22.017391 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98c56a-690a-4eba-9ac5-46629b65ae1b admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:22.018128 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98c56a-690a-4eba-9ac5-46629b65ae1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:51:22.018558 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98c56a-690a-4eba-9ac5-46629b65ae1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:22.020172 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98c56a-690a-4eba-9ac5-46629b65ae1b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:22.022886 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f4f14-f667-4147-a57d-182eed77ea44 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:22.028201 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535da9f-5b64-42b4-b1fe-ffb76a7d13fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:22.028948 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535da9f-5b64-42b4-b1fe-ffb76a7d13fb admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:22.029585 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535da9f-5b64-42b4-b1fe-ffb76a7d13fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:22.029585 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535da9f-5b64-42b4-b1fe-ffb76a7d13fb admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:22.030333 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535da9f-5b64-42b4-b1fe-ffb76a7d13fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:51:22.030641 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535da9f-5b64-42b4-b1fe-ffb76a7d13fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:22.032534 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535da9f-5b64-42b4-b1fe-ffb76a7d13fb admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:22.038628 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 915/1825] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:51:22.042773 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98c56a-690a-4eba-9ac5-46629b65ae1b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:22.049184 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 911/1826] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:51:22.052170 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535da9f-5b64-42b4-b1fe-ffb76a7d13fb admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:22.060759 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98c56a-690a-4eba-9ac5-46629b65ae1b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:22.063963 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535da9f-5b64-42b4-b1fe-ffb76a7d13fb admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:22.068830 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c752c-5d8b-4daa-b4cd-be53074b56b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:22.069039 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d642c79-b939-4c03-a363-1a8a66d2150b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:22.069765 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c752c-5d8b-4daa-b4cd-be53074b56b5 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:22.069893 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d642c79-b939-4c03-a363-1a8a66d2150b admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:22.070056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c752c-5d8b-4daa-b4cd-be53074b56b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:22.070783 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c752c-5d8b-4daa-b4cd-be53074b56b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:22.070887 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d642c79-b939-4c03-a363-1a8a66d2150b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:22.070887 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d642c79-b939-4c03-a363-1a8a66d2150b admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:22.071093 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c752c-5d8b-4daa-b4cd-be53074b56b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:22.071348 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d642c79-b939-4c03-a363-1a8a66d2150b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:22.073134 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c752c-5d8b-4daa-b4cd-be53074b56b5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:22.073439 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d642c79-b939-4c03-a363-1a8a66d2150b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:22.107753 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 912/1827] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:22 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:51:22.108238 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 916/1828] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:22 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:22.109310 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d642c79-b939-4c03-a363-1a8a66d2150b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:22.109967 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c752c-5d8b-4daa-b4cd-be53074b56b5 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:22.176746 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c752c-5d8b-4daa-b4cd-be53074b56b5 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:22.186584 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d642c79-b939-4c03-a363-1a8a66d2150b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:22.186843 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47cb2f-c397-43b8-85b7-59e6ea2e9760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:22.187518 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47cb2f-c397-43b8-85b7-59e6ea2e9760 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:22.187914 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47cb2f-c397-43b8-85b7-59e6ea2e9760 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:22.188145 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47cb2f-c397-43b8-85b7-59e6ea2e9760 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:22.188871 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47cb2f-c397-43b8-85b7-59e6ea2e9760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:22.190796 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47cb2f-c397-43b8-85b7-59e6ea2e9760 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:22.191870 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630fbe3-f5a7-4df0-9207-3c273f998e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:22.192608 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630fbe3-f5a7-4df0-9207-3c273f998e4a admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:22.193136 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630fbe3-f5a7-4df0-9207-3c273f998e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:22.193252 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630fbe3-f5a7-4df0-9207-3c273f998e4a admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:22.194075 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630fbe3-f5a7-4df0-9207-3c273f998e4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:22.196904 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630fbe3-f5a7-4df0-9207-3c273f998e4a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:22.218250 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 917/1829] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:22 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:22.221952 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47cb2f-c397-43b8-85b7-59e6ea2e9760 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:22.222392 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 913/1830] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:22 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:22.226612 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630fbe3-f5a7-4df0-9207-3c273f998e4a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:22.232120 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47cb2f-c397-43b8-85b7-59e6ea2e9760 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:22.236957 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98636e7f-6c55-4c73-84f0-1b6d09ebca55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:22.237631 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98636e7f-6c55-4c73-84f0-1b6d09ebca55 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:22.237916 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98636e7f-6c55-4c73-84f0-1b6d09ebca55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:22.238194 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98636e7f-6c55-4c73-84f0-1b6d09ebca55 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:22.238417 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630fbe3-f5a7-4df0-9207-3c273f998e4a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:22.238943 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98636e7f-6c55-4c73-84f0-1b6d09ebca55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:22.240577 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98636e7f-6c55-4c73-84f0-1b6d09ebca55 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:22.243080 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd6371-a8fd-4f90-853f-bbd2972b6f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:22.244248 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd6371-a8fd-4f90-853f-bbd2972b6f2c admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:22.244534 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd6371-a8fd-4f90-853f-bbd2972b6f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:22.244809 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd6371-a8fd-4f90-853f-bbd2972b6f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:22.245587 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd6371-a8fd-4f90-853f-bbd2972b6f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:22.247364 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd6371-a8fd-4f90-853f-bbd2972b6f2c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:22.250892 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 918/1831] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:51:22.257038 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98636e7f-6c55-4c73-84f0-1b6d09ebca55 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:22.262536 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 914/1832] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:22.266701 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd6371-a8fd-4f90-853f-bbd2972b6f2c admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:22.266993 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98636e7f-6c55-4c73-84f0-1b6d09ebca55 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:22.271957 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f5695-c84c-4659-b28f-b7d96274b7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:22.272712 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f5695-c84c-4659-b28f-b7d96274b7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:22.273096 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f5695-c84c-4659-b28f-b7d96274b7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:22.273762 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f5695-c84c-4659-b28f-b7d96274b7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:22.274566 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f5695-c84c-4659-b28f-b7d96274b7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:22.277135 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f5695-c84c-4659-b28f-b7d96274b7e0 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:22.278594 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd6371-a8fd-4f90-853f-bbd2972b6f2c admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:22.285353 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db214e6-8f44-4f22-9c9b-f1474e120ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:22.286219 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db214e6-8f44-4f22-9c9b-f1474e120ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:22.286628 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db214e6-8f44-4f22-9c9b-f1474e120ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:22.287519 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db214e6-8f44-4f22-9c9b-f1474e120ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:22.287948 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db214e6-8f44-4f22-9c9b-f1474e120ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:22.289659 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db214e6-8f44-4f22-9c9b-f1474e120ed2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:22.290681 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 919/1833] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:22.295963 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f5695-c84c-4659-b28f-b7d96274b7e0 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:22.309137 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f5695-c84c-4659-b28f-b7d96274b7e0 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:22.315662 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 915/1834] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:22.316965 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db214e6-8f44-4f22-9c9b-f1474e120ed2 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:22.317082 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605d7d3-41d4-48f5-85ed-ae71e4433a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:22.317900 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605d7d3-41d4-48f5-85ed-ae71e4433a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:22.318182 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605d7d3-41d4-48f5-85ed-ae71e4433a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:22.318460 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605d7d3-41d4-48f5-85ed-ae71e4433a79 admin admin] PATH_INFO: `/v3/projects/03d505080db0418ea8691a31e101c2c0/users/02fdf4be843a4a4da9f023ff17abb63f/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:22.331196 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db214e6-8f44-4f22-9c9b-f1474e120ed2 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:22.338143 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dcbf4-2953-43b4-96b8-2faeac085b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:22.338961 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605d7d3-41d4-48f5-85ed-ae71e4433a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03d505080db0418ea8691a31e101c2c0, user_id=02fdf4be843a4a4da9f023ff17abb63f, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:22.340654 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dcbf4-2953-43b4-96b8-2faeac085b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:22.341758 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605d7d3-41d4-48f5-85ed-ae71e4433a79 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:22.342008 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dcbf4-2953-43b4-96b8-2faeac085b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:22.342292 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dcbf4-2953-43b4-96b8-2faeac085b5f admin admin] PATH_INFO: `/v3/projects/08c1bf0f5a4c4ffca1a7ee8879944380/users/6766ea341daa40dd908dd4d8d8d86d2f/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:22.359752 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dcbf4-2953-43b4-96b8-2faeac085b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c1bf0f5a4c4ffca1a7ee8879944380, user_id=6766ea341daa40dd908dd4d8d8d86d2f, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:22.361424 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 920/1835] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:22 2022] PUT /identity/v3/projects/03d505080db0418ea8691a31e101c2c0/users/02fdf4be843a4a4da9f023ff17abb63f/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:22.362663 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dcbf4-2953-43b4-96b8-2faeac085b5f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:22.370817 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1810f91-8f87-4437-8768-ed8963e9d2e1 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:22.371105 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1810f91-8f87-4437-8768-ed8963e9d2e1 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:22.371554 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1810f91-8f87-4437-8768-ed8963e9d2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:22.379308 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 916/1836] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:22 2022] PUT /identity/v3/projects/08c1bf0f5a4c4ffca1a7ee8879944380/users/6766ea341daa40dd908dd4d8d8d86d2f/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:22.390346 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0ec41-8319-4840-82a3-3e98ed578358 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:22.390718 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0ec41-8319-4840-82a3-3e98ed578358 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:22.391103 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0ec41-8319-4840-82a3-3e98ed578358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:22.400062 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-a1810f91-8f87-4437-8768-ed8963e9d2e1 None None] MFA Rules not processed for user `02fdf4be843a4a4da9f023ff17abb63f`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:22.401474 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a1810f91-8f87-4437-8768-ed8963e9d2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:22.419984 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-4db0ec41-8319-4840-82a3-3e98ed578358 None None] MFA Rules not processed for user `6766ea341daa40dd908dd4d8d8d86d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:22.421499 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-4db0ec41-8319-4840-82a3-3e98ed578358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:22.479338 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 921/1837] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:22.487950 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1810f91-8f87-4437-8768-ed8963e9d2e1 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:22.489878 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a1810f91-8f87-4437-8768-ed8963e9d2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:22.492487 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 917/1838] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:22.496723 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0ec41-8319-4840-82a3-3e98ed578358 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:22.559120 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0ec41-8319-4840-82a3-3e98ed578358 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:22.562575 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1810f91-8f87-4437-8768-ed8963e9d2e1 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:22.564889 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc08c92-6b30-434f-b814-e05e993c1a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:22.565563 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc08c92-6b30-434f-b814-e05e993c1a51 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:22.565846 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc08c92-6b30-434f-b814-e05e993c1a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:22.566125 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc08c92-6b30-434f-b814-e05e993c1a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:22.566838 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc08c92-6b30-434f-b814-e05e993c1a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:22.568201 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c503798-cdad-4895-9a8e-6b1783bcf082 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:22.568778 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc08c92-6b30-434f-b814-e05e993c1a51 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:22.568902 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c503798-cdad-4895-9a8e-6b1783bcf082 service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:22.569151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c503798-cdad-4895-9a8e-6b1783bcf082 service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:22.569428 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c503798-cdad-4895-9a8e-6b1783bcf082 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:22.577349 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c503798-cdad-4895-9a8e-6b1783bcf082 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:22.579359 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c503798-cdad-4895-9a8e-6b1783bcf082 service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:22.589042 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 922/1839] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:51:22.613270 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 918/1840] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:22 2022] POST /identity/v3/projects => generated 391 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:51:22.617368 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c503798-cdad-4895-9a8e-6b1783bcf082 service nova] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:22.632879 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c503798-cdad-4895-9a8e-6b1783bcf082 service nova] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:22.740691 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0dd31-fc44-4365-abe0-ae7a286c5e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:22.741399 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0dd31-fc44-4365-abe0-ae7a286c5e94 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:22.741706 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0dd31-fc44-4365-abe0-ae7a286c5e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:22.741950 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0dd31-fc44-4365-abe0-ae7a286c5e94 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:22.753153 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0dd31-fc44-4365-abe0-ae7a286c5e94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:22.753153 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0dd31-fc44-4365-abe0-ae7a286c5e94 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:22.789359 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 923/1841] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:22 2022] POST /identity/v3/users => generated 302 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:22.790840 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc08c92-6b30-434f-b814-e05e993c1a51 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:22.803097 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc08c92-6b30-434f-b814-e05e993c1a51 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:22.808123 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda0b77-e195-4eee-aeae-cda2410fcd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:22.809251 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda0b77-e195-4eee-aeae-cda2410fcd47 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:22.809706 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda0b77-e195-4eee-aeae-cda2410fcd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:22.809882 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda0b77-e195-4eee-aeae-cda2410fcd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:22.810724 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda0b77-e195-4eee-aeae-cda2410fcd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:22.813241 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda0b77-e195-4eee-aeae-cda2410fcd47 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:22.836111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 919/1842] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:22.840299 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0dd31-fc44-4365-abe0-ae7a286c5e94 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:22.856664 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0dd31-fc44-4365-abe0-ae7a286c5e94 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:22.872377 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97c4d6-d832-453b-a2b9-9e57d12b500b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:22.873271 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97c4d6-d832-453b-a2b9-9e57d12b500b admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:22.873556 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97c4d6-d832-453b-a2b9-9e57d12b500b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:22.873865 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97c4d6-d832-453b-a2b9-9e57d12b500b admin admin] PATH_INFO: `/v3/projects/8258b71ee14c44a7960ef0a612ba8626/users/69b1d4733c0945db993462de4b700bfc/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:22.897096 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97c4d6-d832-453b-a2b9-9e57d12b500b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8258b71ee14c44a7960ef0a612ba8626, user_id=69b1d4733c0945db993462de4b700bfc, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:22.900440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97c4d6-d832-453b-a2b9-9e57d12b500b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:22.931468 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda0b77-e195-4eee-aeae-cda2410fcd47 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:22.932442 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 924/1843] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:22 2022] PUT /identity/v3/projects/8258b71ee14c44a7960ef0a612ba8626/users/69b1d4733c0945db993462de4b700bfc/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:22.942871 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda0b77-e195-4eee-aeae-cda2410fcd47 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:23.010368 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75b7b8-a422-41f0-957b-c0740e970831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:23.011121 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75b7b8-a422-41f0-957b-c0740e970831 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:23.011421 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75b7b8-a422-41f0-957b-c0740e970831 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:23.011708 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75b7b8-a422-41f0-957b-c0740e970831 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:23.012687 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75b7b8-a422-41f0-957b-c0740e970831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:23.014199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75b7b8-a422-41f0-957b-c0740e970831 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:23.029395 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 920/1844] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:23.039626 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97c4d6-d832-453b-a2b9-9e57d12b500b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:23.055656 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97c4d6-d832-453b-a2b9-9e57d12b500b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:23.064895 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f852f84-6c06-4dc0-baff-477f14175eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:23.065899 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f852f84-6c06-4dc0-baff-477f14175eee admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:23.066241 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f852f84-6c06-4dc0-baff-477f14175eee admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:23.066487 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f852f84-6c06-4dc0-baff-477f14175eee admin admin] PATH_INFO: `/v3/projects/8258b71ee14c44a7960ef0a612ba8626/users/69b1d4733c0945db993462de4b700bfc/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:23.069278 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f852f84-6c06-4dc0-baff-477f14175eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8258b71ee14c44a7960ef0a612ba8626, user_id=69b1d4733c0945db993462de4b700bfc, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:23.073701 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f852f84-6c06-4dc0-baff-477f14175eee admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:23.089236 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 925/1845] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:23 2022] PUT /identity/v3/projects/8258b71ee14c44a7960ef0a612ba8626/users/69b1d4733c0945db993462de4b700bfc/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:23.098609 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e3333-894b-4120-ac8c-7775642006ac None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:23.098900 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e3333-894b-4120-ac8c-7775642006ac None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:23.099179 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e3333-894b-4120-ac8c-7775642006ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:23.146482 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b04e3333-894b-4120-ac8c-7775642006ac None None] MFA Rules not processed for user `69b1d4733c0945db993462de4b700bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:23.149247 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b04e3333-894b-4120-ac8c-7775642006ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:23.224899 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 921/1846] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:23.233897 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f852f84-6c06-4dc0-baff-477f14175eee admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:23.236266 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-4f852f84-6c06-4dc0-baff-477f14175eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:23.293664 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f852f84-6c06-4dc0-baff-477f14175eee admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:23.297377 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e11436-9fba-448a-9354-9e38a609e443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:23.297997 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e11436-9fba-448a-9354-9e38a609e443 service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:23.298281 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e11436-9fba-448a-9354-9e38a609e443 service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:23.298557 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e11436-9fba-448a-9354-9e38a609e443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:23.307871 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e11436-9fba-448a-9354-9e38a609e443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:23.309566 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e11436-9fba-448a-9354-9e38a609e443 service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:23.319228 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 926/1847] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:23.365239 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e3333-894b-4120-ac8c-7775642006ac None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:23.366830 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b04e3333-894b-4120-ac8c-7775642006ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:23.379062 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e3333-894b-4120-ac8c-7775642006ac None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:23.383288 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f6467-811b-466e-bd66-6d3d7f5bd926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:23.384046 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f6467-811b-466e-bd66-6d3d7f5bd926 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:23.384316 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f6467-811b-466e-bd66-6d3d7f5bd926 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:23.384610 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f6467-811b-466e-bd66-6d3d7f5bd926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:23.455278 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f6467-811b-466e-bd66-6d3d7f5bd926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:23.456958 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f6467-811b-466e-bd66-6d3d7f5bd926 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:23.469164 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 922/1848] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:24.197193 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e11436-9fba-448a-9354-9e38a609e443 service cinder] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:24.198561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-63e11436-9fba-448a-9354-9e38a609e443 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:24.297241 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e11436-9fba-448a-9354-9e38a609e443 service cinder] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:24.306017 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9a250-27f8-4434-89d8-f779876f6f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:24.307143 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9a250-27f8-4434-89d8-f779876f6f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:24.307493 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9a250-27f8-4434-89d8-f779876f6f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:24.307863 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9a250-27f8-4434-89d8-f779876f6f9c admin admin] PATH_INFO: `/v3/users/db40c36dd09744a5a0f0a4155c871877` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:24.309185 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9a250-27f8-4434-89d8-f779876f6f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=db40c36dd09744a5a0f0a4155c871877)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:24.312057 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9a250-27f8-4434-89d8-f779876f6f9c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:24.365862 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-33e9a250-27f8-4434-89d8-f779876f6f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db40c36dd09744a5a0f0a4155c871877'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:24.366761 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-33e9a250-27f8-4434-89d8-f779876f6f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db40c36dd09744a5a0f0a4155c871877'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:24.367378 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-33e9a250-27f8-4434-89d8-f779876f6f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db40c36dd09744a5a0f0a4155c871877'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:24.380088 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-33e9a250-27f8-4434-89d8-f779876f6f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db40c36dd09744a5a0f0a4155c871877'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:24.387820 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-33e9a250-27f8-4434-89d8-f779876f6f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db40c36dd09744a5a0f0a4155c871877'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:24.416042 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 927/1849] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:24 2022] DELETE /identity/v3/users/db40c36dd09744a5a0f0a4155c871877 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:24.416788 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc6360-ca41-4444-9509-ae552e407b70 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:24.416788 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc6360-ca41-4444-9509-ae552e407b70 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:24.416788 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc6360-ca41-4444-9509-ae552e407b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:24.430649 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-a9fc6360-ca41-4444-9509-ae552e407b70 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:24.431861 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-a9fc6360-ca41-4444-9509-ae552e407b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:24.501523 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 923/1850] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:24.510733 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9a250-27f8-4434-89d8-f779876f6f9c admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:24.512709 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-33e9a250-27f8-4434-89d8-f779876f6f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:24.591961 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9a250-27f8-4434-89d8-f779876f6f9c admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:24.595795 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab9d64-fda1-47a2-9cd1-a98473a39da0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:24.596441 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab9d64-fda1-47a2-9cd1-a98473a39da0 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:24.596724 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab9d64-fda1-47a2-9cd1-a98473a39da0 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:24.597177 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab9d64-fda1-47a2-9cd1-a98473a39da0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:24.608724 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab9d64-fda1-47a2-9cd1-a98473a39da0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:24.610243 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab9d64-fda1-47a2-9cd1-a98473a39da0 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:24.619841 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 928/1851] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:24.886104 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc6360-ca41-4444-9509-ae552e407b70 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:24.887649 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-a9fc6360-ca41-4444-9509-ae552e407b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:24.914413 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc6360-ca41-4444-9509-ae552e407b70 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:24.919688 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a9e0f-9017-44b8-b870-6e5dec42e704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:24.920583 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a9e0f-9017-44b8-b870-6e5dec42e704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:24.920881 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a9e0f-9017-44b8-b870-6e5dec42e704 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:24.921168 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a9e0f-9017-44b8-b870-6e5dec42e704 admin admin] PATH_INFO: `/v3/projects/49da6d91c4704b85978cb2fe20e0f6e5` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:24.922457 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a9e0f-9017-44b8-b870-6e5dec42e704 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49da6d91c4704b85978cb2fe20e0f6e5)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:24.924407 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a9e0f-9017-44b8-b870-6e5dec42e704 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:24.970556 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f38a9e0f-9017-44b8-b870-6e5dec42e704 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49da6d91c4704b85978cb2fe20e0f6e5', 'request_id': 'req-f38a9e0f-9017-44b8-b870-6e5dec42e704'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:24.976579 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f38a9e0f-9017-44b8-b870-6e5dec42e704 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49da6d91c4704b85978cb2fe20e0f6e5', 'request_id': 'req-f38a9e0f-9017-44b8-b870-6e5dec42e704'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:24.985669 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f38a9e0f-9017-44b8-b870-6e5dec42e704 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49da6d91c4704b85978cb2fe20e0f6e5', 'request_id': 'req-f38a9e0f-9017-44b8-b870-6e5dec42e704'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:24.995786 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f38a9e0f-9017-44b8-b870-6e5dec42e704 admin admin] The token cache is being invalidate because project 49da6d91c4704b85978cb2fe20e0f6e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:24.996079 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f38a9e0f-9017-44b8-b870-6e5dec42e704 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:24.996703 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f38a9e0f-9017-44b8-b870-6e5dec42e704 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:24.998306 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 924/1852] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:24 2022] DELETE /identity/v3/projects/49da6d91c4704b85978cb2fe20e0f6e5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:25.002358 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab9d64-fda1-47a2-9cd1-a98473a39da0 service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:25.011671 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab9d64-fda1-47a2-9cd1-a98473a39da0 service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:25.068302 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe4eb0-82b9-4d0b-bbcd-4f10a1b7a0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:25.069439 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe4eb0-82b9-4d0b-bbcd-4f10a1b7a0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:25.069534 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe4eb0-82b9-4d0b-bbcd-4f10a1b7a0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:25.069733 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe4eb0-82b9-4d0b-bbcd-4f10a1b7a0a5 admin admin] PATH_INFO: `/v3/users/7299bd3568ca49b58a5885bdb63718cb` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:25.070943 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe4eb0-82b9-4d0b-bbcd-4f10a1b7a0a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7299bd3568ca49b58a5885bdb63718cb)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:25.072845 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe4eb0-82b9-4d0b-bbcd-4f10a1b7a0a5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:25.121253 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-dffe4eb0-82b9-4d0b-bbcd-4f10a1b7a0a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7299bd3568ca49b58a5885bdb63718cb'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:25.122143 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-dffe4eb0-82b9-4d0b-bbcd-4f10a1b7a0a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7299bd3568ca49b58a5885bdb63718cb'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:25.122841 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-dffe4eb0-82b9-4d0b-bbcd-4f10a1b7a0a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7299bd3568ca49b58a5885bdb63718cb'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:25.134415 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-dffe4eb0-82b9-4d0b-bbcd-4f10a1b7a0a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7299bd3568ca49b58a5885bdb63718cb'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:25.141402 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-dffe4eb0-82b9-4d0b-bbcd-4f10a1b7a0a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7299bd3568ca49b58a5885bdb63718cb'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:25.154865 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 929/1853] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:25 2022] DELETE /identity/v3/users/7299bd3568ca49b58a5885bdb63718cb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:25.483621 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a9e0f-9017-44b8-b870-6e5dec42e704 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:25.485241 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-f38a9e0f-9017-44b8-b870-6e5dec42e704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:25.498539 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a9e0f-9017-44b8-b870-6e5dec42e704 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:25.577068 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49964060-c19a-499f-8c47-8f8b1bc24bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:25.577941 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49964060-c19a-499f-8c47-8f8b1bc24bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:25.578216 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49964060-c19a-499f-8c47-8f8b1bc24bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:25.578549 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49964060-c19a-499f-8c47-8f8b1bc24bc0 admin admin] PATH_INFO: `/v3/projects/145a5f86c4a34f96b571eebc41cdc401` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:25.579750 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49964060-c19a-499f-8c47-8f8b1bc24bc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=145a5f86c4a34f96b571eebc41cdc401)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:25.582048 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49964060-c19a-499f-8c47-8f8b1bc24bc0 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:25.629218 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-49964060-c19a-499f-8c47-8f8b1bc24bc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '145a5f86c4a34f96b571eebc41cdc401', 'request_id': 'req-49964060-c19a-499f-8c47-8f8b1bc24bc0'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:25.635123 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-49964060-c19a-499f-8c47-8f8b1bc24bc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '145a5f86c4a34f96b571eebc41cdc401', 'request_id': 'req-49964060-c19a-499f-8c47-8f8b1bc24bc0'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:25.642297 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-49964060-c19a-499f-8c47-8f8b1bc24bc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '145a5f86c4a34f96b571eebc41cdc401', 'request_id': 'req-49964060-c19a-499f-8c47-8f8b1bc24bc0'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:25.654809 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-49964060-c19a-499f-8c47-8f8b1bc24bc0 admin admin] The token cache is being invalidate because project 145a5f86c4a34f96b571eebc41cdc401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:25.655097 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-49964060-c19a-499f-8c47-8f8b1bc24bc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:25.655733 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-49964060-c19a-499f-8c47-8f8b1bc24bc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:25.657383 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 925/1854] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:25 2022] DELETE /identity/v3/projects/145a5f86c4a34f96b571eebc41cdc401 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:25.663491 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080dcfe-161b-48ab-8c90-07403261b445 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:25.664018 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080dcfe-161b-48ab-8c90-07403261b445 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:25.664118 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080dcfe-161b-48ab-8c90-07403261b445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:25.682212 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-e080dcfe-161b-48ab-8c90-07403261b445 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:25.683397 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-e080dcfe-161b-48ab-8c90-07403261b445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:25.741343 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 930/1855] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:25.748988 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941188b6-f37e-4ae6-8a80-39d22138c5d9 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:25.749278 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941188b6-f37e-4ae6-8a80-39d22138c5d9 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:25.749557 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941188b6-f37e-4ae6-8a80-39d22138c5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:25.768342 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-941188b6-f37e-4ae6-8a80-39d22138c5d9 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:25.769555 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-941188b6-f37e-4ae6-8a80-39d22138c5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:25.777726 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 926/1856] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:25.781930 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080dcfe-161b-48ab-8c90-07403261b445 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:25.795052 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080dcfe-161b-48ab-8c90-07403261b445 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:25.801335 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e70ab7-be34-4dd8-93ac-8038138945bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:25.802030 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e70ab7-be34-4dd8-93ac-8038138945bd admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:25.802280 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e70ab7-be34-4dd8-93ac-8038138945bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:25.802551 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e70ab7-be34-4dd8-93ac-8038138945bd admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:25.803289 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e70ab7-be34-4dd8-93ac-8038138945bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:51:25.803589 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e70ab7-be34-4dd8-93ac-8038138945bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:25.805276 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e70ab7-be34-4dd8-93ac-8038138945bd admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:25.817807 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 931/1857] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:51:25.822703 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941188b6-f37e-4ae6-8a80-39d22138c5d9 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:25.833278 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941188b6-f37e-4ae6-8a80-39d22138c5d9 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:25.839901 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0006b88-ad26-4827-9a35-12c727ff4708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:25.840697 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006b88-ad26-4827-9a35-12c727ff4708 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:25.841052 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006b88-ad26-4827-9a35-12c727ff4708 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:25.841383 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006b88-ad26-4827-9a35-12c727ff4708 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:25.842352 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0006b88-ad26-4827-9a35-12c727ff4708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:25.844493 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0006b88-ad26-4827-9a35-12c727ff4708 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:25.872200 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 927/1858] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:25 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:25.876679 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e70ab7-be34-4dd8-93ac-8038138945bd admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:25.887477 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e70ab7-be34-4dd8-93ac-8038138945bd admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:25.944272 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be307d8e-b9af-4930-89af-2085cf2fb606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:25.944964 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be307d8e-b9af-4930-89af-2085cf2fb606 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:25.945250 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be307d8e-b9af-4930-89af-2085cf2fb606 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:25.945525 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be307d8e-b9af-4930-89af-2085cf2fb606 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:25.946219 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be307d8e-b9af-4930-89af-2085cf2fb606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:25.948135 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be307d8e-b9af-4930-89af-2085cf2fb606 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:25.970901 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 932/1859] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:25 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:25.975160 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0006b88-ad26-4827-9a35-12c727ff4708 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:25.985892 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0006b88-ad26-4827-9a35-12c727ff4708 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:25.992041 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6c268-05af-4994-af78-33008c611ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:25.992699 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6c268-05af-4994-af78-33008c611ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:25.993012 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6c268-05af-4994-af78-33008c611ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:25.993301 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6c268-05af-4994-af78-33008c611ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:25.994020 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6c268-05af-4994-af78-33008c611ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:25.995611 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6c268-05af-4994-af78-33008c611ee8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:26.006249 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 928/1860] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:26.010146 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be307d8e-b9af-4930-89af-2085cf2fb606 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:26.020619 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be307d8e-b9af-4930-89af-2085cf2fb606 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:26.025955 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf33af-117b-4e8b-9ef4-7f7c22ac5b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:26.026610 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf33af-117b-4e8b-9ef4-7f7c22ac5b80 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:26.026892 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf33af-117b-4e8b-9ef4-7f7c22ac5b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:26.027170 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf33af-117b-4e8b-9ef4-7f7c22ac5b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:26.027910 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf33af-117b-4e8b-9ef4-7f7c22ac5b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:26.029552 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf33af-117b-4e8b-9ef4-7f7c22ac5b80 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:26.039651 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 933/1861] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:26.043881 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6c268-05af-4994-af78-33008c611ee8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:26.054098 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6c268-05af-4994-af78-33008c611ee8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:26.059705 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c61a8-8c10-48e5-9667-8a840cfa17dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:26.060604 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c61a8-8c10-48e5-9667-8a840cfa17dc admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:26.060883 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c61a8-8c10-48e5-9667-8a840cfa17dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:26.061181 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c61a8-8c10-48e5-9667-8a840cfa17dc admin admin] PATH_INFO: `/v3/projects/48bbae7ec0a94ff6b2454cbf859d8cd7/users/8c7d4256f1ee4c1e858b8905c98250f5/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:26.076466 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c61a8-8c10-48e5-9667-8a840cfa17dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=48bbae7ec0a94ff6b2454cbf859d8cd7, user_id=8c7d4256f1ee4c1e858b8905c98250f5, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:26.079155 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c61a8-8c10-48e5-9667-8a840cfa17dc admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:26.094856 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 929/1862] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:26 2022] PUT /identity/v3/projects/48bbae7ec0a94ff6b2454cbf859d8cd7/users/8c7d4256f1ee4c1e858b8905c98250f5/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:26.105199 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f45bb-3097-4bd5-9e48-412f1d616bc8 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:26.105477 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f45bb-3097-4bd5-9e48-412f1d616bc8 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:26.105807 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f45bb-3097-4bd5-9e48-412f1d616bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:26.258040 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-842f45bb-3097-4bd5-9e48-412f1d616bc8 None None] MFA Rules not processed for user `8c7d4256f1ee4c1e858b8905c98250f5`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:26.259247 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-842f45bb-3097-4bd5-9e48-412f1d616bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:26.325690 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 934/1863] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:26.330595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c61a8-8c10-48e5-9667-8a840cfa17dc admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:26.393803 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c61a8-8c10-48e5-9667-8a840cfa17dc admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:26.398946 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f2e8d-3653-4c69-8f1d-012718cf5c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:26.399606 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f2e8d-3653-4c69-8f1d-012718cf5c89 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:26.399882 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f2e8d-3653-4c69-8f1d-012718cf5c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:26.400128 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f2e8d-3653-4c69-8f1d-012718cf5c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:26.400827 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f2e8d-3653-4c69-8f1d-012718cf5c89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:26.402772 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f2e8d-3653-4c69-8f1d-012718cf5c89 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:26.431448 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 930/1864] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:26 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:51:26.435561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f45bb-3097-4bd5-9e48-412f1d616bc8 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:26.446183 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f45bb-3097-4bd5-9e48-412f1d616bc8 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:26.499049 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc5bbc-bbdf-491c-a9d9-fb0d4125c6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:26.499699 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc5bbc-bbdf-491c-a9d9-fb0d4125c6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:26.499977 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc5bbc-bbdf-491c-a9d9-fb0d4125c6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:26.500276 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc5bbc-bbdf-491c-a9d9-fb0d4125c6a8 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:26.501003 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc5bbc-bbdf-491c-a9d9-fb0d4125c6a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:26.503017 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc5bbc-bbdf-491c-a9d9-fb0d4125c6a8 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:26.524031 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 935/1865] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:26 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:51:26.528159 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f2e8d-3653-4c69-8f1d-012718cf5c89 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:26.538292 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f2e8d-3653-4c69-8f1d-012718cf5c89 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:26.542873 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b60e29-8990-4603-8311-2b62ff019ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:26.543509 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b60e29-8990-4603-8311-2b62ff019ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:26.543782 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b60e29-8990-4603-8311-2b62ff019ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:26.544052 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b60e29-8990-4603-8311-2b62ff019ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:26.544784 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b60e29-8990-4603-8311-2b62ff019ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:26.546396 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b60e29-8990-4603-8311-2b62ff019ab4 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:26.557068 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 931/1866] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:26.561150 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc5bbc-bbdf-491c-a9d9-fb0d4125c6a8 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:26.570904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc5bbc-bbdf-491c-a9d9-fb0d4125c6a8 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:26.575632 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507aaa5-6ab4-49dd-9857-7e6e3dff0f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:26.576502 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507aaa5-6ab4-49dd-9857-7e6e3dff0f1a admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:26.576776 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507aaa5-6ab4-49dd-9857-7e6e3dff0f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:26.577070 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507aaa5-6ab4-49dd-9857-7e6e3dff0f1a admin admin] PATH_INFO: `/v3/projects/167c0229fc52415db6b188874b9fd61e/users/c031be3c95a8444ca26b87f10121e8b2/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:26.591814 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507aaa5-6ab4-49dd-9857-7e6e3dff0f1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=167c0229fc52415db6b188874b9fd61e, user_id=c031be3c95a8444ca26b87f10121e8b2, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:26.594535 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507aaa5-6ab4-49dd-9857-7e6e3dff0f1a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:26.610418 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 936/1867] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:26 2022] PUT /identity/v3/projects/167c0229fc52415db6b188874b9fd61e/users/c031be3c95a8444ca26b87f10121e8b2/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:26.614363 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b60e29-8990-4603-8311-2b62ff019ab4 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:26.624274 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b60e29-8990-4603-8311-2b62ff019ab4 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:26.678909 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd57dd-8e29-4e31-977b-2b0a4649f7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:26.679576 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd57dd-8e29-4e31-977b-2b0a4649f7cf admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:26.679856 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd57dd-8e29-4e31-977b-2b0a4649f7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:26.680124 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd57dd-8e29-4e31-977b-2b0a4649f7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:26.680883 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd57dd-8e29-4e31-977b-2b0a4649f7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:26.682479 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd57dd-8e29-4e31-977b-2b0a4649f7cf admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:26.691976 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 932/1868] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:26.695949 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507aaa5-6ab4-49dd-9857-7e6e3dff0f1a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:26.706848 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507aaa5-6ab4-49dd-9857-7e6e3dff0f1a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:26.711821 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae3d79-6cd7-49d6-963c-3cd9ec7f6a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:26.712711 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae3d79-6cd7-49d6-963c-3cd9ec7f6a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:26.713023 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae3d79-6cd7-49d6-963c-3cd9ec7f6a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:26.713295 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae3d79-6cd7-49d6-963c-3cd9ec7f6a39 admin admin] PATH_INFO: `/v3/projects/167c0229fc52415db6b188874b9fd61e/users/c031be3c95a8444ca26b87f10121e8b2/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:26.715313 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae3d79-6cd7-49d6-963c-3cd9ec7f6a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=167c0229fc52415db6b188874b9fd61e, user_id=c031be3c95a8444ca26b87f10121e8b2, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:26.717969 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae3d79-6cd7-49d6-963c-3cd9ec7f6a39 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:26.728309 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 937/1869] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:26 2022] PUT /identity/v3/projects/167c0229fc52415db6b188874b9fd61e/users/c031be3c95a8444ca26b87f10121e8b2/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:26.739509 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef01662-7275-4660-9276-5ba4033d43a0 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:26.739797 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef01662-7275-4660-9276-5ba4033d43a0 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:26.740077 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef01662-7275-4660-9276-5ba4033d43a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:26.766755 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-bef01662-7275-4660-9276-5ba4033d43a0 None None] MFA Rules not processed for user `c031be3c95a8444ca26b87f10121e8b2`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:26.767938 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-bef01662-7275-4660-9276-5ba4033d43a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:26.833121 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 933/1870] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:26.843430 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae3d79-6cd7-49d6-963c-3cd9ec7f6a39 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:26.845581 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-bcae3d79-6cd7-49d6-963c-3cd9ec7f6a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:26.902659 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae3d79-6cd7-49d6-963c-3cd9ec7f6a39 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:26.907014 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6acf7-123e-43b3-a2b8-24fc85a440c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:26.907640 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6acf7-123e-43b3-a2b8-24fc85a440c3 service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:26.907918 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6acf7-123e-43b3-a2b8-24fc85a440c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:26.908187 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6acf7-123e-43b3-a2b8-24fc85a440c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:26.917299 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6acf7-123e-43b3-a2b8-24fc85a440c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:26.918714 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6acf7-123e-43b3-a2b8-24fc85a440c3 service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:26.927702 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 938/1871] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:27.201534 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef01662-7275-4660-9276-5ba4033d43a0 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:27.274187 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef01662-7275-4660-9276-5ba4033d43a0 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:27.279598 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2517f42-2ac0-47e8-a876-93ff3fd10277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:27.280468 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2517f42-2ac0-47e8-a876-93ff3fd10277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:27.280757 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2517f42-2ac0-47e8-a876-93ff3fd10277 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:27.281069 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2517f42-2ac0-47e8-a876-93ff3fd10277 admin admin] PATH_INFO: `/v3/users/8c7d4256f1ee4c1e858b8905c98250f5` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:27.282364 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2517f42-2ac0-47e8-a876-93ff3fd10277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c7d4256f1ee4c1e858b8905c98250f5)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:27.284314 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2517f42-2ac0-47e8-a876-93ff3fd10277 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:27.333349 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d2517f42-2ac0-47e8-a876-93ff3fd10277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c7d4256f1ee4c1e858b8905c98250f5'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:27.352199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d2517f42-2ac0-47e8-a876-93ff3fd10277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c7d4256f1ee4c1e858b8905c98250f5'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:27.361756 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d2517f42-2ac0-47e8-a876-93ff3fd10277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c7d4256f1ee4c1e858b8905c98250f5'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:27.372160 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d2517f42-2ac0-47e8-a876-93ff3fd10277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c7d4256f1ee4c1e858b8905c98250f5'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:27.372876 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d2517f42-2ac0-47e8-a876-93ff3fd10277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c7d4256f1ee4c1e858b8905c98250f5'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:27.381551 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 934/1872] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:27 2022] DELETE /identity/v3/users/8c7d4256f1ee4c1e858b8905c98250f5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:27.387503 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f7a1a-211c-4a2b-8fa4-f31269e979ab None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:27.387790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f7a1a-211c-4a2b-8fa4-f31269e979ab None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:27.388070 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f7a1a-211c-4a2b-8fa4-f31269e979ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:27.406886 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-fc2f7a1a-211c-4a2b-8fa4-f31269e979ab None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:27.408103 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-fc2f7a1a-211c-4a2b-8fa4-f31269e979ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:27.466557 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 939/1873] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:27.476415 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2517f42-2ac0-47e8-a876-93ff3fd10277 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:27.477922 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-d2517f42-2ac0-47e8-a876-93ff3fd10277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:27.536771 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2517f42-2ac0-47e8-a876-93ff3fd10277 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:27.541446 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5d7e4-390a-459e-bb67-0408c8939c0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:27.542089 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5d7e4-390a-459e-bb67-0408c8939c0d service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:27.542367 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5d7e4-390a-459e-bb67-0408c8939c0d service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:27.542639 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5d7e4-390a-459e-bb67-0408c8939c0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:27.552886 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5d7e4-390a-459e-bb67-0408c8939c0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:27.554573 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5d7e4-390a-459e-bb67-0408c8939c0d service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:27.564435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 935/1874] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:27.838891 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f7a1a-211c-4a2b-8fa4-f31269e979ab None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:27.840313 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-fc2f7a1a-211c-4a2b-8fa4-f31269e979ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:27.876517 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f7a1a-211c-4a2b-8fa4-f31269e979ab None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:27.882936 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff237e04-80bd-4bc7-9f90-8c6dab52e9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:27.883917 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff237e04-80bd-4bc7-9f90-8c6dab52e9be admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:27.884967 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff237e04-80bd-4bc7-9f90-8c6dab52e9be admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:27.885323 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff237e04-80bd-4bc7-9f90-8c6dab52e9be admin admin] PATH_INFO: `/v3/projects/48bbae7ec0a94ff6b2454cbf859d8cd7` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:27.886706 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff237e04-80bd-4bc7-9f90-8c6dab52e9be admin admin] RBAC: Authorizing `identity:delete_project(project_id=48bbae7ec0a94ff6b2454cbf859d8cd7)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:27.888699 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff237e04-80bd-4bc7-9f90-8c6dab52e9be admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:27.938558 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ff237e04-80bd-4bc7-9f90-8c6dab52e9be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48bbae7ec0a94ff6b2454cbf859d8cd7', 'request_id': 'req-ff237e04-80bd-4bc7-9f90-8c6dab52e9be'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:27.944525 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ff237e04-80bd-4bc7-9f90-8c6dab52e9be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48bbae7ec0a94ff6b2454cbf859d8cd7', 'request_id': 'req-ff237e04-80bd-4bc7-9f90-8c6dab52e9be'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:27.954449 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ff237e04-80bd-4bc7-9f90-8c6dab52e9be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48bbae7ec0a94ff6b2454cbf859d8cd7', 'request_id': 'req-ff237e04-80bd-4bc7-9f90-8c6dab52e9be'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:27.969709 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ff237e04-80bd-4bc7-9f90-8c6dab52e9be admin admin] The token cache is being invalidate because project 48bbae7ec0a94ff6b2454cbf859d8cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:27.970033 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ff237e04-80bd-4bc7-9f90-8c6dab52e9be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:27.970865 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ff237e04-80bd-4bc7-9f90-8c6dab52e9be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:27.975503 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 940/1875] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:27 2022] DELETE /identity/v3/projects/48bbae7ec0a94ff6b2454cbf859d8cd7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:27.976571 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5d7e4-390a-459e-bb67-0408c8939c0d service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:27.995379 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5d7e4-390a-459e-bb67-0408c8939c0d service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:28.044414 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a05e4-e21b-4cb9-92fd-af695a418dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:28.045387 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a05e4-e21b-4cb9-92fd-af695a418dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:28.045731 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a05e4-e21b-4cb9-92fd-af695a418dda admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:28.046066 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a05e4-e21b-4cb9-92fd-af695a418dda admin admin] PATH_INFO: `/v3/users/c031be3c95a8444ca26b87f10121e8b2` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:28.047407 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a05e4-e21b-4cb9-92fd-af695a418dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=c031be3c95a8444ca26b87f10121e8b2)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:28.049435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a05e4-e21b-4cb9-92fd-af695a418dda admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:28.098664 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-af7a05e4-e21b-4cb9-92fd-af695a418dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c031be3c95a8444ca26b87f10121e8b2'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:28.110051 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-af7a05e4-e21b-4cb9-92fd-af695a418dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c031be3c95a8444ca26b87f10121e8b2'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:28.117022 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-af7a05e4-e21b-4cb9-92fd-af695a418dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c031be3c95a8444ca26b87f10121e8b2'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:28.126138 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-af7a05e4-e21b-4cb9-92fd-af695a418dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c031be3c95a8444ca26b87f10121e8b2'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:28.126822 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-af7a05e4-e21b-4cb9-92fd-af695a418dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c031be3c95a8444ca26b87f10121e8b2'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:28.133115 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 936/1876] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:27 2022] DELETE /identity/v3/users/c031be3c95a8444ca26b87f10121e8b2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:28.395168 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff237e04-80bd-4bc7-9f90-8c6dab52e9be admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:28.396972 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-ff237e04-80bd-4bc7-9f90-8c6dab52e9be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:28.412087 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff237e04-80bd-4bc7-9f90-8c6dab52e9be admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:28.472434 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f912fb-cfb4-4364-b13a-d65c35ecf696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:28.473453 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f912fb-cfb4-4364-b13a-d65c35ecf696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:28.473805 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f912fb-cfb4-4364-b13a-d65c35ecf696 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:28.474145 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f912fb-cfb4-4364-b13a-d65c35ecf696 admin admin] PATH_INFO: `/v3/projects/167c0229fc52415db6b188874b9fd61e` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:28.475422 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f912fb-cfb4-4364-b13a-d65c35ecf696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=167c0229fc52415db6b188874b9fd61e)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:28.477501 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f912fb-cfb4-4364-b13a-d65c35ecf696 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:28.528904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-19f912fb-cfb4-4364-b13a-d65c35ecf696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167c0229fc52415db6b188874b9fd61e', 'request_id': 'req-19f912fb-cfb4-4364-b13a-d65c35ecf696'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:28.535441 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-19f912fb-cfb4-4364-b13a-d65c35ecf696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167c0229fc52415db6b188874b9fd61e', 'request_id': 'req-19f912fb-cfb4-4364-b13a-d65c35ecf696'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:28.543130 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-19f912fb-cfb4-4364-b13a-d65c35ecf696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167c0229fc52415db6b188874b9fd61e', 'request_id': 'req-19f912fb-cfb4-4364-b13a-d65c35ecf696'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:28.555465 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-19f912fb-cfb4-4364-b13a-d65c35ecf696 admin admin] The token cache is being invalidate because project 167c0229fc52415db6b188874b9fd61e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:28.555725 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-19f912fb-cfb4-4364-b13a-d65c35ecf696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:28.559077 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-19f912fb-cfb4-4364-b13a-d65c35ecf696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:28.560615 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 941/1877] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:28 2022] DELETE /identity/v3/projects/167c0229fc52415db6b188874b9fd61e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:28.566060 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2ae4d-033f-46de-ad0a-bce0af75cdc4 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:28.566523 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2ae4d-033f-46de-ad0a-bce0af75cdc4 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:28.566611 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2ae4d-033f-46de-ad0a-bce0af75cdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:28.585436 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-aaa2ae4d-033f-46de-ad0a-bce0af75cdc4 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:28.586644 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-aaa2ae4d-033f-46de-ad0a-bce0af75cdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:28.645340 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 937/1878] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:28.653622 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9351d6-d0f7-4ffc-97fe-95830fc5400c None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:28.653911 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9351d6-d0f7-4ffc-97fe-95830fc5400c None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:28.654191 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9351d6-d0f7-4ffc-97fe-95830fc5400c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:28.673053 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-cb9351d6-d0f7-4ffc-97fe-95830fc5400c None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:28.674348 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-cb9351d6-d0f7-4ffc-97fe-95830fc5400c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:28.682944 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 942/1879] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:28.687187 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2ae4d-033f-46de-ad0a-bce0af75cdc4 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:28.696549 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2ae4d-033f-46de-ad0a-bce0af75cdc4 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:28.701282 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790e828-f586-464e-8cbf-6886c3eb95a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:28.701944 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790e828-f586-464e-8cbf-6886c3eb95a5 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:28.702491 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790e828-f586-464e-8cbf-6886c3eb95a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:28.702491 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790e828-f586-464e-8cbf-6886c3eb95a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:28.703322 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790e828-f586-464e-8cbf-6886c3eb95a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:51:28.703641 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790e828-f586-464e-8cbf-6886c3eb95a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:28.705287 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790e828-f586-464e-8cbf-6886c3eb95a5 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:28.719679 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 938/1880] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:51:28.724410 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9351d6-d0f7-4ffc-97fe-95830fc5400c None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:28.734982 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9351d6-d0f7-4ffc-97fe-95830fc5400c None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:28.740388 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe63b41-3ad5-4082-9ef1-d33468d68288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:28.741201 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe63b41-3ad5-4082-9ef1-d33468d68288 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:28.741739 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe63b41-3ad5-4082-9ef1-d33468d68288 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:28.741975 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe63b41-3ad5-4082-9ef1-d33468d68288 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:28.742836 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe63b41-3ad5-4082-9ef1-d33468d68288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:28.745025 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe63b41-3ad5-4082-9ef1-d33468d68288 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:28.772892 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 943/1881] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:28 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:28.776191 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790e828-f586-464e-8cbf-6886c3eb95a5 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:28.787104 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790e828-f586-464e-8cbf-6886c3eb95a5 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:28.857419 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a968a9c-8f8b-41a2-91ac-1ef52e48574f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:28.858150 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a968a9c-8f8b-41a2-91ac-1ef52e48574f admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:28.858430 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a968a9c-8f8b-41a2-91ac-1ef52e48574f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:28.858704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a968a9c-8f8b-41a2-91ac-1ef52e48574f admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:28.859551 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a968a9c-8f8b-41a2-91ac-1ef52e48574f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:28.861642 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a968a9c-8f8b-41a2-91ac-1ef52e48574f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:28.884576 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 939/1882] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:28 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:28.888804 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe63b41-3ad5-4082-9ef1-d33468d68288 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:28.894391 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a968a9c-8f8b-41a2-91ac-1ef52e48574f admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:28.896569 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-4a968a9c-8f8b-41a2-91ac-1ef52e48574f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:28.899656 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe63b41-3ad5-4082-9ef1-d33468d68288 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:28.904311 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abd4b2-ed44-40a0-9622-e6a6b74c77d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:28.905001 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abd4b2-ed44-40a0-9622-e6a6b74c77d2 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:28.905321 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abd4b2-ed44-40a0-9622-e6a6b74c77d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:28.905587 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abd4b2-ed44-40a0-9622-e6a6b74c77d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:28.906303 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abd4b2-ed44-40a0-9622-e6a6b74c77d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:28.907989 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abd4b2-ed44-40a0-9622-e6a6b74c77d2 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:28.909282 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a968a9c-8f8b-41a2-91ac-1ef52e48574f admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:28.916320 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36690b1b-f257-480f-8c37-a432cea97146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:28.917220 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36690b1b-f257-480f-8c37-a432cea97146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:28.917498 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36690b1b-f257-480f-8c37-a432cea97146 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:28.917767 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36690b1b-f257-480f-8c37-a432cea97146 admin admin] PATH_INFO: `/v3/users/6766ea341daa40dd908dd4d8d8d86d2f` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:28.920633 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 944/1883] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:28.920762 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36690b1b-f257-480f-8c37-a432cea97146 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6766ea341daa40dd908dd4d8d8d86d2f)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:28.921109 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36690b1b-f257-480f-8c37-a432cea97146 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:28.922787 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abd4b2-ed44-40a0-9622-e6a6b74c77d2 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:28.932074 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abd4b2-ed44-40a0-9622-e6a6b74c77d2 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:28.938365 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f636354-bb42-4db3-85b2-e05e35065762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:28.939036 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f636354-bb42-4db3-85b2-e05e35065762 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:28.939318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f636354-bb42-4db3-85b2-e05e35065762 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:28.939580 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f636354-bb42-4db3-85b2-e05e35065762 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:28.940312 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f636354-bb42-4db3-85b2-e05e35065762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:28.942486 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f636354-bb42-4db3-85b2-e05e35065762 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:28.953974 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 945/1884] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:51:28.958230 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f636354-bb42-4db3-85b2-e05e35065762 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:28.970937 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f636354-bb42-4db3-85b2-e05e35065762 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:28.976393 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba8672-f63c-419c-a88a-7e3e6861631a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:28.977491 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba8672-f63c-419c-a88a-7e3e6861631a admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:28.977913 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba8672-f63c-419c-a88a-7e3e6861631a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:28.978387 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba8672-f63c-419c-a88a-7e3e6861631a admin admin] PATH_INFO: `/v3/projects/877a14c93b5b44eda43e77e35c5820ee/users/275d7e2b65534a408b1e2e4b9bceab13/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:28.978785 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-36690b1b-f257-480f-8c37-a432cea97146 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6766ea341daa40dd908dd4d8d8d86d2f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:28.993253 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-36690b1b-f257-480f-8c37-a432cea97146 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6766ea341daa40dd908dd4d8d8d86d2f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:29.004355 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-36690b1b-f257-480f-8c37-a432cea97146 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6766ea341daa40dd908dd4d8d8d86d2f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:29.009058 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba8672-f63c-419c-a88a-7e3e6861631a admin admin] RBAC: Authorizing `identity:create_grant(project_id=877a14c93b5b44eda43e77e35c5820ee, user_id=275d7e2b65534a408b1e2e4b9bceab13, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:29.013261 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba8672-f63c-419c-a88a-7e3e6861631a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:29.018356 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-36690b1b-f257-480f-8c37-a432cea97146 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6766ea341daa40dd908dd4d8d8d86d2f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:29.019691 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-36690b1b-f257-480f-8c37-a432cea97146 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6766ea341daa40dd908dd4d8d8d86d2f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:29.030755 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 940/1885] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:28 2022] DELETE /identity/v3/users/6766ea341daa40dd908dd4d8d8d86d2f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:29.037056 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe748640-c907-43fb-b64a-386a7533e28b None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:29.037463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe748640-c907-43fb-b64a-386a7533e28b None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:29.038144 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe748640-c907-43fb-b64a-386a7533e28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:29.041189 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 946/1886] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:28 2022] PUT /identity/v3/projects/877a14c93b5b44eda43e77e35c5820ee/users/275d7e2b65534a408b1e2e4b9bceab13/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:29.051465 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865220a-88e9-4a59-972a-377eb76bfe89 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:29.051873 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865220a-88e9-4a59-972a-377eb76bfe89 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:29.052250 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865220a-88e9-4a59-972a-377eb76bfe89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:29.061256 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-fe748640-c907-43fb-b64a-386a7533e28b None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:29.062507 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-fe748640-c907-43fb-b64a-386a7533e28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:29.106227 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-4865220a-88e9-4a59-972a-377eb76bfe89 None None] MFA Rules not processed for user `275d7e2b65534a408b1e2e4b9bceab13`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:29.107906 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-4865220a-88e9-4a59-972a-377eb76bfe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:29.161248 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 941/1887] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:29.175500 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe748640-c907-43fb-b64a-386a7533e28b None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:29.177173 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-fe748640-c907-43fb-b64a-386a7533e28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:29.212166 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 947/1888] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:29.219898 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865220a-88e9-4a59-972a-377eb76bfe89 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:29.221718 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-4865220a-88e9-4a59-972a-377eb76bfe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:29.259291 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865220a-88e9-4a59-972a-377eb76bfe89 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:29.266745 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc43d54-2015-4637-9d7c-81da27360b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:29.268060 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc43d54-2015-4637-9d7c-81da27360b95 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:29.268437 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc43d54-2015-4637-9d7c-81da27360b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:29.268928 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc43d54-2015-4637-9d7c-81da27360b95 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:29.270197 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc43d54-2015-4637-9d7c-81da27360b95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:29.272459 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc43d54-2015-4637-9d7c-81da27360b95 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:29.279790 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe748640-c907-43fb-b64a-386a7533e28b None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:29.288220 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed615e-1e23-4274-b76e-cdb5c183df6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:29.288899 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed615e-1e23-4274-b76e-cdb5c183df6d service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:29.289228 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed615e-1e23-4274-b76e-cdb5c183df6d service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:29.289506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed615e-1e23-4274-b76e-cdb5c183df6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:29.301681 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed615e-1e23-4274-b76e-cdb5c183df6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:29.305944 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed615e-1e23-4274-b76e-cdb5c183df6d service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:29.317844 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 942/1889] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:51:29.329873 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 948/1890] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:29 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:29.331279 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed615e-1e23-4274-b76e-cdb5c183df6d service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:29.345810 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed615e-1e23-4274-b76e-cdb5c183df6d service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:29.415248 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf82664-603e-4fb6-b960-38978e141c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:29.415872 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf82664-603e-4fb6-b960-38978e141c13 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:29.416157 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf82664-603e-4fb6-b960-38978e141c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:29.416423 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf82664-603e-4fb6-b960-38978e141c13 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:29.417169 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf82664-603e-4fb6-b960-38978e141c13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:29.419082 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf82664-603e-4fb6-b960-38978e141c13 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:29.441595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 943/1891] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:29 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:29.442869 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc43d54-2015-4637-9d7c-81da27360b95 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:29.453990 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc43d54-2015-4637-9d7c-81da27360b95 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:29.458579 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d738ade-0219-4c7c-bb01-3c6df6d25dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:29.459241 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d738ade-0219-4c7c-bb01-3c6df6d25dcd admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:29.459515 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d738ade-0219-4c7c-bb01-3c6df6d25dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:29.459785 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d738ade-0219-4c7c-bb01-3c6df6d25dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:29.460548 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d738ade-0219-4c7c-bb01-3c6df6d25dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:29.462227 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d738ade-0219-4c7c-bb01-3c6df6d25dcd admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:29.473313 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 949/1892] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:29.479606 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf82664-603e-4fb6-b960-38978e141c13 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:29.490856 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf82664-603e-4fb6-b960-38978e141c13 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:29.496160 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06768873-307d-4a10-9c43-ab49cbeb8b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:29.497229 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06768873-307d-4a10-9c43-ab49cbeb8b12 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:29.497648 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06768873-307d-4a10-9c43-ab49cbeb8b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:29.498009 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06768873-307d-4a10-9c43-ab49cbeb8b12 admin admin] PATH_INFO: `/v3/projects/c7a908015fc84ca1b724cd95ac73363f/users/3b940839b801435e93671d817afd1f81/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:29.513378 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06768873-307d-4a10-9c43-ab49cbeb8b12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a908015fc84ca1b724cd95ac73363f, user_id=3b940839b801435e93671d817afd1f81, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:29.516240 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06768873-307d-4a10-9c43-ab49cbeb8b12 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:29.532500 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 944/1893] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:29 2022] PUT /identity/v3/projects/c7a908015fc84ca1b724cd95ac73363f/users/3b940839b801435e93671d817afd1f81/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:29.536449 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d738ade-0219-4c7c-bb01-3c6df6d25dcd admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:29.546335 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d738ade-0219-4c7c-bb01-3c6df6d25dcd admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:29.606728 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06768873-307d-4a10-9c43-ab49cbeb8b12 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:29.607264 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51461132-b5f0-49b3-8f5b-47f1777c648e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:29.607513 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51461132-b5f0-49b3-8f5b-47f1777c648e admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:29.608064 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51461132-b5f0-49b3-8f5b-47f1777c648e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:29.608187 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51461132-b5f0-49b3-8f5b-47f1777c648e admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:29.608484 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-06768873-307d-4a10-9c43-ab49cbeb8b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:29.608881 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51461132-b5f0-49b3-8f5b-47f1777c648e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:29.610802 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51461132-b5f0-49b3-8f5b-47f1777c648e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:29.622308 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 950/1894] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:51:29.626775 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51461132-b5f0-49b3-8f5b-47f1777c648e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:29.632219 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06768873-307d-4a10-9c43-ab49cbeb8b12 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:29.638698 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51461132-b5f0-49b3-8f5b-47f1777c648e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:29.638886 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff0e8c-4071-4cad-a40c-626327c10d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:29.639718 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff0e8c-4071-4cad-a40c-626327c10d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:29.640015 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff0e8c-4071-4cad-a40c-626327c10d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:29.640287 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff0e8c-4071-4cad-a40c-626327c10d9b admin admin] PATH_INFO: `/v3/projects/08c1bf0f5a4c4ffca1a7ee8879944380` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:29.642148 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff0e8c-4071-4cad-a40c-626327c10d9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=08c1bf0f5a4c4ffca1a7ee8879944380)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:29.644012 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b005bc-8b19-45a3-9ef1-edbf1cd31177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:29.644152 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff0e8c-4071-4cad-a40c-626327c10d9b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:29.645380 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b005bc-8b19-45a3-9ef1-edbf1cd31177 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:29.645380 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b005bc-8b19-45a3-9ef1-edbf1cd31177 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:29.645808 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b005bc-8b19-45a3-9ef1-edbf1cd31177 admin admin] PATH_INFO: `/v3/projects/c7a908015fc84ca1b724cd95ac73363f/users/3b940839b801435e93671d817afd1f81/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:29.647914 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b005bc-8b19-45a3-9ef1-edbf1cd31177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a908015fc84ca1b724cd95ac73363f, user_id=3b940839b801435e93671d817afd1f81, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:29.650976 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b005bc-8b19-45a3-9ef1-edbf1cd31177 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:29.661554 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 951/1895] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:29 2022] PUT /identity/v3/projects/c7a908015fc84ca1b724cd95ac73363f/users/3b940839b801435e93671d817afd1f81/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:29.672524 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0e50d-b9a6-4cee-a4ea-a13634c40a69 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:29.672907 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0e50d-b9a6-4cee-a4ea-a13634c40a69 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:29.673259 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0e50d-b9a6-4cee-a4ea-a13634c40a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:29.695296 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-28ff0e8c-4071-4cad-a40c-626327c10d9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c1bf0f5a4c4ffca1a7ee8879944380', 'request_id': 'req-28ff0e8c-4071-4cad-a40c-626327c10d9b'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:29.699621 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-2de0e50d-b9a6-4cee-a4ea-a13634c40a69 None None] MFA Rules not processed for user `3b940839b801435e93671d817afd1f81`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:29.700925 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-2de0e50d-b9a6-4cee-a4ea-a13634c40a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:29.702551 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-28ff0e8c-4071-4cad-a40c-626327c10d9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c1bf0f5a4c4ffca1a7ee8879944380', 'request_id': 'req-28ff0e8c-4071-4cad-a40c-626327c10d9b'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:29.709832 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-28ff0e8c-4071-4cad-a40c-626327c10d9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c1bf0f5a4c4ffca1a7ee8879944380', 'request_id': 'req-28ff0e8c-4071-4cad-a40c-626327c10d9b'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:29.720051 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-28ff0e8c-4071-4cad-a40c-626327c10d9b admin admin] The token cache is being invalidate because project 08c1bf0f5a4c4ffca1a7ee8879944380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:29.720780 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-28ff0e8c-4071-4cad-a40c-626327c10d9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:29.721187 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-28ff0e8c-4071-4cad-a40c-626327c10d9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:29.724095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 945/1896] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:29 2022] DELETE /identity/v3/projects/08c1bf0f5a4c4ffca1a7ee8879944380 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:29.728024 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff0e8c-4071-4cad-a40c-626327c10d9b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:29.729548 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-28ff0e8c-4071-4cad-a40c-626327c10d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:29.772709 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 952/1897] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:29.784329 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0e50d-b9a6-4cee-a4ea-a13634c40a69 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:29.785804 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-2de0e50d-b9a6-4cee-a4ea-a13634c40a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:29.796250 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff0e8c-4071-4cad-a40c-626327c10d9b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:29.801415 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac395e-a38c-4818-9bfe-2e3f178ff4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:29.802309 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac395e-a38c-4818-9bfe-2e3f178ff4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:29.802698 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac395e-a38c-4818-9bfe-2e3f178ff4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:29.802986 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac395e-a38c-4818-9bfe-2e3f178ff4e1 admin admin] PATH_INFO: `/v3/users/69b1d4733c0945db993462de4b700bfc` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:29.804209 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac395e-a38c-4818-9bfe-2e3f178ff4e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69b1d4733c0945db993462de4b700bfc)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:29.806188 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac395e-a38c-4818-9bfe-2e3f178ff4e1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:29.841356 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0e50d-b9a6-4cee-a4ea-a13634c40a69 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:29.845178 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d771f-eeb1-4217-af3e-c62ab691bf95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:29.845834 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d771f-eeb1-4217-af3e-c62ab691bf95 service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:29.846121 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d771f-eeb1-4217-af3e-c62ab691bf95 service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:29.846402 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d771f-eeb1-4217-af3e-c62ab691bf95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:29.855747 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1bac395e-a38c-4818-9bfe-2e3f178ff4e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69b1d4733c0945db993462de4b700bfc'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:29.856000 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d771f-eeb1-4217-af3e-c62ab691bf95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:29.857598 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d771f-eeb1-4217-af3e-c62ab691bf95 service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:29.867036 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1bac395e-a38c-4818-9bfe-2e3f178ff4e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69b1d4733c0945db993462de4b700bfc'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:29.867196 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 953/1898] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:51:29.868024 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d771f-eeb1-4217-af3e-c62ab691bf95 service cinder] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:29.869399 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-7b1d771f-eeb1-4217-af3e-c62ab691bf95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:29.873717 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1bac395e-a38c-4818-9bfe-2e3f178ff4e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69b1d4733c0945db993462de4b700bfc'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:29.882680 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d771f-eeb1-4217-af3e-c62ab691bf95 service cinder] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:29.886137 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1bac395e-a38c-4818-9bfe-2e3f178ff4e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69b1d4733c0945db993462de4b700bfc'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:29.886913 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1bac395e-a38c-4818-9bfe-2e3f178ff4e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69b1d4733c0945db993462de4b700bfc'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:29.888714 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752a337-b0bd-47b1-b405-71eefe6f5899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:29.889650 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752a337-b0bd-47b1-b405-71eefe6f5899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:29.890173 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752a337-b0bd-47b1-b405-71eefe6f5899 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:29.890173 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752a337-b0bd-47b1-b405-71eefe6f5899 admin admin] PATH_INFO: `/v3/users/4258db085b7049aaa4d94ed99e3eb973` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:29.891404 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752a337-b0bd-47b1-b405-71eefe6f5899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4258db085b7049aaa4d94ed99e3eb973)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:29.893349 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752a337-b0bd-47b1-b405-71eefe6f5899 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:29.897077 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 946/1899] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:29 2022] DELETE /identity/v3/users/69b1d4733c0945db993462de4b700bfc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:29.955160 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-0752a337-b0bd-47b1-b405-71eefe6f5899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4258db085b7049aaa4d94ed99e3eb973'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:29.956063 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-0752a337-b0bd-47b1-b405-71eefe6f5899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4258db085b7049aaa4d94ed99e3eb973'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:29.957142 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-0752a337-b0bd-47b1-b405-71eefe6f5899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4258db085b7049aaa4d94ed99e3eb973'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:29.971567 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-0752a337-b0bd-47b1-b405-71eefe6f5899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4258db085b7049aaa4d94ed99e3eb973'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:29.980367 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-0752a337-b0bd-47b1-b405-71eefe6f5899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4258db085b7049aaa4d94ed99e3eb973'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:29.994701 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 954/1900] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:29 2022] DELETE /identity/v3/users/4258db085b7049aaa4d94ed99e3eb973 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:30.003683 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2474f3a-eb0c-414f-b69c-1cb7d458be2f None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:30.003683 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2474f3a-eb0c-414f-b69c-1cb7d458be2f None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:30.003683 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2474f3a-eb0c-414f-b69c-1cb7d458be2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:30.020939 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-a2474f3a-eb0c-414f-b69c-1cb7d458be2f None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:30.022161 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-a2474f3a-eb0c-414f-b69c-1cb7d458be2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:30.086957 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 947/1901] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:30.096679 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752a337-b0bd-47b1-b405-71eefe6f5899 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:30.098277 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-0752a337-b0bd-47b1-b405-71eefe6f5899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:30.162230 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752a337-b0bd-47b1-b405-71eefe6f5899 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:30.166349 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2571b1-bb91-4cdc-9b0d-b2851f9b28ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:30.167004 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2571b1-bb91-4cdc-9b0d-b2851f9b28ca service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:30.167313 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2571b1-bb91-4cdc-9b0d-b2851f9b28ca service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:30.167609 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2571b1-bb91-4cdc-9b0d-b2851f9b28ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:30.177329 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2571b1-bb91-4cdc-9b0d-b2851f9b28ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:30.178758 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2571b1-bb91-4cdc-9b0d-b2851f9b28ca service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:30.188723 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 955/1902] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:30.215493 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2474f3a-eb0c-414f-b69c-1cb7d458be2f None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:30.217674 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-a2474f3a-eb0c-414f-b69c-1cb7d458be2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:30.233742 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2571b1-bb91-4cdc-9b0d-b2851f9b28ca service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:30.235436 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-fe2571b1-bb91-4cdc-9b0d-b2851f9b28ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:30.241721 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2474f3a-eb0c-414f-b69c-1cb7d458be2f None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:30.286656 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd698d-d9d5-42e8-9030-487fe42b4566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:30.287563 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd698d-d9d5-42e8-9030-487fe42b4566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:30.288462 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd698d-d9d5-42e8-9030-487fe42b4566 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:30.288462 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd698d-d9d5-42e8-9030-487fe42b4566 admin admin] PATH_INFO: `/v3/projects/8258b71ee14c44a7960ef0a612ba8626` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:30.290084 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd698d-d9d5-42e8-9030-487fe42b4566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8258b71ee14c44a7960ef0a612ba8626)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:30.292009 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd698d-d9d5-42e8-9030-487fe42b4566 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:30.347868 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2571b1-bb91-4cdc-9b0d-b2851f9b28ca service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:30.351913 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4bcd698d-d9d5-42e8-9030-487fe42b4566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8258b71ee14c44a7960ef0a612ba8626', 'request_id': 'req-4bcd698d-d9d5-42e8-9030-487fe42b4566'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:30.359935 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4bcd698d-d9d5-42e8-9030-487fe42b4566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8258b71ee14c44a7960ef0a612ba8626', 'request_id': 'req-4bcd698d-d9d5-42e8-9030-487fe42b4566'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:30.372575 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4bcd698d-d9d5-42e8-9030-487fe42b4566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8258b71ee14c44a7960ef0a612ba8626', 'request_id': 'req-4bcd698d-d9d5-42e8-9030-487fe42b4566'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:30.387009 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4bcd698d-d9d5-42e8-9030-487fe42b4566 admin admin] The token cache is being invalidate because project 8258b71ee14c44a7960ef0a612ba8626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:30.387647 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4bcd698d-d9d5-42e8-9030-487fe42b4566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:30.388427 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4bcd698d-d9d5-42e8-9030-487fe42b4566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:30.390292 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 948/1903] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:30 2022] DELETE /identity/v3/projects/8258b71ee14c44a7960ef0a612ba8626 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:30.398722 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebade8-00b0-4959-9dcc-2b95c1f02af3 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:30.399141 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebade8-00b0-4959-9dcc-2b95c1f02af3 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:30.399496 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebade8-00b0-4959-9dcc-2b95c1f02af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:30.423638 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efebf43-a151-4562-84f6-d2158e517ea5 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b940839b801435e93671d817afd1f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a908015fc84ca1b724cd95ac73363f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:30.424422 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efebf43-a151-4562-84f6-d2158e517ea5 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:30.424783 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efebf43-a151-4562-84f6-d2158e517ea5 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:30.425228 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efebf43-a151-4562-84f6-d2158e517ea5 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:30.426261 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efebf43-a151-4562-84f6-d2158e517ea5 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:51:30.427059 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efebf43-a151-4562-84f6-d2158e517ea5 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:30.428613 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efebf43-a151-4562-84f6-d2158e517ea5 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:30.450547 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b9ebade8-00b0-4959-9dcc-2b95c1f02af3 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:30.450547 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b9ebade8-00b0-4959-9dcc-2b95c1f02af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:30.451953 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 956/1904] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:51:30.453383 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efebf43-a151-4562-84f6-d2158e517ea5 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:30.455132 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-5efebf43-a151-4562-84f6-d2158e517ea5 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:30.469716 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efebf43-a151-4562-84f6-d2158e517ea5 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:30.484113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4126e2-446b-4e8c-8159-a8f2dc23c35e tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b940839b801435e93671d817afd1f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a908015fc84ca1b724cd95ac73363f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:30.484113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4126e2-446b-4e8c-8159-a8f2dc23c35e tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:30.484113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4126e2-446b-4e8c-8159-a8f2dc23c35e tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:30.484358 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4126e2-446b-4e8c-8159-a8f2dc23c35e tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:30.486062 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4126e2-446b-4e8c-8159-a8f2dc23c35e tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:30.487993 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4126e2-446b-4e8c-8159-a8f2dc23c35e tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:30.561812 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 949/1905] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:30.563315 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 957/1906] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:30 2022] POST /identity/v3/projects => generated 353 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:30.563747 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc629b-cdd5-42bb-845b-b00b5c192ecd None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:30.563986 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc629b-cdd5-42bb-845b-b00b5c192ecd None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:30.564309 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc629b-cdd5-42bb-845b-b00b5c192ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:30.567377 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4126e2-446b-4e8c-8159-a8f2dc23c35e tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:30.591908 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-aedc629b-cdd5-42bb-845b-b00b5c192ecd None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:30.595150 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-aedc629b-cdd5-42bb-845b-b00b5c192ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:30.650994 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4126e2-446b-4e8c-8159-a8f2dc23c35e tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:30.661621 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155dce6-7e3e-41ce-8354-26c3b33f9392 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b940839b801435e93671d817afd1f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a908015fc84ca1b724cd95ac73363f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:30.664434 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155dce6-7e3e-41ce-8354-26c3b33f9392 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:30.665004 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155dce6-7e3e-41ce-8354-26c3b33f9392 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:30.665620 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155dce6-7e3e-41ce-8354-26c3b33f9392 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:30.667504 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155dce6-7e3e-41ce-8354-26c3b33f9392 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:51:30.668398 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155dce6-7e3e-41ce-8354-26c3b33f9392 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:30.671829 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155dce6-7e3e-41ce-8354-26c3b33f9392 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:30.681362 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 950/1907] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:30.682992 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc629b-cdd5-42bb-845b-b00b5c192ecd None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:30.684923 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-aedc629b-cdd5-42bb-845b-b00b5c192ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:30.698349 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 958/1908] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:51:30.699336 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155dce6-7e3e-41ce-8354-26c3b33f9392 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:30.699814 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc629b-cdd5-42bb-845b-b00b5c192ecd None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:30.708199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac9111-b337-4afe-b1a7-287b82ef32ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:30.708199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac9111-b337-4afe-b1a7-287b82ef32ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:30.708199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac9111-b337-4afe-b1a7-287b82ef32ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:30.708199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac9111-b337-4afe-b1a7-287b82ef32ed admin admin] PATH_INFO: `/v3/users/02fdf4be843a4a4da9f023ff17abb63f` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:30.708731 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac9111-b337-4afe-b1a7-287b82ef32ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=02fdf4be843a4a4da9f023ff17abb63f)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:30.710973 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac9111-b337-4afe-b1a7-287b82ef32ed admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:30.738060 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155dce6-7e3e-41ce-8354-26c3b33f9392 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:30.748910 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc3904-9748-43f4-bfe9-bcab127c967c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:30.749796 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc3904-9748-43f4-bfe9-bcab127c967c admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:30.750185 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc3904-9748-43f4-bfe9-bcab127c967c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:30.750454 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc3904-9748-43f4-bfe9-bcab127c967c admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:30.751192 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc3904-9748-43f4-bfe9-bcab127c967c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:51:30.751496 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc3904-9748-43f4-bfe9-bcab127c967c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:30.753110 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc3904-9748-43f4-bfe9-bcab127c967c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:30.766722 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 959/1909] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:51:30.770832 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc3904-9748-43f4-bfe9-bcab127c967c admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:30.771676 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-b7ac9111-b337-4afe-b1a7-287b82ef32ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02fdf4be843a4a4da9f023ff17abb63f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:30.772507 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-7dfc3904-9748-43f4-bfe9-bcab127c967c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:30.783016 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-b7ac9111-b337-4afe-b1a7-287b82ef32ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02fdf4be843a4a4da9f023ff17abb63f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:30.784980 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc3904-9748-43f4-bfe9-bcab127c967c admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:30.789383 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-b7ac9111-b337-4afe-b1a7-287b82ef32ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02fdf4be843a4a4da9f023ff17abb63f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:30.789497 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715e4c6-a9ab-40f2-8efe-b0015c401162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:30.790289 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715e4c6-a9ab-40f2-8efe-b0015c401162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:30.790566 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715e4c6-a9ab-40f2-8efe-b0015c401162 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:30.790835 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715e4c6-a9ab-40f2-8efe-b0015c401162 admin admin] PATH_INFO: `/v3/projects/e5ef1868a7ef40faaad07b4cb60e6d1b` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:30.792212 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715e4c6-a9ab-40f2-8efe-b0015c401162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5ef1868a7ef40faaad07b4cb60e6d1b)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:30.794124 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715e4c6-a9ab-40f2-8efe-b0015c401162 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:30.799264 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-b7ac9111-b337-4afe-b1a7-287b82ef32ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02fdf4be843a4a4da9f023ff17abb63f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:30.799983 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-b7ac9111-b337-4afe-b1a7-287b82ef32ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02fdf4be843a4a4da9f023ff17abb63f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:30.806251 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 951/1910] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:30 2022] DELETE /identity/v3/users/02fdf4be843a4a4da9f023ff17abb63f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:30.807380 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac9111-b337-4afe-b1a7-287b82ef32ed admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:30.808758 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b7ac9111-b337-4afe-b1a7-287b82ef32ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:30.840404 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b715e4c6-a9ab-40f2-8efe-b0015c401162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5ef1868a7ef40faaad07b4cb60e6d1b', 'request_id': 'req-b715e4c6-a9ab-40f2-8efe-b0015c401162'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:30.846164 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b715e4c6-a9ab-40f2-8efe-b0015c401162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5ef1868a7ef40faaad07b4cb60e6d1b', 'request_id': 'req-b715e4c6-a9ab-40f2-8efe-b0015c401162'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:30.854208 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b715e4c6-a9ab-40f2-8efe-b0015c401162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5ef1868a7ef40faaad07b4cb60e6d1b', 'request_id': 'req-b715e4c6-a9ab-40f2-8efe-b0015c401162'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:30.866462 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b715e4c6-a9ab-40f2-8efe-b0015c401162 admin admin] The token cache is being invalidate because project e5ef1868a7ef40faaad07b4cb60e6d1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:30.866748 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b715e4c6-a9ab-40f2-8efe-b0015c401162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:30.867369 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b715e4c6-a9ab-40f2-8efe-b0015c401162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:30.869116 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 960/1911] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:30 2022] DELETE /identity/v3/projects/e5ef1868a7ef40faaad07b4cb60e6d1b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:30.869840 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715e4c6-a9ab-40f2-8efe-b0015c401162 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:30.871090 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b715e4c6-a9ab-40f2-8efe-b0015c401162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:30.878562 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac9111-b337-4afe-b1a7-287b82ef32ed admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:30.931852 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5e507-13bc-4370-a334-c0147ec23098 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b940839b801435e93671d817afd1f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7a908015fc84ca1b724cd95ac73363f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:30.932712 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5e507-13bc-4370-a334-c0147ec23098 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:30.933031 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5e507-13bc-4370-a334-c0147ec23098 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:30.933328 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5e507-13bc-4370-a334-c0147ec23098 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] PATH_INFO: `/v3/projects/09c82e35ea9b4e74842681ef93be4399` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:30.933914 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715e4c6-a9ab-40f2-8efe-b0015c401162 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:30.934480 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5e507-13bc-4370-a334-c0147ec23098 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] RBAC: Authorizing `identity:delete_project(project_id=09c82e35ea9b4e74842681ef93be4399)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:30.936364 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5e507-13bc-4370-a334-c0147ec23098 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:30.939210 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a6750-49c9-4c78-9e58-2ef84328f366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:30.939858 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a6750-49c9-4c78-9e58-2ef84328f366 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:30.940160 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a6750-49c9-4c78-9e58-2ef84328f366 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:30.940420 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a6750-49c9-4c78-9e58-2ef84328f366 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:30.941135 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a6750-49c9-4c78-9e58-2ef84328f366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:30.943017 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a6750-49c9-4c78-9e58-2ef84328f366 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:30.973578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 961/1912] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:30 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:30.973578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27c719-f54f-4b75-b759-57e2ce96b68c None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:30.973578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27c719-f54f-4b75-b759-57e2ce96b68c None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:30.973578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27c719-f54f-4b75-b759-57e2ce96b68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:30.980373 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d1f5e507-13bc-4370-a334-c0147ec23098 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09c82e35ea9b4e74842681ef93be4399', 'request_id': 'req-d1f5e507-13bc-4370-a334-c0147ec23098'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:30.989962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d1f5e507-13bc-4370-a334-c0147ec23098 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09c82e35ea9b4e74842681ef93be4399', 'request_id': 'req-d1f5e507-13bc-4370-a334-c0147ec23098'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:30.996659 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-3d27c719-f54f-4b75-b759-57e2ce96b68c None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:30.998729 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-3d27c719-f54f-4b75-b759-57e2ce96b68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:31.000824 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d1f5e507-13bc-4370-a334-c0147ec23098 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09c82e35ea9b4e74842681ef93be4399', 'request_id': 'req-d1f5e507-13bc-4370-a334-c0147ec23098'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:31.013813 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d1f5e507-13bc-4370-a334-c0147ec23098 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] The token cache is being invalidate because project 09c82e35ea9b4e74842681ef93be4399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:31.014431 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d1f5e507-13bc-4370-a334-c0147ec23098 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:31.016240 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d1f5e507-13bc-4370-a334-c0147ec23098 tempest-VolumeQuotaClassesTest-929447828 tempest-VolumeQuotaClassesTest-929447828-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:31.018622 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 952/1913] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:30 2022] DELETE /identity/v3/projects/09c82e35ea9b4e74842681ef93be4399 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:31.019970 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34de56-909e-412a-a070-7deda2ec2662 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:31.020470 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34de56-909e-412a-a070-7deda2ec2662 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:31.021487 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34de56-909e-412a-a070-7deda2ec2662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:31.044307 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-ec34de56-909e-412a-a070-7deda2ec2662 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:31.045667 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-ec34de56-909e-412a-a070-7deda2ec2662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:31.077846 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 962/1914] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:31.088895 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27c719-f54f-4b75-b759-57e2ce96b68c None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:31.090532 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-3d27c719-f54f-4b75-b759-57e2ce96b68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:31.111540 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 953/1915] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:31.116203 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27c719-f54f-4b75-b759-57e2ce96b68c None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:31.119407 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34de56-909e-412a-a070-7deda2ec2662 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:31.120922 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-ec34de56-909e-412a-a070-7deda2ec2662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:31.128351 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dae199-77e7-416e-aa28-40472c9a0b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:31.129356 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dae199-77e7-416e-aa28-40472c9a0b57 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:31.129656 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dae199-77e7-416e-aa28-40472c9a0b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:31.130200 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dae199-77e7-416e-aa28-40472c9a0b57 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:31.130812 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dae199-77e7-416e-aa28-40472c9a0b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:31.133376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dae199-77e7-416e-aa28-40472c9a0b57 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:31.163442 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 963/1916] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:31 2022] POST /identity/v3/users => generated 293 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:31.163442 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c9fed-e064-475b-b0bb-fa0116cb66e2 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:31.163442 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c9fed-e064-475b-b0bb-fa0116cb66e2 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:31.163442 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c9fed-e064-475b-b0bb-fa0116cb66e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:31.181731 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-c10c9fed-e064-475b-b0bb-fa0116cb66e2 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:31.182962 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-c10c9fed-e064-475b-b0bb-fa0116cb66e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:31.199658 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34de56-909e-412a-a070-7deda2ec2662 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:31.202553 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 964/1917] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:31.203437 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c9fed-e064-475b-b0bb-fa0116cb66e2 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:31.203745 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fd257-1d03-40ed-83e4-06a3c587bedf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:31.204463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fd257-1d03-40ed-83e4-06a3c587bedf service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:31.204812 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fd257-1d03-40ed-83e4-06a3c587bedf service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:31.205373 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fd257-1d03-40ed-83e4-06a3c587bedf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:31.213775 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c9fed-e064-475b-b0bb-fa0116cb66e2 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:31.214903 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fd257-1d03-40ed-83e4-06a3c587bedf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:31.216336 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fd257-1d03-40ed-83e4-06a3c587bedf service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:31.219229 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742e415-93a5-41fe-9334-f25b359cc056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:31.219749 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742e415-93a5-41fe-9334-f25b359cc056 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:31.223200 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742e415-93a5-41fe-9334-f25b359cc056 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:31.223592 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742e415-93a5-41fe-9334-f25b359cc056 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:31.224448 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742e415-93a5-41fe-9334-f25b359cc056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:31.226224 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742e415-93a5-41fe-9334-f25b359cc056 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:31.228656 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 954/1918] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:31.229487 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fd257-1d03-40ed-83e4-06a3c587bedf service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:31.239804 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fd257-1d03-40ed-83e4-06a3c587bedf service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:31.245378 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a9f42-46a3-4aff-8d17-175889cf9bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:31.246380 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a9f42-46a3-4aff-8d17-175889cf9bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:31.246531 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a9f42-46a3-4aff-8d17-175889cf9bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:31.246875 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a9f42-46a3-4aff-8d17-175889cf9bd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:31.247615 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a9f42-46a3-4aff-8d17-175889cf9bd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:51:31.248027 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a9f42-46a3-4aff-8d17-175889cf9bd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:31.249669 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a9f42-46a3-4aff-8d17-175889cf9bd0 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:31.254475 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 965/1919] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:31.259693 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742e415-93a5-41fe-9334-f25b359cc056 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:31.263017 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 955/1920] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:51:31.270416 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a9f42-46a3-4aff-8d17-175889cf9bd0 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:31.273959 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742e415-93a5-41fe-9334-f25b359cc056 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:31.279092 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03300571-ae71-4f29-8f99-30a162333c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:31.280114 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03300571-ae71-4f29-8f99-30a162333c43 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:31.280521 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03300571-ae71-4f29-8f99-30a162333c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:31.281089 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a9f42-46a3-4aff-8d17-175889cf9bd0 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:31.281221 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03300571-ae71-4f29-8f99-30a162333c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:31.281896 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03300571-ae71-4f29-8f99-30a162333c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:31.283498 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03300571-ae71-4f29-8f99-30a162333c43 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:31.285632 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fb661-9a29-4a9e-85f1-5b2f58fbadef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:31.286281 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fb661-9a29-4a9e-85f1-5b2f58fbadef admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:31.286558 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fb661-9a29-4a9e-85f1-5b2f58fbadef admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:31.286826 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fb661-9a29-4a9e-85f1-5b2f58fbadef admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:31.287549 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971fb661-9a29-4a9e-85f1-5b2f58fbadef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:31.289450 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971fb661-9a29-4a9e-85f1-5b2f58fbadef admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:31.298674 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 966/1921] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:31.299824 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03300571-ae71-4f29-8f99-30a162333c43 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:31.302015 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-03300571-ae71-4f29-8f99-30a162333c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:31.315604 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03300571-ae71-4f29-8f99-30a162333c43 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:31.318598 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 956/1922] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:31 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:31.319674 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fb661-9a29-4a9e-85f1-5b2f58fbadef admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:31.320181 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6718762-9a9c-46bc-9650-1bd76f3887c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:31.321520 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6718762-9a9c-46bc-9650-1bd76f3887c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:31.321810 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6718762-9a9c-46bc-9650-1bd76f3887c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:31.322081 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6718762-9a9c-46bc-9650-1bd76f3887c5 admin admin] PATH_INFO: `/v3/users/275d7e2b65534a408b1e2e4b9bceab13` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:31.323358 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6718762-9a9c-46bc-9650-1bd76f3887c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=275d7e2b65534a408b1e2e4b9bceab13)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:31.325255 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6718762-9a9c-46bc-9650-1bd76f3887c5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:31.373420 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a6718762-9a9c-46bc-9650-1bd76f3887c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275d7e2b65534a408b1e2e4b9bceab13'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:31.374105 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a6718762-9a9c-46bc-9650-1bd76f3887c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275d7e2b65534a408b1e2e4b9bceab13'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:31.374714 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a6718762-9a9c-46bc-9650-1bd76f3887c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275d7e2b65534a408b1e2e4b9bceab13'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:31.382372 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fb661-9a29-4a9e-85f1-5b2f58fbadef admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:31.386890 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a6718762-9a9c-46bc-9650-1bd76f3887c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275d7e2b65534a408b1e2e4b9bceab13'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:31.387299 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bb65e-a3b5-478a-892f-5b2c23fa1218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:31.388194 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bb65e-a3b5-478a-892f-5b2c23fa1218 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:31.388472 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bb65e-a3b5-478a-892f-5b2c23fa1218 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:31.388743 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bb65e-a3b5-478a-892f-5b2c23fa1218 admin admin] PATH_INFO: `/v3/projects/cea99edc1a6246c08482f900b7b7f63b/users/f6d805c96d014759af3492a04c7d8318/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:31.393628 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a6718762-9a9c-46bc-9650-1bd76f3887c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275d7e2b65534a408b1e2e4b9bceab13'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:31.404794 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bb65e-a3b5-478a-892f-5b2c23fa1218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea99edc1a6246c08482f900b7b7f63b, user_id=f6d805c96d014759af3492a04c7d8318, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:31.407647 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bb65e-a3b5-478a-892f-5b2c23fa1218 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:31.412461 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 967/1923] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:31 2022] DELETE /identity/v3/users/275d7e2b65534a408b1e2e4b9bceab13 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:31.412461 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6718762-9a9c-46bc-9650-1bd76f3887c5 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:31.412461 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a6718762-9a9c-46bc-9650-1bd76f3887c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:31.424958 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 957/1924] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:31 2022] PUT /identity/v3/projects/cea99edc1a6246c08482f900b7b7f63b/users/f6d805c96d014759af3492a04c7d8318/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:31.433883 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdd409-2153-49fe-8cc4-9d4d88ef7ea5 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:31.433883 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdd409-2153-49fe-8cc4-9d4d88ef7ea5 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:31.433883 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdd409-2153-49fe-8cc4-9d4d88ef7ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:31.450023 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-0ecdd409-2153-49fe-8cc4-9d4d88ef7ea5 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:31.451307 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-0ecdd409-2153-49fe-8cc4-9d4d88ef7ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:31.481280 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6718762-9a9c-46bc-9650-1bd76f3887c5 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:31.519828 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 958/1925] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:31.521540 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a61852-cfbc-4a70-bcfe-bfd124f88c5b None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:31.521873 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a61852-cfbc-4a70-bcfe-bfd124f88c5b None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:31.522095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a61852-cfbc-4a70-bcfe-bfd124f88c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:31.544437 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62ade3-8e42-491a-b81b-871587a781ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:31.545195 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62ade3-8e42-491a-b81b-871587a781ce admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:31.545479 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62ade3-8e42-491a-b81b-871587a781ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:31.545753 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62ade3-8e42-491a-b81b-871587a781ce admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:31.546467 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62ade3-8e42-491a-b81b-871587a781ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:31.548420 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62ade3-8e42-491a-b81b-871587a781ce admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:31.559424 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-44a61852-cfbc-4a70-bcfe-bfd124f88c5b None None] MFA Rules not processed for user `f6d805c96d014759af3492a04c7d8318`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:31.560730 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-44a61852-cfbc-4a70-bcfe-bfd124f88c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:31.572226 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 968/1926] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:31 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:31.573658 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62ade3-8e42-491a-b81b-871587a781ce admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:31.576194 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-2c62ade3-8e42-491a-b81b-871587a781ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:31.628638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 959/1927] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:31.630290 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a61852-cfbc-4a70-bcfe-bfd124f88c5b None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:31.632111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-44a61852-cfbc-4a70-bcfe-bfd124f88c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:31.645404 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62ade3-8e42-491a-b81b-871587a781ce admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:31.647315 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a61852-cfbc-4a70-bcfe-bfd124f88c5b None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:31.649655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7e061-46b8-498b-a148-f8abd67d52ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:31.650236 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7e061-46b8-498b-a148-f8abd67d52ba service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:31.650516 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7e061-46b8-498b-a148-f8abd67d52ba service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:31.650791 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7e061-46b8-498b-a148-f8abd67d52ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:31.654057 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65eedc1-ae43-41c3-85a9-345cc18bab5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:31.656102 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65eedc1-ae43-41c3-85a9-345cc18bab5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:31.656627 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65eedc1-ae43-41c3-85a9-345cc18bab5f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:31.657112 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65eedc1-ae43-41c3-85a9-345cc18bab5f admin admin] PATH_INFO: `/v3/projects/03d505080db0418ea8691a31e101c2c0` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:31.659168 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65eedc1-ae43-41c3-85a9-345cc18bab5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=03d505080db0418ea8691a31e101c2c0)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:31.661683 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7e061-46b8-498b-a148-f8abd67d52ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:31.662316 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65eedc1-ae43-41c3-85a9-345cc18bab5f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:31.663103 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7e061-46b8-498b-a148-f8abd67d52ba service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:31.675424 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 969/1928] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:31.676257 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7e061-46b8-498b-a148-f8abd67d52ba service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:31.685959 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7e061-46b8-498b-a148-f8abd67d52ba service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:31.690733 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a972a-d8a0-40bd-8773-970ced55e304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:31.691393 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a972a-d8a0-40bd-8773-970ced55e304 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:31.691670 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a972a-d8a0-40bd-8773-970ced55e304 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:31.691943 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a972a-d8a0-40bd-8773-970ced55e304 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:31.692678 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a972a-d8a0-40bd-8773-970ced55e304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:31.695628 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a972a-d8a0-40bd-8773-970ced55e304 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:31.705721 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 970/1929] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:31.705721 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a972a-d8a0-40bd-8773-970ced55e304 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:31.709173 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-697a972a-d8a0-40bd-8773-970ced55e304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:31.722536 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a972a-d8a0-40bd-8773-970ced55e304 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:31.733007 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c65eedc1-ae43-41c3-85a9-345cc18bab5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03d505080db0418ea8691a31e101c2c0', 'request_id': 'req-c65eedc1-ae43-41c3-85a9-345cc18bab5f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:31.741561 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c65eedc1-ae43-41c3-85a9-345cc18bab5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03d505080db0418ea8691a31e101c2c0', 'request_id': 'req-c65eedc1-ae43-41c3-85a9-345cc18bab5f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:31.753088 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c65eedc1-ae43-41c3-85a9-345cc18bab5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03d505080db0418ea8691a31e101c2c0', 'request_id': 'req-c65eedc1-ae43-41c3-85a9-345cc18bab5f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:31.775391 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c65eedc1-ae43-41c3-85a9-345cc18bab5f admin admin] The token cache is being invalidate because project 03d505080db0418ea8691a31e101c2c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:31.775760 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c65eedc1-ae43-41c3-85a9-345cc18bab5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:31.776447 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c65eedc1-ae43-41c3-85a9-345cc18bab5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:31.778360 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 960/1930] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:31 2022] DELETE /identity/v3/projects/03d505080db0418ea8691a31e101c2c0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:31.782117 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65eedc1-ae43-41c3-85a9-345cc18bab5f admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:31.786255 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-c65eedc1-ae43-41c3-85a9-345cc18bab5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:31.805554 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54246f-4c92-4c11-ac79-c3d273278825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:31.806408 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54246f-4c92-4c11-ac79-c3d273278825 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:31.806691 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54246f-4c92-4c11-ac79-c3d273278825 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:31.806988 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54246f-4c92-4c11-ac79-c3d273278825 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:31.807701 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54246f-4c92-4c11-ac79-c3d273278825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:31.811492 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54246f-4c92-4c11-ac79-c3d273278825 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:31.843828 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 971/1931] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:31 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:31.845911 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5970aa-6197-47d9-b54e-c918c313cd66 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:31.846932 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5970aa-6197-47d9-b54e-c918c313cd66 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:31.846932 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5970aa-6197-47d9-b54e-c918c313cd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:31.865218 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-af5970aa-6197-47d9-b54e-c918c313cd66 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:31.868495 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-af5970aa-6197-47d9-b54e-c918c313cd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:31.889467 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65eedc1-ae43-41c3-85a9-345cc18bab5f admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:31.931292 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 972/1932] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:31.932339 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5970aa-6197-47d9-b54e-c918c313cd66 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:31.933644 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-af5970aa-6197-47d9-b54e-c918c313cd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:31.946045 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5970aa-6197-47d9-b54e-c918c313cd66 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:31.951772 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27251a-d5a2-4149-9a80-f2f1b03e530b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:31.953020 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27251a-d5a2-4149-9a80-f2f1b03e530b admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:31.953343 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27251a-d5a2-4149-9a80-f2f1b03e530b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:31.953620 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27251a-d5a2-4149-9a80-f2f1b03e530b admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:31.954329 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27251a-d5a2-4149-9a80-f2f1b03e530b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:31.955199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e617374-6b35-4186-930d-c7c021d25e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:31.955875 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e617374-6b35-4186-930d-c7c021d25e7d admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:31.956152 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e617374-6b35-4186-930d-c7c021d25e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:31.956427 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e617374-6b35-4186-930d-c7c021d25e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:31.956825 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27251a-d5a2-4149-9a80-f2f1b03e530b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:31.957203 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e617374-6b35-4186-930d-c7c021d25e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:31.958813 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e617374-6b35-4186-930d-c7c021d25e7d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:31.969407 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 961/1933] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:31.970869 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b5c9e-759f-4e1d-bfc1-de48b376e3f0 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:31.971160 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b5c9e-759f-4e1d-bfc1-de48b376e3f0 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:31.971435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b5c9e-759f-4e1d-bfc1-de48b376e3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:31.983256 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 973/1934] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:31 2022] POST /identity/v3/users => generated 293 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:31.984328 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27251a-d5a2-4149-9a80-f2f1b03e530b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:31.991929 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-c74b5c9e-759f-4e1d-bfc1-de48b376e3f0 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:31.993360 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-c74b5c9e-759f-4e1d-bfc1-de48b376e3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:31.996077 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27251a-d5a2-4149-9a80-f2f1b03e530b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:32.001954 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3172d-c65e-494f-bd42-d8fd275fd0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:32.002996 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3172d-c65e-494f-bd42-d8fd275fd0cb admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:32.003416 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3172d-c65e-494f-bd42-d8fd275fd0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:32.003830 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3172d-c65e-494f-bd42-d8fd275fd0cb admin admin] PATH_INFO: `/v3/projects/8c0804e4f9b742cb82e550f4258d98e5/users/d4283e40300a4708a177e53ef95cedda/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:32.004899 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 962/1935] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:32.005802 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b5c9e-759f-4e1d-bfc1-de48b376e3f0 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:32.016002 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b5c9e-759f-4e1d-bfc1-de48b376e3f0 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:32.019859 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3172d-c65e-494f-bd42-d8fd275fd0cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0804e4f9b742cb82e550f4258d98e5, user_id=d4283e40300a4708a177e53ef95cedda, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:32.022117 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed819721-aa8b-40b2-bf3e-55714b849cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:32.023037 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3172d-c65e-494f-bd42-d8fd275fd0cb admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:32.023489 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed819721-aa8b-40b2-bf3e-55714b849cef admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:32.023489 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed819721-aa8b-40b2-bf3e-55714b849cef admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:32.023726 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed819721-aa8b-40b2-bf3e-55714b849cef admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:32.024439 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed819721-aa8b-40b2-bf3e-55714b849cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:32.026056 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed819721-aa8b-40b2-bf3e-55714b849cef admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:32.040442 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 963/1936] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:32.041408 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed819721-aa8b-40b2-bf3e-55714b849cef admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:32.042553 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 974/1937] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:31 2022] PUT /identity/v3/projects/8c0804e4f9b742cb82e550f4258d98e5/users/d4283e40300a4708a177e53ef95cedda/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:32.043106 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-ed819721-aa8b-40b2-bf3e-55714b849cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:32.043372 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3172d-c65e-494f-bd42-d8fd275fd0cb admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:32.055605 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed819721-aa8b-40b2-bf3e-55714b849cef admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:32.106121 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3172d-c65e-494f-bd42-d8fd275fd0cb admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:32.107377 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cf456-2124-452c-95c6-1054483496d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:32.108238 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cf456-2124-452c-95c6-1054483496d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:32.108544 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cf456-2124-452c-95c6-1054483496d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:32.108912 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cf456-2124-452c-95c6-1054483496d4 admin admin] PATH_INFO: `/v3/projects/877a14c93b5b44eda43e77e35c5820ee` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:32.110677 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cf456-2124-452c-95c6-1054483496d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=877a14c93b5b44eda43e77e35c5820ee)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:32.110951 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832817f-d78e-4ee7-8196-cf77dbbece0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:32.111605 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832817f-d78e-4ee7-8196-cf77dbbece0d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:32.111888 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832817f-d78e-4ee7-8196-cf77dbbece0d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:32.112165 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832817f-d78e-4ee7-8196-cf77dbbece0d admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:32.112572 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cf456-2124-452c-95c6-1054483496d4 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:32.112922 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832817f-d78e-4ee7-8196-cf77dbbece0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:51:32.113230 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832817f-d78e-4ee7-8196-cf77dbbece0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:32.114812 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832817f-d78e-4ee7-8196-cf77dbbece0d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:32.126107 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 975/1938] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:51:32.126972 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832817f-d78e-4ee7-8196-cf77dbbece0d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:32.141178 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832817f-d78e-4ee7-8196-cf77dbbece0d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:32.146255 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874f7c2-2b47-47ec-af2f-ebfa2d3cf086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:32.146915 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874f7c2-2b47-47ec-af2f-ebfa2d3cf086 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:32.147199 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874f7c2-2b47-47ec-af2f-ebfa2d3cf086 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:32.147477 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874f7c2-2b47-47ec-af2f-ebfa2d3cf086 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:32.148533 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874f7c2-2b47-47ec-af2f-ebfa2d3cf086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:32.150171 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874f7c2-2b47-47ec-af2f-ebfa2d3cf086 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:32.160221 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a22cf456-2124-452c-95c6-1054483496d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '877a14c93b5b44eda43e77e35c5820ee', 'request_id': 'req-a22cf456-2124-452c-95c6-1054483496d4'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:32.166034 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 976/1939] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:32.166870 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a22cf456-2124-452c-95c6-1054483496d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '877a14c93b5b44eda43e77e35c5820ee', 'request_id': 'req-a22cf456-2124-452c-95c6-1054483496d4'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:32.167232 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d47ea-61a8-415b-ad4d-8eb381bc6114 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:32.167521 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d47ea-61a8-415b-ad4d-8eb381bc6114 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:32.167794 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d47ea-61a8-415b-ad4d-8eb381bc6114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:32.178893 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a22cf456-2124-452c-95c6-1054483496d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '877a14c93b5b44eda43e77e35c5820ee', 'request_id': 'req-a22cf456-2124-452c-95c6-1054483496d4'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:32.192218 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a22cf456-2124-452c-95c6-1054483496d4 admin admin] The token cache is being invalidate because project 877a14c93b5b44eda43e77e35c5820ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:32.192600 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a22cf456-2124-452c-95c6-1054483496d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:32.193507 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a22cf456-2124-452c-95c6-1054483496d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:32.195500 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 964/1940] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:32 2022] DELETE /identity/v3/projects/877a14c93b5b44eda43e77e35c5820ee => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:32.199224 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cf456-2124-452c-95c6-1054483496d4 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:32.201055 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-a22cf456-2124-452c-95c6-1054483496d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:32.209257 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-488d47ea-61a8-415b-ad4d-8eb381bc6114 None None] MFA Rules not processed for user `d4283e40300a4708a177e53ef95cedda`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:32.211343 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-488d47ea-61a8-415b-ad4d-8eb381bc6114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:32.269002 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cf456-2124-452c-95c6-1054483496d4 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:32.273937 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40eec0-90a8-4523-8c20-961ffa898994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:32.274600 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40eec0-90a8-4523-8c20-961ffa898994 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:32.274884 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40eec0-90a8-4523-8c20-961ffa898994 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:32.275161 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40eec0-90a8-4523-8c20-961ffa898994 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:32.275873 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40eec0-90a8-4523-8c20-961ffa898994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:32.277818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40eec0-90a8-4523-8c20-961ffa898994 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:32.279093 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 977/1941] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:32.283342 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d47ea-61a8-415b-ad4d-8eb381bc6114 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:32.283342 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-488d47ea-61a8-415b-ad4d-8eb381bc6114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:32.299304 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d47ea-61a8-415b-ad4d-8eb381bc6114 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:32.304788 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c41613-5c47-4305-8695-2123e62ef6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:32.305771 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c41613-5c47-4305-8695-2123e62ef6bd admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:32.306054 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c41613-5c47-4305-8695-2123e62ef6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:32.306332 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c41613-5c47-4305-8695-2123e62ef6bd admin admin] PATH_INFO: `/v3/projects/d83ec0b1aad845aba51719c375b6c06d/users/948143fe86d9407e99eff9ec6c3f1dc8/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:32.308073 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 965/1942] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:32 2022] POST /identity/v3/projects => generated 403 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:32.308927 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40eec0-90a8-4523-8c20-961ffa898994 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:32.310526 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-4f40eec0-90a8-4523-8c20-961ffa898994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:32.324009 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c41613-5c47-4305-8695-2123e62ef6bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d83ec0b1aad845aba51719c375b6c06d, user_id=948143fe86d9407e99eff9ec6c3f1dc8, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:32.326722 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c41613-5c47-4305-8695-2123e62ef6bd admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:32.341408 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 978/1943] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:32 2022] PUT /identity/v3/projects/d83ec0b1aad845aba51719c375b6c06d/users/948143fe86d9407e99eff9ec6c3f1dc8/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:32.342277 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c41613-5c47-4305-8695-2123e62ef6bd admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:32.343873 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-29c41613-5c47-4305-8695-2123e62ef6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:32.380713 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40eec0-90a8-4523-8c20-961ffa898994 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:32.407578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c41613-5c47-4305-8695-2123e62ef6bd admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:32.411384 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7db1d-08db-453a-8727-a1abc8779f5d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15232a1930bc43e8bb5aa7310a709056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:32.412038 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7db1d-08db-453a-8727-a1abc8779f5d service glance] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:32.412318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7db1d-08db-453a-8727-a1abc8779f5d service glance] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:32.412594 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7db1d-08db-453a-8727-a1abc8779f5d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:32.446372 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6366170-8c12-4210-9634-732e7bd7f991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:32.447453 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6366170-8c12-4210-9634-732e7bd7f991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:32.448273 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6366170-8c12-4210-9634-732e7bd7f991 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:32.448273 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6366170-8c12-4210-9634-732e7bd7f991 admin admin] PATH_INFO: `/v3/users/3b940839b801435e93671d817afd1f81` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:32.449531 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6366170-8c12-4210-9634-732e7bd7f991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b940839b801435e93671d817afd1f81)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:32.451560 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6366170-8c12-4210-9634-732e7bd7f991 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:32.471411 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7db1d-08db-453a-8727-a1abc8779f5d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:32.472897 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7db1d-08db-453a-8727-a1abc8779f5d service glance] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:32.483257 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 979/1944] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:32.486384 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7db1d-08db-453a-8727-a1abc8779f5d service glance] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:32.499360 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7db1d-08db-453a-8727-a1abc8779f5d service glance] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:32.502618 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a6366170-8c12-4210-9634-732e7bd7f991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b940839b801435e93671d817afd1f81'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:32.506366 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb193d7b-2e7e-4836-95bc-46b01ae71359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:32.507301 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb193d7b-2e7e-4836-95bc-46b01ae71359 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:32.507737 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb193d7b-2e7e-4836-95bc-46b01ae71359 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:32.507997 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb193d7b-2e7e-4836-95bc-46b01ae71359 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:32.508769 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb193d7b-2e7e-4836-95bc-46b01ae71359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:32.511035 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb193d7b-2e7e-4836-95bc-46b01ae71359 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:32.520462 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a6366170-8c12-4210-9634-732e7bd7f991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b940839b801435e93671d817afd1f81'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:32.529163 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a6366170-8c12-4210-9634-732e7bd7f991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b940839b801435e93671d817afd1f81'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:32.548573 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 980/1945] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:32 2022] POST /identity/v3/users => generated 302 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:32.548573 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722c44d-e11c-4894-b89b-f2cdd5aad0cd None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:32.548573 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722c44d-e11c-4894-b89b-f2cdd5aad0cd None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:32.548573 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722c44d-e11c-4894-b89b-f2cdd5aad0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:32.553427 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a6366170-8c12-4210-9634-732e7bd7f991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b940839b801435e93671d817afd1f81'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:32.555267 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a6366170-8c12-4210-9634-732e7bd7f991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b940839b801435e93671d817afd1f81'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:32.569418 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 966/1946] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:32 2022] DELETE /identity/v3/users/3b940839b801435e93671d817afd1f81 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:32.569848 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6366170-8c12-4210-9634-732e7bd7f991 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:32.571376 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-a6366170-8c12-4210-9634-732e7bd7f991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:32.605954 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-b722c44d-e11c-4894-b89b-f2cdd5aad0cd None None] MFA Rules not processed for user `948143fe86d9407e99eff9ec6c3f1dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:32.607344 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b722c44d-e11c-4894-b89b-f2cdd5aad0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:32.668769 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6366170-8c12-4210-9634-732e7bd7f991 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:32.678354 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ca1e3-8a7d-4e17-848f-8dadf1afb48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:32.679115 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ca1e3-8a7d-4e17-848f-8dadf1afb48e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:32.679399 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ca1e3-8a7d-4e17-848f-8dadf1afb48e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:32.679750 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ca1e3-8a7d-4e17-848f-8dadf1afb48e admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:32.680648 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ca1e3-8a7d-4e17-848f-8dadf1afb48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:32.682430 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ca1e3-8a7d-4e17-848f-8dadf1afb48e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:32.697764 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 967/1947] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:32.714933 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ca1e3-8a7d-4e17-848f-8dadf1afb48e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:32.738808 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ca1e3-8a7d-4e17-848f-8dadf1afb48e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:32.753175 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cd781-a82a-4051-a41b-d19c41600f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:32.754660 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cd781-a82a-4051-a41b-d19c41600f24 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:32.754958 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cd781-a82a-4051-a41b-d19c41600f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:32.755237 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cd781-a82a-4051-a41b-d19c41600f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:32.756042 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5cd781-a82a-4051-a41b-d19c41600f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:32.758614 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5cd781-a82a-4051-a41b-d19c41600f24 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:32.763768 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 981/1948] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:32.768587 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722c44d-e11c-4894-b89b-f2cdd5aad0cd None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:32.770386 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b722c44d-e11c-4894-b89b-f2cdd5aad0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:32.784907 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 968/1949] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:32.789026 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cd781-a82a-4051-a41b-d19c41600f24 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:32.795774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722c44d-e11c-4894-b89b-f2cdd5aad0cd None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:32.799748 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cd781-a82a-4051-a41b-d19c41600f24 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:32.804767 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc5135-2557-4c36-aa73-0d40a8763a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:32.805857 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc5135-2557-4c36-aa73-0d40a8763a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:32.806246 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc5135-2557-4c36-aa73-0d40a8763a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:32.806619 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc5135-2557-4c36-aa73-0d40a8763a59 admin admin] PATH_INFO: `/v3/projects/ca032d0195914a6ca83d4db4967d1e70/users/915acf56aabb4774b317c9adb40f8e03/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:32.809229 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038231c-a1e7-4451-b712-cb1a4ceef021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:32.810551 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038231c-a1e7-4451-b712-cb1a4ceef021 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:32.810836 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038231c-a1e7-4451-b712-cb1a4ceef021 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:32.811110 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038231c-a1e7-4451-b712-cb1a4ceef021 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:32.811825 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038231c-a1e7-4451-b712-cb1a4ceef021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:32.813864 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038231c-a1e7-4451-b712-cb1a4ceef021 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:32.826031 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc5135-2557-4c36-aa73-0d40a8763a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca032d0195914a6ca83d4db4967d1e70, user_id=915acf56aabb4774b317c9adb40f8e03, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:32.829826 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc5135-2557-4c36-aa73-0d40a8763a59 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:32.876720 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 969/1950] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:32 2022] PUT /identity/v3/projects/ca032d0195914a6ca83d4db4967d1e70/users/915acf56aabb4774b317c9adb40f8e03/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:32.878698 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba528ab4-b639-479e-8d7a-ef6e9fcc8e4a None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:32.878993 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba528ab4-b639-479e-8d7a-ef6e9fcc8e4a None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:32.879272 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba528ab4-b639-479e-8d7a-ef6e9fcc8e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:32.880087 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 982/1951] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:32 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:32.888047 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038231c-a1e7-4451-b712-cb1a4ceef021 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:32.911280 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-ba528ab4-b639-479e-8d7a-ef6e9fcc8e4a None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:32.912687 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-ba528ab4-b639-479e-8d7a-ef6e9fcc8e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:33.007641 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038231c-a1e7-4451-b712-cb1a4ceef021 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:33.025598 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f4005-3236-4427-aa2c-e2d702daeba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:33.026487 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f4005-3236-4427-aa2c-e2d702daeba2 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:33.026916 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f4005-3236-4427-aa2c-e2d702daeba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:33.027351 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f4005-3236-4427-aa2c-e2d702daeba2 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:33.028441 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f4005-3236-4427-aa2c-e2d702daeba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:33.030951 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f4005-3236-4427-aa2c-e2d702daeba2 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:33.049810 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 970/1952] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:33.059737 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 983/1953] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:32 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:33.060044 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba528ab4-b639-479e-8d7a-ef6e9fcc8e4a None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:33.061698 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-ba528ab4-b639-479e-8d7a-ef6e9fcc8e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:33.063178 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f4005-3236-4427-aa2c-e2d702daeba2 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:33.076903 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f4005-3236-4427-aa2c-e2d702daeba2 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:33.081714 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0756e47-4b6b-4620-b8e4-2997b92b9158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:33.082548 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0756e47-4b6b-4620-b8e4-2997b92b9158 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:33.082829 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0756e47-4b6b-4620-b8e4-2997b92b9158 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:33.083101 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0756e47-4b6b-4620-b8e4-2997b92b9158 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:33.084508 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0756e47-4b6b-4620-b8e4-2997b92b9158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:33.086310 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0756e47-4b6b-4620-b8e4-2997b92b9158 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:33.108602 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 984/1954] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:33.109576 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0756e47-4b6b-4620-b8e4-2997b92b9158 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:33.121638 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0756e47-4b6b-4620-b8e4-2997b92b9158 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:33.132731 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcee4ca-07e4-461e-bf4b-86e6d38a2d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:33.134490 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcee4ca-07e4-461e-bf4b-86e6d38a2d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:33.134846 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcee4ca-07e4-461e-bf4b-86e6d38a2d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:33.135173 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcee4ca-07e4-461e-bf4b-86e6d38a2d7d admin admin] PATH_INFO: `/v3/projects/bf3688fb1ded4fcfbc118e4d02cb6ae6/users/093cc60ab0954690bf85d5048d2af2a8/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:33.163419 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcee4ca-07e4-461e-bf4b-86e6d38a2d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf3688fb1ded4fcfbc118e4d02cb6ae6, user_id=093cc60ab0954690bf85d5048d2af2a8, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:33.166326 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcee4ca-07e4-461e-bf4b-86e6d38a2d7d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:33.182680 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 985/1955] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:33 2022] PUT /identity/v3/projects/bf3688fb1ded4fcfbc118e4d02cb6ae6/users/093cc60ab0954690bf85d5048d2af2a8/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:33.185719 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcee4ca-07e4-461e-bf4b-86e6d38a2d7d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:33.186204 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba528ab4-b639-479e-8d7a-ef6e9fcc8e4a None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:33.187657 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-5fcee4ca-07e4-461e-bf4b-86e6d38a2d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:33.243170 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3a8ed-83d5-4067-85f0-c18fe999a08f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:33.243914 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3a8ed-83d5-4067-85f0-c18fe999a08f service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:33.244270 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3a8ed-83d5-4067-85f0-c18fe999a08f service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:33.244635 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3a8ed-83d5-4067-85f0-c18fe999a08f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:33.266856 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcee4ca-07e4-461e-bf4b-86e6d38a2d7d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:33.272255 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa5c7b-dfac-4fe1-ad91-de125b65f4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:33.273737 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa5c7b-dfac-4fe1-ad91-de125b65f4c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:33.274036 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa5c7b-dfac-4fe1-ad91-de125b65f4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:33.274315 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa5c7b-dfac-4fe1-ad91-de125b65f4c5 admin admin] PATH_INFO: `/v3/projects/c7a908015fc84ca1b724cd95ac73363f` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:33.275657 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa5c7b-dfac-4fe1-ad91-de125b65f4c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7a908015fc84ca1b724cd95ac73363f)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:33.277605 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa5c7b-dfac-4fe1-ad91-de125b65f4c5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:33.305678 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3a8ed-83d5-4067-85f0-c18fe999a08f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:33.307355 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3a8ed-83d5-4067-85f0-c18fe999a08f service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:33.317610 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 971/1956] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:51:33.318514 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3a8ed-83d5-4067-85f0-c18fe999a08f service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:33.328276 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3a8ed-83d5-4067-85f0-c18fe999a08f service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:33.338057 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-e5fa5c7b-dfac-4fe1-ad91-de125b65f4c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7a908015fc84ca1b724cd95ac73363f', 'request_id': 'req-e5fa5c7b-dfac-4fe1-ad91-de125b65f4c5'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:33.348132 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-e5fa5c7b-dfac-4fe1-ad91-de125b65f4c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7a908015fc84ca1b724cd95ac73363f', 'request_id': 'req-e5fa5c7b-dfac-4fe1-ad91-de125b65f4c5'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:33.359749 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-e5fa5c7b-dfac-4fe1-ad91-de125b65f4c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7a908015fc84ca1b724cd95ac73363f', 'request_id': 'req-e5fa5c7b-dfac-4fe1-ad91-de125b65f4c5'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:33.378010 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-e5fa5c7b-dfac-4fe1-ad91-de125b65f4c5 admin admin] The token cache is being invalidate because project c7a908015fc84ca1b724cd95ac73363f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:33.378309 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-e5fa5c7b-dfac-4fe1-ad91-de125b65f4c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:33.379180 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-e5fa5c7b-dfac-4fe1-ad91-de125b65f4c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:33.381114 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 986/1957] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:33 2022] DELETE /identity/v3/projects/c7a908015fc84ca1b724cd95ac73363f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:33.386927 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9ec63-50f8-41de-ac01-59beb80514b6 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:33.387262 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9ec63-50f8-41de-ac01-59beb80514b6 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:33.387548 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9ec63-50f8-41de-ac01-59beb80514b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:33.397816 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10212a86-88fe-425e-82e8-efe3dd9c19ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:33.399582 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10212a86-88fe-425e-82e8-efe3dd9c19ec admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:33.399932 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10212a86-88fe-425e-82e8-efe3dd9c19ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:33.400739 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10212a86-88fe-425e-82e8-efe3dd9c19ec admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:33.401179 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10212a86-88fe-425e-82e8-efe3dd9c19ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:33.402917 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10212a86-88fe-425e-82e8-efe3dd9c19ec admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:33.416791 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 972/1958] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:33.417031 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-c8f9ec63-50f8-41de-ac01-59beb80514b6 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:33.417031 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-c8f9ec63-50f8-41de-ac01-59beb80514b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:33.418046 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10212a86-88fe-425e-82e8-efe3dd9c19ec admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:33.422629 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-10212a86-88fe-425e-82e8-efe3dd9c19ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:33.427718 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 987/1959] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:33.437642 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10212a86-88fe-425e-82e8-efe3dd9c19ec admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:33.439663 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd2ca7-1ed5-476a-b61f-e7c495135fa8 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:33.440737 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd2ca7-1ed5-476a-b61f-e7c495135fa8 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:33.441631 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd2ca7-1ed5-476a-b61f-e7c495135fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:33.443145 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782e1f9-0c52-40eb-bc2f-247273bf4292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:33.444199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782e1f9-0c52-40eb-bc2f-247273bf4292 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:33.444477 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782e1f9-0c52-40eb-bc2f-247273bf4292 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:33.444754 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782e1f9-0c52-40eb-bc2f-247273bf4292 admin admin] PATH_INFO: `/v3/projects/bf3688fb1ded4fcfbc118e4d02cb6ae6/users/093cc60ab0954690bf85d5048d2af2a8/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:33.452470 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782e1f9-0c52-40eb-bc2f-247273bf4292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf3688fb1ded4fcfbc118e4d02cb6ae6, user_id=093cc60ab0954690bf85d5048d2af2a8, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:33.455875 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782e1f9-0c52-40eb-bc2f-247273bf4292 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:33.468097 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-dfbd2ca7-1ed5-476a-b61f-e7c495135fa8 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:33.469510 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-dfbd2ca7-1ed5-476a-b61f-e7c495135fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:33.476997 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 973/1960] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:33 2022] PUT /identity/v3/projects/bf3688fb1ded4fcfbc118e4d02cb6ae6/users/093cc60ab0954690bf85d5048d2af2a8/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:33.478713 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380723f-9489-4188-a5fa-c5bfa115fafb None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:33.479002 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380723f-9489-4188-a5fa-c5bfa115fafb None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:33.479287 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380723f-9489-4188-a5fa-c5bfa115fafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:33.519822 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-e380723f-9489-4188-a5fa-c5bfa115fafb None None] MFA Rules not processed for user `093cc60ab0954690bf85d5048d2af2a8`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:33.521538 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-e380723f-9489-4188-a5fa-c5bfa115fafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:33.568891 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 988/1961] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:33.574639 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd2ca7-1ed5-476a-b61f-e7c495135fa8 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:33.591074 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd2ca7-1ed5-476a-b61f-e7c495135fa8 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:33.603170 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f4b59-dbbb-44ad-a207-44d1b52e9b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:33.603726 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f4b59-dbbb-44ad-a207-44d1b52e9b37 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:33.604004 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f4b59-dbbb-44ad-a207-44d1b52e9b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:33.604276 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f4b59-dbbb-44ad-a207-44d1b52e9b37 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:33.605049 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f4b59-dbbb-44ad-a207-44d1b52e9b37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:51:33.605410 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f4b59-dbbb-44ad-a207-44d1b52e9b37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:33.606978 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f4b59-dbbb-44ad-a207-44d1b52e9b37 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:33.619355 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 989/1962] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:51:33.622742 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 974/1963] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:33.633067 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f4b59-dbbb-44ad-a207-44d1b52e9b37 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:33.633242 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380723f-9489-4188-a5fa-c5bfa115fafb None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:33.634509 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-e380723f-9489-4188-a5fa-c5bfa115fafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:33.644606 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f4b59-dbbb-44ad-a207-44d1b52e9b37 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:33.650235 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0858ad1-f23f-4d15-82e8-24bd26de383d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:33.650841 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0858ad1-f23f-4d15-82e8-24bd26de383d admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:33.651125 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0858ad1-f23f-4d15-82e8-24bd26de383d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:33.651402 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0858ad1-f23f-4d15-82e8-24bd26de383d admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:33.652130 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0858ad1-f23f-4d15-82e8-24bd26de383d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:33.654618 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0858ad1-f23f-4d15-82e8-24bd26de383d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:33.691733 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 990/1964] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:33 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:33.693704 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0858ad1-f23f-4d15-82e8-24bd26de383d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:33.745388 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380723f-9489-4188-a5fa-c5bfa115fafb None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:33.795080 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0858ad1-f23f-4d15-82e8-24bd26de383d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:33.802194 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08a5fd-8e19-42c7-8131-2ffa1e7fd1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:33.802874 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08a5fd-8e19-42c7-8131-2ffa1e7fd1ec admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:33.803392 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08a5fd-8e19-42c7-8131-2ffa1e7fd1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:33.803995 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08a5fd-8e19-42c7-8131-2ffa1e7fd1ec admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:33.804737 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08a5fd-8e19-42c7-8131-2ffa1e7fd1ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:33.807349 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08a5fd-8e19-42c7-8131-2ffa1e7fd1ec admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:33.822378 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e2752-5963-4f5a-8e9c-62263520a613 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:33.823522 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e2752-5963-4f5a-8e9c-62263520a613 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:33.824374 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e2752-5963-4f5a-8e9c-62263520a613 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:33.824658 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e2752-5963-4f5a-8e9c-62263520a613 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:33.827635 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-a67e2752-5963-4f5a-8e9c-62263520a613 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:33.839578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 991/1965] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:33 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:33.840694 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08a5fd-8e19-42c7-8131-2ffa1e7fd1ec admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:33.853220 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08a5fd-8e19-42c7-8131-2ffa1e7fd1ec admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:33.862749 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35163d8b-a2d3-45fc-b9d6-84841613554d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:33.863425 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35163d8b-a2d3-45fc-b9d6-84841613554d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:33.863705 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35163d8b-a2d3-45fc-b9d6-84841613554d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:33.864522 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35163d8b-a2d3-45fc-b9d6-84841613554d admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:33.865335 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35163d8b-a2d3-45fc-b9d6-84841613554d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:33.866936 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35163d8b-a2d3-45fc-b9d6-84841613554d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:33.883652 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 992/1966] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:33.887767 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35163d8b-a2d3-45fc-b9d6-84841613554d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:33.902691 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35163d8b-a2d3-45fc-b9d6-84841613554d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:33.905105 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e2752-5963-4f5a-8e9c-62263520a613 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:33.906893 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e2752-5963-4f5a-8e9c-62263520a613 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:33.908155 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a8d9a-3272-4fc6-9659-fd40c8539a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:33.908827 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a8d9a-3272-4fc6-9659-fd40c8539a74 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:33.909142 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a8d9a-3272-4fc6-9659-fd40c8539a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:33.909422 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a8d9a-3272-4fc6-9659-fd40c8539a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:33.910169 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a8d9a-3272-4fc6-9659-fd40c8539a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:33.911767 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a8d9a-3272-4fc6-9659-fd40c8539a74 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:33.918060 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 975/1967] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:33.922382 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 993/1968] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:51:33.926733 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e2752-5963-4f5a-8e9c-62263520a613 service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:33.938199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e2752-5963-4f5a-8e9c-62263520a613 service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:33.942789 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59038a2d-3818-4182-9f70-829e786f8d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:33.943733 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59038a2d-3818-4182-9f70-829e786f8d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:33.944018 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59038a2d-3818-4182-9f70-829e786f8d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:33.944294 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59038a2d-3818-4182-9f70-829e786f8d23 admin admin] PATH_INFO: `/v3/projects/3e9010065c7e44eb84e1dc0caa4a7f22/users/6a1dbb5a6c674a1e953c4aaf88786cd6/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:33.965516 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59038a2d-3818-4182-9f70-829e786f8d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9010065c7e44eb84e1dc0caa4a7f22, user_id=6a1dbb5a6c674a1e953c4aaf88786cd6, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:33.968549 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59038a2d-3818-4182-9f70-829e786f8d23 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:33.984621 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 976/1969] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:33 2022] PUT /identity/v3/projects/3e9010065c7e44eb84e1dc0caa4a7f22/users/6a1dbb5a6c674a1e953c4aaf88786cd6/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:33.997176 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e691d0-b889-4dc7-90cc-a71dabb9ab9f None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:33.997645 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e691d0-b889-4dc7-90cc-a71dabb9ab9f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:33.998377 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e691d0-b889-4dc7-90cc-a71dabb9ab9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:34.037313 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-61e691d0-b889-4dc7-90cc-a71dabb9ab9f None None] MFA Rules not processed for user `6a1dbb5a6c674a1e953c4aaf88786cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:34.045079 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-61e691d0-b889-4dc7-90cc-a71dabb9ab9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:34.069470 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146156b6-2d57-4912-bb51-0d7971e20ff1 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:34.069674 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146156b6-2d57-4912-bb51-0d7971e20ff1 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:34.069919 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146156b6-2d57-4912-bb51-0d7971e20ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:34.115663 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-146156b6-2d57-4912-bb51-0d7971e20ff1 None None] MFA Rules not processed for user `915acf56aabb4774b317c9adb40f8e03`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:34.118264 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-146156b6-2d57-4912-bb51-0d7971e20ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:34.175998 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 994/1970] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:34.184920 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e691d0-b889-4dc7-90cc-a71dabb9ab9f None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:34.190840 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-61e691d0-b889-4dc7-90cc-a71dabb9ab9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:34.261569 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 977/1971] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:34.266349 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146156b6-2d57-4912-bb51-0d7971e20ff1 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:34.267886 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-146156b6-2d57-4912-bb51-0d7971e20ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:34.278691 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e691d0-b889-4dc7-90cc-a71dabb9ab9f None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:34.285918 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff86f23-931c-4707-9859-ee9fce69748b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:34.285918 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff86f23-931c-4707-9859-ee9fce69748b service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:34.285918 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff86f23-931c-4707-9859-ee9fce69748b service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:34.285918 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff86f23-931c-4707-9859-ee9fce69748b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:34.304058 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff86f23-931c-4707-9859-ee9fce69748b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:34.305261 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff86f23-931c-4707-9859-ee9fce69748b service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:34.331180 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 995/1972] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:51:34.366686 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff86f23-931c-4707-9859-ee9fce69748b service cinder] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:34.427987 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146156b6-2d57-4912-bb51-0d7971e20ff1 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:34.438885 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd9c12-559f-4a45-abd7-234fe74b09be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:34.439766 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd9c12-559f-4a45-abd7-234fe74b09be admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:34.440628 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd9c12-559f-4a45-abd7-234fe74b09be admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:34.440628 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd9c12-559f-4a45-abd7-234fe74b09be admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:34.441329 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd9c12-559f-4a45-abd7-234fe74b09be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:34.443325 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd9c12-559f-4a45-abd7-234fe74b09be admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:34.482730 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff86f23-931c-4707-9859-ee9fce69748b service cinder] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:34.484445 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 978/1973] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:34 2022] POST /identity/v3/projects => generated 405 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:34.488413 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd9c12-559f-4a45-abd7-234fe74b09be admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:34.551190 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f43d1-38d7-437e-b8d7-174112e668a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:34.555796 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f43d1-38d7-437e-b8d7-174112e668a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:34.556332 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f43d1-38d7-437e-b8d7-174112e668a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:34.556826 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f43d1-38d7-437e-b8d7-174112e668a3 admin admin] PATH_INFO: `/v3/users/6a1dbb5a6c674a1e953c4aaf88786cd6` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:34.558355 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f43d1-38d7-437e-b8d7-174112e668a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a1dbb5a6c674a1e953c4aaf88786cd6)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:34.560398 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f43d1-38d7-437e-b8d7-174112e668a3 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:34.562944 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd9c12-559f-4a45-abd7-234fe74b09be admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:34.570320 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4516c-3de8-4e18-8ce8-3e26faa4ad09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:34.571090 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4516c-3de8-4e18-8ce8-3e26faa4ad09 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:34.571376 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4516c-3de8-4e18-8ce8-3e26faa4ad09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:34.571654 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4516c-3de8-4e18-8ce8-3e26faa4ad09 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:34.572427 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4516c-3de8-4e18-8ce8-3e26faa4ad09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:34.574435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4516c-3de8-4e18-8ce8-3e26faa4ad09 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:34.600437 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 979/1974] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:34 2022] POST /identity/v3/users => generated 309 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:51:34.604354 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4516c-3de8-4e18-8ce8-3e26faa4ad09 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:34.614332 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4516c-3de8-4e18-8ce8-3e26faa4ad09 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:34.614523 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b99f43d1-38d7-437e-b8d7-174112e668a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a1dbb5a6c674a1e953c4aaf88786cd6'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:34.615071 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b99f43d1-38d7-437e-b8d7-174112e668a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a1dbb5a6c674a1e953c4aaf88786cd6'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:34.615801 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b99f43d1-38d7-437e-b8d7-174112e668a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a1dbb5a6c674a1e953c4aaf88786cd6'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:34.619159 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e208973-ffcb-450e-994d-fa82ea779927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:34.619922 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208973-ffcb-450e-994d-fa82ea779927 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:34.620230 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208973-ffcb-450e-994d-fa82ea779927 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:34.620480 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208973-ffcb-450e-994d-fa82ea779927 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:34.621254 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e208973-ffcb-450e-994d-fa82ea779927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:34.622857 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e208973-ffcb-450e-994d-fa82ea779927 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:34.627710 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b99f43d1-38d7-437e-b8d7-174112e668a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a1dbb5a6c674a1e953c4aaf88786cd6'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:34.634345 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 980/1975] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:34.638612 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e208973-ffcb-450e-994d-fa82ea779927 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:34.639378 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b99f43d1-38d7-437e-b8d7-174112e668a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a1dbb5a6c674a1e953c4aaf88786cd6'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:34.640788 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-1e208973-ffcb-450e-994d-fa82ea779927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:34.656006 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 996/1976] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:34 2022] DELETE /identity/v3/users/6a1dbb5a6c674a1e953c4aaf88786cd6 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:34.657439 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e208973-ffcb-450e-994d-fa82ea779927 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:34.660346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480e91e-894e-4ae5-ac9f-488e269b1cdf None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:34.660639 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480e91e-894e-4ae5-ac9f-488e269b1cdf None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:34.661096 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480e91e-894e-4ae5-ac9f-488e269b1cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:34.678547 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-f480e91e-894e-4ae5-ac9f-488e269b1cdf None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:34.679671 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f480e91e-894e-4ae5-ac9f-488e269b1cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:34.716798 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447eb18b-f757-489b-a168-88b835b14922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:34.717880 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447eb18b-f757-489b-a168-88b835b14922 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:34.718175 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447eb18b-f757-489b-a168-88b835b14922 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:34.718499 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447eb18b-f757-489b-a168-88b835b14922 admin admin] PATH_INFO: `/v3/projects/5e16cdfc9d9641cda100489125167b1a/users/8f7d5aa76a1649ff9a3ae457d73dd89d/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:34.735121 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447eb18b-f757-489b-a168-88b835b14922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e16cdfc9d9641cda100489125167b1a, user_id=8f7d5aa76a1649ff9a3ae457d73dd89d, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:34.737847 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447eb18b-f757-489b-a168-88b835b14922 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:34.751225 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 997/1977] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:34.751755 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 981/1978] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:34 2022] PUT /identity/v3/projects/5e16cdfc9d9641cda100489125167b1a/users/8f7d5aa76a1649ff9a3ae457d73dd89d/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:34.755522 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480e91e-894e-4ae5-ac9f-488e269b1cdf None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:34.760646 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447eb18b-f757-489b-a168-88b835b14922 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:34.762454 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-447eb18b-f757-489b-a168-88b835b14922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:34.764682 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480e91e-894e-4ae5-ac9f-488e269b1cdf None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:34.818396 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447eb18b-f757-489b-a168-88b835b14922 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:34.820024 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3301bdc-ace6-4052-892e-3bc9b7aecb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:34.820699 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3301bdc-ace6-4052-892e-3bc9b7aecb8d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:34.821012 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3301bdc-ace6-4052-892e-3bc9b7aecb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:34.821283 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3301bdc-ace6-4052-892e-3bc9b7aecb8d admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:34.821994 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3301bdc-ace6-4052-892e-3bc9b7aecb8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:34.822099 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5ca61-ec49-4044-b5d0-f67762f8b3e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:34.822765 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5ca61-ec49-4044-b5d0-f67762f8b3e8 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:34.823058 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5ca61-ec49-4044-b5d0-f67762f8b3e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:34.823337 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5ca61-ec49-4044-b5d0-f67762f8b3e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:34.823596 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3301bdc-ace6-4052-892e-3bc9b7aecb8d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:34.833464 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5ca61-ec49-4044-b5d0-f67762f8b3e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:34.835028 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5ca61-ec49-4044-b5d0-f67762f8b3e8 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:34.839312 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 998/1979] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:51:34.840314 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3301bdc-ace6-4052-892e-3bc9b7aecb8d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:34.845579 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 982/1980] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:51:34.850185 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3301bdc-ace6-4052-892e-3bc9b7aecb8d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:34.854951 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7a9f2-fc32-4451-8019-4551faee525e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:34.855871 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7a9f2-fc32-4451-8019-4551faee525e admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:34.856146 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7a9f2-fc32-4451-8019-4551faee525e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:34.856420 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7a9f2-fc32-4451-8019-4551faee525e admin admin] PATH_INFO: `/v3/projects/5e16cdfc9d9641cda100489125167b1a/users/8f7d5aa76a1649ff9a3ae457d73dd89d/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:34.858424 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7a9f2-fc32-4451-8019-4551faee525e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e16cdfc9d9641cda100489125167b1a, user_id=8f7d5aa76a1649ff9a3ae457d73dd89d, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:34.861236 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7a9f2-fc32-4451-8019-4551faee525e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:34.872223 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 999/1981] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:34 2022] PUT /identity/v3/projects/5e16cdfc9d9641cda100489125167b1a/users/8f7d5aa76a1649ff9a3ae457d73dd89d/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:35.288500 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5ca61-ec49-4044-b5d0-f67762f8b3e8 service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:35.290702 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-79d5ca61-ec49-4044-b5d0-f67762f8b3e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:35.313522 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5ca61-ec49-4044-b5d0-f67762f8b3e8 service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:35.380155 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c2913-f6bc-442d-a6b9-f1d4572af22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:35.381669 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c2913-f6bc-442d-a6b9-f1d4572af22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:35.382048 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c2913-f6bc-442d-a6b9-f1d4572af22f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:35.382368 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c2913-f6bc-442d-a6b9-f1d4572af22f admin admin] PATH_INFO: `/v3/projects/3e9010065c7e44eb84e1dc0caa4a7f22` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:35.383764 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c2913-f6bc-442d-a6b9-f1d4572af22f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e9010065c7e44eb84e1dc0caa4a7f22)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:35.385803 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c2913-f6bc-442d-a6b9-f1d4572af22f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:35.441375 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c92c2913-f6bc-442d-a6b9-f1d4572af22f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e9010065c7e44eb84e1dc0caa4a7f22', 'request_id': 'req-c92c2913-f6bc-442d-a6b9-f1d4572af22f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:35.460728 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c92c2913-f6bc-442d-a6b9-f1d4572af22f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e9010065c7e44eb84e1dc0caa4a7f22', 'request_id': 'req-c92c2913-f6bc-442d-a6b9-f1d4572af22f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:35.472539 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c92c2913-f6bc-442d-a6b9-f1d4572af22f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e9010065c7e44eb84e1dc0caa4a7f22', 'request_id': 'req-c92c2913-f6bc-442d-a6b9-f1d4572af22f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:35.486939 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c92c2913-f6bc-442d-a6b9-f1d4572af22f admin admin] The token cache is being invalidate because project 3e9010065c7e44eb84e1dc0caa4a7f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:35.487595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c92c2913-f6bc-442d-a6b9-f1d4572af22f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:35.488516 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c92c2913-f6bc-442d-a6b9-f1d4572af22f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:35.490618 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 983/1982] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:35 2022] DELETE /identity/v3/projects/3e9010065c7e44eb84e1dc0caa4a7f22 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:35.496828 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af78df2-7d8b-4eb5-b24a-2286f09dde2f None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:35.497401 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af78df2-7d8b-4eb5-b24a-2286f09dde2f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:35.497401 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af78df2-7d8b-4eb5-b24a-2286f09dde2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:35.518829 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-2af78df2-7d8b-4eb5-b24a-2286f09dde2f None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:35.520331 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-2af78df2-7d8b-4eb5-b24a-2286f09dde2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:35.625377 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1000/1983] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:35.633343 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8dfe1-78d0-43ad-b68b-e335f9a7e978 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:35.633782 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8dfe1-78d0-43ad-b68b-e335f9a7e978 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:35.634222 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8dfe1-78d0-43ad-b68b-e335f9a7e978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:35.672080 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-48c8dfe1-78d0-43ad-b68b-e335f9a7e978 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:35.672224 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af78df2-7d8b-4eb5-b24a-2286f09dde2f None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:35.673614 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-2af78df2-7d8b-4eb5-b24a-2286f09dde2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:35.676636 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-48c8dfe1-78d0-43ad-b68b-e335f9a7e978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:35.692923 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 984/1984] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:35.694770 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8dfe1-78d0-43ad-b68b-e335f9a7e978 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:35.705881 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8dfe1-78d0-43ad-b68b-e335f9a7e978 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:35.728759 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e8cfd-a6c1-47d8-a7e2-1da688c8a243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:35.729536 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e8cfd-a6c1-47d8-a7e2-1da688c8a243 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:35.729872 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e8cfd-a6c1-47d8-a7e2-1da688c8a243 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:35.730154 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e8cfd-a6c1-47d8-a7e2-1da688c8a243 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:35.730955 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e8cfd-a6c1-47d8-a7e2-1da688c8a243 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:51:35.731269 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e8cfd-a6c1-47d8-a7e2-1da688c8a243 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:35.732959 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e8cfd-a6c1-47d8-a7e2-1da688c8a243 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:35.762734 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af78df2-7d8b-4eb5-b24a-2286f09dde2f None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:35.768562 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adcbee-c44b-412b-a936-f402d80001da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:35.769337 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adcbee-c44b-412b-a936-f402d80001da service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:35.770291 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adcbee-c44b-412b-a936-f402d80001da service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:35.770411 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 985/1985] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:51:35.770872 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adcbee-c44b-412b-a936-f402d80001da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:35.774808 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-99adcbee-c44b-412b-a936-f402d80001da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:35.775422 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e8cfd-a6c1-47d8-a7e2-1da688c8a243 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:35.795213 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e8cfd-a6c1-47d8-a7e2-1da688c8a243 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:35.801193 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b657d6a-a8cb-4d92-bdd9-09c1d566c8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:35.802208 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b657d6a-a8cb-4d92-bdd9-09c1d566c8fe admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:35.802644 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b657d6a-a8cb-4d92-bdd9-09c1d566c8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:35.803081 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b657d6a-a8cb-4d92-bdd9-09c1d566c8fe admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:35.803956 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b657d6a-a8cb-4d92-bdd9-09c1d566c8fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:35.806139 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b657d6a-a8cb-4d92-bdd9-09c1d566c8fe admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:35.855082 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adcbee-c44b-412b-a936-f402d80001da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:35.855244 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 986/1986] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:35 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:51:35.855488 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502caa1-ab34-49ba-b70f-9482a777108a None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:35.855803 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502caa1-ab34-49ba-b70f-9482a777108a None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:35.856065 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502caa1-ab34-49ba-b70f-9482a777108a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:35.857911 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adcbee-c44b-412b-a936-f402d80001da service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:35.872491 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1001/1987] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:51:35.874590 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adcbee-c44b-412b-a936-f402d80001da service cinder] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:35.896084 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adcbee-c44b-412b-a936-f402d80001da service cinder] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:35.917683 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-2502caa1-ab34-49ba-b70f-9482a777108a None None] MFA Rules not processed for user `8f7d5aa76a1649ff9a3ae457d73dd89d`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:35.918874 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-2502caa1-ab34-49ba-b70f-9482a777108a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:36.013621 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a9c64-4c0f-4298-8625-d17810434bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:36.014710 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a9c64-4c0f-4298-8625-d17810434bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:36.014906 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a9c64-4c0f-4298-8625-d17810434bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:36.015167 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a9c64-4c0f-4298-8625-d17810434bf4 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:36.015925 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a9c64-4c0f-4298-8625-d17810434bf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:36.018516 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a9c64-4c0f-4298-8625-d17810434bf4 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:36.043028 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 987/1988] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:35 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:36.046312 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1002/1989] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:35 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:36.051007 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502caa1-ab34-49ba-b70f-9482a777108a None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:36.071919 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502caa1-ab34-49ba-b70f-9482a777108a None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:36.079311 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726d2e8-1bf4-45f8-b78e-35ea83fd23f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:36.080127 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726d2e8-1bf4-45f8-b78e-35ea83fd23f3 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:36.080494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726d2e8-1bf4-45f8-b78e-35ea83fd23f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:36.081033 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726d2e8-1bf4-45f8-b78e-35ea83fd23f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:36.081832 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726d2e8-1bf4-45f8-b78e-35ea83fd23f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:36.083573 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726d2e8-1bf4-45f8-b78e-35ea83fd23f3 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:36.097964 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 988/1990] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:51:36.101218 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a9c64-4c0f-4298-8625-d17810434bf4 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:36.113048 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a9c64-4c0f-4298-8625-d17810434bf4 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:36.118921 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac72c0-ca25-404d-8502-32facdc281a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:36.119781 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac72c0-ca25-404d-8502-32facdc281a6 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:36.120071 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac72c0-ca25-404d-8502-32facdc281a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:36.120391 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac72c0-ca25-404d-8502-32facdc281a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:36.121184 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac72c0-ca25-404d-8502-32facdc281a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:36.123013 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac72c0-ca25-404d-8502-32facdc281a6 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:36.139494 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1003/1991] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:36.143375 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726d2e8-1bf4-45f8-b78e-35ea83fd23f3 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:36.156894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726d2e8-1bf4-45f8-b78e-35ea83fd23f3 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:36.162466 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a491edb-b222-4676-aaec-900f08354b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:36.163414 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a491edb-b222-4676-aaec-900f08354b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:36.163696 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a491edb-b222-4676-aaec-900f08354b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:36.163968 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a491edb-b222-4676-aaec-900f08354b16 admin admin] PATH_INFO: `/v3/projects/e3f54fd1f7f34406a51067e6a54060a6/users/ee1f9ff394734a369aa6fb0bec8f088f/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:36.182952 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a491edb-b222-4676-aaec-900f08354b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f54fd1f7f34406a51067e6a54060a6, user_id=ee1f9ff394734a369aa6fb0bec8f088f, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:36.186194 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a491edb-b222-4676-aaec-900f08354b16 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:36.204768 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 989/1992] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:36 2022] PUT /identity/v3/projects/e3f54fd1f7f34406a51067e6a54060a6/users/ee1f9ff394734a369aa6fb0bec8f088f/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:36.214659 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd257c-894d-4eb8-8b98-d6bbb1baa3e2 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:36.214953 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd257c-894d-4eb8-8b98-d6bbb1baa3e2 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:36.215237 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd257c-894d-4eb8-8b98-d6bbb1baa3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:36.249145 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-96cd257c-894d-4eb8-8b98-d6bbb1baa3e2 None None] MFA Rules not processed for user `ee1f9ff394734a369aa6fb0bec8f088f`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:36.250479 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-96cd257c-894d-4eb8-8b98-d6bbb1baa3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:36.362418 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1004/1993] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:36.386876 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a491edb-b222-4676-aaec-900f08354b16 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:36.388673 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-3a491edb-b222-4676-aaec-900f08354b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:36.457170 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a491edb-b222-4676-aaec-900f08354b16 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:36.460806 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40996bd0-5f8f-465c-9603-deee6c97e08a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:36.461793 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40996bd0-5f8f-465c-9603-deee6c97e08a service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:36.461928 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40996bd0-5f8f-465c-9603-deee6c97e08a service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:36.462157 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40996bd0-5f8f-465c-9603-deee6c97e08a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:36.472876 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40996bd0-5f8f-465c-9603-deee6c97e08a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:36.474462 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40996bd0-5f8f-465c-9603-deee6c97e08a service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:36.484871 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 990/1994] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:36.507725 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd257c-894d-4eb8-8b98-d6bbb1baa3e2 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:36.592979 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd257c-894d-4eb8-8b98-d6bbb1baa3e2 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:36.599512 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91843f15-69f2-436f-8674-a59ea50ef390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:36.600537 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91843f15-69f2-436f-8674-a59ea50ef390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:36.600948 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91843f15-69f2-436f-8674-a59ea50ef390 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:36.601314 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91843f15-69f2-436f-8674-a59ea50ef390 admin admin] PATH_INFO: `/v3/users/ee1f9ff394734a369aa6fb0bec8f088f` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:36.602687 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91843f15-69f2-436f-8674-a59ea50ef390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee1f9ff394734a369aa6fb0bec8f088f)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:36.604693 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91843f15-69f2-436f-8674-a59ea50ef390 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:36.658200 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40996bd0-5f8f-465c-9603-deee6c97e08a service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:36.667365 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40996bd0-5f8f-465c-9603-deee6c97e08a service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:36.668282 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-91843f15-69f2-436f-8674-a59ea50ef390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee1f9ff394734a369aa6fb0bec8f088f'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:36.669357 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-91843f15-69f2-436f-8674-a59ea50ef390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee1f9ff394734a369aa6fb0bec8f088f'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:36.670350 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-91843f15-69f2-436f-8674-a59ea50ef390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee1f9ff394734a369aa6fb0bec8f088f'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:36.672027 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dae6d7-8d40-4d21-a7fa-8b6525c20002 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:36.672936 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dae6d7-8d40-4d21-a7fa-8b6525c20002 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:36.673282 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dae6d7-8d40-4d21-a7fa-8b6525c20002 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:36.673620 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dae6d7-8d40-4d21-a7fa-8b6525c20002 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:36.675688 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-a8dae6d7-8d40-4d21-a7fa-8b6525c20002 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:36.688529 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-91843f15-69f2-436f-8674-a59ea50ef390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee1f9ff394734a369aa6fb0bec8f088f'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:36.696612 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-91843f15-69f2-436f-8674-a59ea50ef390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee1f9ff394734a369aa6fb0bec8f088f'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:36.711521 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1005/1995] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:36 2022] DELETE /identity/v3/users/ee1f9ff394734a369aa6fb0bec8f088f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:36.716151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71acf47-bd85-4960-914c-9e27be46e584 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:36.716553 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71acf47-bd85-4960-914c-9e27be46e584 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:36.716738 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71acf47-bd85-4960-914c-9e27be46e584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:36.737808 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-e71acf47-bd85-4960-914c-9e27be46e584 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:36.739001 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-e71acf47-bd85-4960-914c-9e27be46e584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:36.761930 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dae6d7-8d40-4d21-a7fa-8b6525c20002 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:36.763391 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dae6d7-8d40-4d21-a7fa-8b6525c20002 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:36.778865 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 991/1996] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:36.841119 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1006/1997] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:36.850520 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dae6d7-8d40-4d21-a7fa-8b6525c20002 service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:36.854536 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-a8dae6d7-8d40-4d21-a7fa-8b6525c20002 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:36.947300 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dae6d7-8d40-4d21-a7fa-8b6525c20002 service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:37.001881 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7fb5c-6f91-474d-9515-235bd680f60c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:37.003438 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7fb5c-6f91-474d-9515-235bd680f60c service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:37.003438 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7fb5c-6f91-474d-9515-235bd680f60c service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:37.003438 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7fb5c-6f91-474d-9515-235bd680f60c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:37.013564 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7fb5c-6f91-474d-9515-235bd680f60c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:37.015258 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7fb5c-6f91-474d-9515-235bd680f60c service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:37.029259 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 992/1998] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:37.293473 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71acf47-bd85-4960-914c-9e27be46e584 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:37.294859 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-e71acf47-bd85-4960-914c-9e27be46e584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:37.313008 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71acf47-bd85-4960-914c-9e27be46e584 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:37.318652 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93608b-83f5-4dd3-801e-040c8ec81154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:37.319388 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93608b-83f5-4dd3-801e-040c8ec81154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:37.319669 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93608b-83f5-4dd3-801e-040c8ec81154 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:37.319942 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93608b-83f5-4dd3-801e-040c8ec81154 admin admin] PATH_INFO: `/v3/projects/e3f54fd1f7f34406a51067e6a54060a6` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:37.321306 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93608b-83f5-4dd3-801e-040c8ec81154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3f54fd1f7f34406a51067e6a54060a6)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:37.323227 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93608b-83f5-4dd3-801e-040c8ec81154 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:37.381118 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7fb5c-6f91-474d-9515-235bd680f60c service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:37.381788 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6d93608b-83f5-4dd3-801e-040c8ec81154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3f54fd1f7f34406a51067e6a54060a6', 'request_id': 'req-6d93608b-83f5-4dd3-801e-040c8ec81154'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:37.383826 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-66e7fb5c-6f91-474d-9515-235bd680f60c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:37.388692 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6d93608b-83f5-4dd3-801e-040c8ec81154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3f54fd1f7f34406a51067e6a54060a6', 'request_id': 'req-6d93608b-83f5-4dd3-801e-040c8ec81154'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:37.400260 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6d93608b-83f5-4dd3-801e-040c8ec81154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3f54fd1f7f34406a51067e6a54060a6', 'request_id': 'req-6d93608b-83f5-4dd3-801e-040c8ec81154'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:37.401450 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7fb5c-6f91-474d-9515-235bd680f60c service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:37.414084 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6d93608b-83f5-4dd3-801e-040c8ec81154 admin admin] The token cache is being invalidate because project e3f54fd1f7f34406a51067e6a54060a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:37.414544 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6d93608b-83f5-4dd3-801e-040c8ec81154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:37.415003 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6d93608b-83f5-4dd3-801e-040c8ec81154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:37.420951 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1007/1999] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:37 2022] DELETE /identity/v3/projects/e3f54fd1f7f34406a51067e6a54060a6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:37.425426 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d509b-268e-4075-9c2b-86342fcfc0c4 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:37.425773 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d509b-268e-4075-9c2b-86342fcfc0c4 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:37.426065 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d509b-268e-4075-9c2b-86342fcfc0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:37.445196 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-d47d509b-268e-4075-9c2b-86342fcfc0c4 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:37.446389 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-d47d509b-268e-4075-9c2b-86342fcfc0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:37.466117 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320539b-e02c-4e39-bbb4-f9eb29c23325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:37.473394 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320539b-e02c-4e39-bbb4-f9eb29c23325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:37.473919 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320539b-e02c-4e39-bbb4-f9eb29c23325 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:37.474199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320539b-e02c-4e39-bbb4-f9eb29c23325 admin admin] PATH_INFO: `/v3/users/915acf56aabb4774b317c9adb40f8e03` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:37.475573 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320539b-e02c-4e39-bbb4-f9eb29c23325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=915acf56aabb4774b317c9adb40f8e03)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:37.477562 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320539b-e02c-4e39-bbb4-f9eb29c23325 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:37.505540 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1008/2000] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:37.514443 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ecec7-3975-4196-af36-13a27130dccb None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:37.515423 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ecec7-3975-4196-af36-13a27130dccb None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:37.515879 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ecec7-3975-4196-af36-13a27130dccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:37.530803 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-5320539b-e02c-4e39-bbb4-f9eb29c23325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '915acf56aabb4774b317c9adb40f8e03'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:37.539495 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-171ecec7-3975-4196-af36-13a27130dccb None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:37.540678 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-171ecec7-3975-4196-af36-13a27130dccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:37.546240 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-5320539b-e02c-4e39-bbb4-f9eb29c23325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '915acf56aabb4774b317c9adb40f8e03'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:37.553822 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1009/2001] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:37.554772 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ecec7-3975-4196-af36-13a27130dccb None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:37.558251 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-5320539b-e02c-4e39-bbb4-f9eb29c23325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '915acf56aabb4774b317c9adb40f8e03'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:37.566352 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ecec7-3975-4196-af36-13a27130dccb None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:37.570442 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-5320539b-e02c-4e39-bbb4-f9eb29c23325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '915acf56aabb4774b317c9adb40f8e03'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:37.571260 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-5320539b-e02c-4e39-bbb4-f9eb29c23325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '915acf56aabb4774b317c9adb40f8e03'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:37.573791 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5640fc-98da-4b26-9a52-8872d06785e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:37.574694 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5640fc-98da-4b26-9a52-8872d06785e4 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:37.574971 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5640fc-98da-4b26-9a52-8872d06785e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:37.575242 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5640fc-98da-4b26-9a52-8872d06785e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:37.575978 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5640fc-98da-4b26-9a52-8872d06785e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:51:37.576280 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5640fc-98da-4b26-9a52-8872d06785e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:37.577888 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5640fc-98da-4b26-9a52-8872d06785e4 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:37.578835 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 993/2002] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:37 2022] DELETE /identity/v3/users/915acf56aabb4774b317c9adb40f8e03 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:37.590560 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1010/2003] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:51:37.598153 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320539b-e02c-4e39-bbb4-f9eb29c23325 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:37.599620 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-5320539b-e02c-4e39-bbb4-f9eb29c23325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:37.665459 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320539b-e02c-4e39-bbb4-f9eb29c23325 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:37.669994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ae38e-9326-4ecf-9c53-02501205564e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:37.670654 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ae38e-9326-4ecf-9c53-02501205564e admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:37.670937 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ae38e-9326-4ecf-9c53-02501205564e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:37.671209 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ae38e-9326-4ecf-9c53-02501205564e admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:37.671976 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ae38e-9326-4ecf-9c53-02501205564e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:37.673911 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ae38e-9326-4ecf-9c53-02501205564e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:37.704132 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 994/2004] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:37 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:37.705312 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5640fc-98da-4b26-9a52-8872d06785e4 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:37.715644 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5640fc-98da-4b26-9a52-8872d06785e4 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:37.760247 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ae38e-9326-4ecf-9c53-02501205564e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:37.761999 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-6b5ae38e-9326-4ecf-9c53-02501205564e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:37.778720 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760079d-c623-4240-9af3-97f78322ea14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:37.779405 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760079d-c623-4240-9af3-97f78322ea14 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:37.779706 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760079d-c623-4240-9af3-97f78322ea14 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:37.780747 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760079d-c623-4240-9af3-97f78322ea14 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:37.781544 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760079d-c623-4240-9af3-97f78322ea14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:37.783488 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760079d-c623-4240-9af3-97f78322ea14 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:37.808048 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1011/2005] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:37 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:51:37.811945 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760079d-c623-4240-9af3-97f78322ea14 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:37.821804 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760079d-c623-4240-9af3-97f78322ea14 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:37.827691 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a97f6b-4735-4a13-882f-5882434a0a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:37.829111 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a97f6b-4735-4a13-882f-5882434a0a6a admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:37.829472 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a97f6b-4735-4a13-882f-5882434a0a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:37.829866 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a97f6b-4735-4a13-882f-5882434a0a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:37.830623 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a97f6b-4735-4a13-882f-5882434a0a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:37.832229 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a97f6b-4735-4a13-882f-5882434a0a6a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:37.832946 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ae38e-9326-4ecf-9c53-02501205564e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:37.837665 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0127538-5c09-47bc-b08b-6599a4b6a488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:37.838536 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0127538-5c09-47bc-b08b-6599a4b6a488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:37.838823 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0127538-5c09-47bc-b08b-6599a4b6a488 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:37.839102 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0127538-5c09-47bc-b08b-6599a4b6a488 admin admin] PATH_INFO: `/v3/projects/ca032d0195914a6ca83d4db4967d1e70` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:37.840299 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0127538-5c09-47bc-b08b-6599a4b6a488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca032d0195914a6ca83d4db4967d1e70)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:37.842279 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0127538-5c09-47bc-b08b-6599a4b6a488 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:37.844896 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1012/2006] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:51:37.846578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a97f6b-4735-4a13-882f-5882434a0a6a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:37.856205 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a97f6b-4735-4a13-882f-5882434a0a6a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:37.861153 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f24712-4bcf-42d3-ace4-89e2176f7cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:37.861826 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f24712-4bcf-42d3-ace4-89e2176f7cde admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:37.862161 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f24712-4bcf-42d3-ace4-89e2176f7cde admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:37.862433 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f24712-4bcf-42d3-ace4-89e2176f7cde admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:37.863222 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f24712-4bcf-42d3-ace4-89e2176f7cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:37.866908 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f24712-4bcf-42d3-ace4-89e2176f7cde admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:37.881760 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1013/2007] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:51:37.883021 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f24712-4bcf-42d3-ace4-89e2176f7cde admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:37.890704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e0127538-5c09-47bc-b08b-6599a4b6a488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca032d0195914a6ca83d4db4967d1e70', 'request_id': 'req-e0127538-5c09-47bc-b08b-6599a4b6a488'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:37.892487 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f24712-4bcf-42d3-ace4-89e2176f7cde admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:37.898052 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e0127538-5c09-47bc-b08b-6599a4b6a488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca032d0195914a6ca83d4db4967d1e70', 'request_id': 'req-e0127538-5c09-47bc-b08b-6599a4b6a488'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:37.907257 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e0127538-5c09-47bc-b08b-6599a4b6a488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca032d0195914a6ca83d4db4967d1e70', 'request_id': 'req-e0127538-5c09-47bc-b08b-6599a4b6a488'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:37.920999 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e0127538-5c09-47bc-b08b-6599a4b6a488 admin admin] The token cache is being invalidate because project ca032d0195914a6ca83d4db4967d1e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:37.921412 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e0127538-5c09-47bc-b08b-6599a4b6a488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:37.922119 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e0127538-5c09-47bc-b08b-6599a4b6a488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:37.923820 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 995/2008] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:37 2022] DELETE /identity/v3/projects/ca032d0195914a6ca83d4db4967d1e70 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:37.927899 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0127538-5c09-47bc-b08b-6599a4b6a488 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:37.929304 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-e0127538-5c09-47bc-b08b-6599a4b6a488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:37.949563 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61535121-9b30-4a76-ab8e-618c0167b1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:37.950617 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61535121-9b30-4a76-ab8e-618c0167b1dc admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:37.950902 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61535121-9b30-4a76-ab8e-618c0167b1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:37.951181 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61535121-9b30-4a76-ab8e-618c0167b1dc admin admin] PATH_INFO: `/v3/projects/86585fdba5604a99a7cd38964c217480/users/c1b5d04c5442400286d6dce123a2dd59/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:37.974579 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61535121-9b30-4a76-ab8e-618c0167b1dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=86585fdba5604a99a7cd38964c217480, user_id=c1b5d04c5442400286d6dce123a2dd59, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:37.977259 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61535121-9b30-4a76-ab8e-618c0167b1dc admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:38.004956 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1014/2009] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:37 2022] PUT /identity/v3/projects/86585fdba5604a99a7cd38964c217480/users/c1b5d04c5442400286d6dce123a2dd59/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:38.009273 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde16c5d-f4ff-41d0-bff1-cdccd3c2204e None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:38.010005 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde16c5d-f4ff-41d0-bff1-cdccd3c2204e None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:38.010436 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde16c5d-f4ff-41d0-bff1-cdccd3c2204e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:38.036302 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0127538-5c09-47bc-b08b-6599a4b6a488 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:38.048599 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-fde16c5d-f4ff-41d0-bff1-cdccd3c2204e None None] MFA Rules not processed for user `c1b5d04c5442400286d6dce123a2dd59`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:38.049865 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-fde16c5d-f4ff-41d0-bff1-cdccd3c2204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:38.122125 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4bd19-45f7-4462-83ab-c2a249faa737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:38.123239 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4bd19-45f7-4462-83ab-c2a249faa737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:38.123621 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4bd19-45f7-4462-83ab-c2a249faa737 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:38.123997 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4bd19-45f7-4462-83ab-c2a249faa737 admin admin] PATH_INFO: `/v3/users/8f7d5aa76a1649ff9a3ae457d73dd89d` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:38.126970 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4bd19-45f7-4462-83ab-c2a249faa737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f7d5aa76a1649ff9a3ae457d73dd89d)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:38.129287 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4bd19-45f7-4462-83ab-c2a249faa737 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:38.142544 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1015/2010] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:38.148585 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde16c5d-f4ff-41d0-bff1-cdccd3c2204e None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:38.154890 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-fde16c5d-f4ff-41d0-bff1-cdccd3c2204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:38.195264 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde16c5d-f4ff-41d0-bff1-cdccd3c2204e None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:38.200894 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6e259-53e0-455a-8541-25792afabf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:38.201607 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6e259-53e0-455a-8541-25792afabf0f admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:38.201939 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6e259-53e0-455a-8541-25792afabf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:38.202218 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6e259-53e0-455a-8541-25792afabf0f admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:38.203077 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6e259-53e0-455a-8541-25792afabf0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:38.205218 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6e259-53e0-455a-8541-25792afabf0f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:38.227936 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-38a4bd19-45f7-4462-83ab-c2a249faa737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f7d5aa76a1649ff9a3ae457d73dd89d'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:38.241962 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1016/2011] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:38 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:38.245998 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6e259-53e0-455a-8541-25792afabf0f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:38.251350 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-38a4bd19-45f7-4462-83ab-c2a249faa737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f7d5aa76a1649ff9a3ae457d73dd89d'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:38.269580 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-38a4bd19-45f7-4462-83ab-c2a249faa737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f7d5aa76a1649ff9a3ae457d73dd89d'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:38.280948 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-38a4bd19-45f7-4462-83ab-c2a249faa737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f7d5aa76a1649ff9a3ae457d73dd89d'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:38.281654 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-38a4bd19-45f7-4462-83ab-c2a249faa737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f7d5aa76a1649ff9a3ae457d73dd89d'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:38.290307 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 996/2012] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:37 2022] DELETE /identity/v3/users/8f7d5aa76a1649ff9a3ae457d73dd89d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:38.355561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6e259-53e0-455a-8541-25792afabf0f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:38.413032 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88240fb9-7ead-4d0e-a16e-d9317ce7f970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:38.413740 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88240fb9-7ead-4d0e-a16e-d9317ce7f970 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:38.414024 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88240fb9-7ead-4d0e-a16e-d9317ce7f970 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:38.414300 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88240fb9-7ead-4d0e-a16e-d9317ce7f970 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:38.415003 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88240fb9-7ead-4d0e-a16e-d9317ce7f970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:38.416921 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88240fb9-7ead-4d0e-a16e-d9317ce7f970 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:38.443985 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1017/2013] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:38 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:38.448311 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4bd19-45f7-4462-83ab-c2a249faa737 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:38.450823 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-38a4bd19-45f7-4462-83ab-c2a249faa737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:38.466051 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4bd19-45f7-4462-83ab-c2a249faa737 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:38.471733 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698be56-3cf0-4181-9a18-0bc75b98e675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:38.472789 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698be56-3cf0-4181-9a18-0bc75b98e675 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:38.473537 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698be56-3cf0-4181-9a18-0bc75b98e675 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:38.473537 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698be56-3cf0-4181-9a18-0bc75b98e675 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:38.474433 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698be56-3cf0-4181-9a18-0bc75b98e675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:38.476372 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698be56-3cf0-4181-9a18-0bc75b98e675 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:38.482170 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88240fb9-7ead-4d0e-a16e-d9317ce7f970 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:38.485400 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-88240fb9-7ead-4d0e-a16e-d9317ce7f970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:38.488179 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 997/2014] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:51:38.498306 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698be56-3cf0-4181-9a18-0bc75b98e675 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:38.503536 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88240fb9-7ead-4d0e-a16e-d9317ce7f970 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:38.508525 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac5043-bb3e-4d8c-8b64-5e8d48d56f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:38.509542 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac5043-bb3e-4d8c-8b64-5e8d48d56f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:38.509812 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac5043-bb3e-4d8c-8b64-5e8d48d56f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:38.509984 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac5043-bb3e-4d8c-8b64-5e8d48d56f4a admin admin] PATH_INFO: `/v3/projects/5e16cdfc9d9641cda100489125167b1a` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:38.511195 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac5043-bb3e-4d8c-8b64-5e8d48d56f4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e16cdfc9d9641cda100489125167b1a)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:38.511468 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698be56-3cf0-4181-9a18-0bc75b98e675 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:38.513096 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac5043-bb3e-4d8c-8b64-5e8d48d56f4a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:38.517343 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94757d-e6e5-4d9d-9757-d39359d6f207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:38.518251 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94757d-e6e5-4d9d-9757-d39359d6f207 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:38.518518 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94757d-e6e5-4d9d-9757-d39359d6f207 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:38.518764 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94757d-e6e5-4d9d-9757-d39359d6f207 admin admin] PATH_INFO: `/v3/projects/6ddb249d1a0c43ae8af96c501a25e8d4/users/9e84b758c2a742c69c22e1627490e772/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:38.538426 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94757d-e6e5-4d9d-9757-d39359d6f207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ddb249d1a0c43ae8af96c501a25e8d4, user_id=9e84b758c2a742c69c22e1627490e772, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:38.541112 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94757d-e6e5-4d9d-9757-d39359d6f207 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:38.566608 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 998/2015] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:38 2022] PUT /identity/v3/projects/6ddb249d1a0c43ae8af96c501a25e8d4/users/9e84b758c2a742c69c22e1627490e772/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:38.568564 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043e8f0-aaa9-475d-8cf4-cba0bfd3665b None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:38.568879 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043e8f0-aaa9-475d-8cf4-cba0bfd3665b None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:38.569159 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043e8f0-aaa9-475d-8cf4-cba0bfd3665b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:38.573474 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-47ac5043-bb3e-4d8c-8b64-5e8d48d56f4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e16cdfc9d9641cda100489125167b1a', 'request_id': 'req-47ac5043-bb3e-4d8c-8b64-5e8d48d56f4a'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:38.578965 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-47ac5043-bb3e-4d8c-8b64-5e8d48d56f4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e16cdfc9d9641cda100489125167b1a', 'request_id': 'req-47ac5043-bb3e-4d8c-8b64-5e8d48d56f4a'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:38.587366 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-7043e8f0-aaa9-475d-8cf4-cba0bfd3665b None None] MFA Rules not processed for user `3284aee452cd4b0483a2044d36a3e357`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:38.588117 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-47ac5043-bb3e-4d8c-8b64-5e8d48d56f4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e16cdfc9d9641cda100489125167b1a', 'request_id': 'req-47ac5043-bb3e-4d8c-8b64-5e8d48d56f4a'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:38.589104 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-7043e8f0-aaa9-475d-8cf4-cba0bfd3665b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:38.600726 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-47ac5043-bb3e-4d8c-8b64-5e8d48d56f4a admin admin] The token cache is being invalidate because project 5e16cdfc9d9641cda100489125167b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:38.600832 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-47ac5043-bb3e-4d8c-8b64-5e8d48d56f4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:38.601474 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-47ac5043-bb3e-4d8c-8b64-5e8d48d56f4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:38.603263 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1018/2016] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:38 2022] DELETE /identity/v3/projects/5e16cdfc9d9641cda100489125167b1a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:38.603869 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac5043-bb3e-4d8c-8b64-5e8d48d56f4a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:38.605146 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-47ac5043-bb3e-4d8c-8b64-5e8d48d56f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:38.647846 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 999/2017] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:38.649766 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3a775-367e-4342-8088-dc643d396a1e None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:38.650058 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3a775-367e-4342-8088-dc643d396a1e None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:38.650413 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3a775-367e-4342-8088-dc643d396a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:38.671880 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-a5e3a775-367e-4342-8088-dc643d396a1e None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:38.673118 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-a5e3a775-367e-4342-8088-dc643d396a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:38.681258 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac5043-bb3e-4d8c-8b64-5e8d48d56f4a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:38.747355 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0f1c4-c07d-4343-bdb8-228ae13a1375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:38.748042 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0f1c4-c07d-4343-bdb8-228ae13a1375 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:38.748326 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0f1c4-c07d-4343-bdb8-228ae13a1375 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:38.748604 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0f1c4-c07d-4343-bdb8-228ae13a1375 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:38.749396 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0f1c4-c07d-4343-bdb8-228ae13a1375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:38.751114 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0f1c4-c07d-4343-bdb8-228ae13a1375 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:38.752552 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1000/2018] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:38.760762 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789af10-e0b5-48ed-a0af-c95b36f46c56 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:38.761093 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789af10-e0b5-48ed-a0af-c95b36f46c56 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:38.761359 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1019/2019] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:38.761487 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789af10-e0b5-48ed-a0af-c95b36f46c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:38.766146 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0f1c4-c07d-4343-bdb8-228ae13a1375 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:38.776399 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0f1c4-c07d-4343-bdb8-228ae13a1375 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:38.782706 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-f789af10-e0b5-48ed-a0af-c95b36f46c56 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:38.782893 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48438151-cfdc-46f5-bb58-81312efa95fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:38.783688 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48438151-cfdc-46f5-bb58-81312efa95fd admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:38.783936 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-f789af10-e0b5-48ed-a0af-c95b36f46c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:38.784046 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48438151-cfdc-46f5-bb58-81312efa95fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:38.784233 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48438151-cfdc-46f5-bb58-81312efa95fd admin admin] PATH_INFO: `/v3/projects/6ddb249d1a0c43ae8af96c501a25e8d4/users/9e84b758c2a742c69c22e1627490e772/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:38.786356 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48438151-cfdc-46f5-bb58-81312efa95fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ddb249d1a0c43ae8af96c501a25e8d4, user_id=9e84b758c2a742c69c22e1627490e772, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:38.789041 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48438151-cfdc-46f5-bb58-81312efa95fd admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:38.792313 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1001/2020] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:38.796958 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789af10-e0b5-48ed-a0af-c95b36f46c56 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:38.810064 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1020/2021] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:38 2022] PUT /identity/v3/projects/6ddb249d1a0c43ae8af96c501a25e8d4/users/9e84b758c2a742c69c22e1627490e772/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:38.810269 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789af10-e0b5-48ed-a0af-c95b36f46c56 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:38.812604 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281eb54c-2b46-43f1-85a1-3bf55d300f4d None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:38.813039 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281eb54c-2b46-43f1-85a1-3bf55d300f4d None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:38.813491 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281eb54c-2b46-43f1-85a1-3bf55d300f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:38.841310 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-281eb54c-2b46-43f1-85a1-3bf55d300f4d None None] MFA Rules not processed for user `9e84b758c2a742c69c22e1627490e772`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:38.842503 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-281eb54c-2b46-43f1-85a1-3bf55d300f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:38.878150 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba03fad-259d-47c2-adff-8e29fbe578a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:38.878817 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba03fad-259d-47c2-adff-8e29fbe578a0 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:38.879093 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba03fad-259d-47c2-adff-8e29fbe578a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:38.879362 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba03fad-259d-47c2-adff-8e29fbe578a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:38.880109 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba03fad-259d-47c2-adff-8e29fbe578a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:51:38.881202 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba03fad-259d-47c2-adff-8e29fbe578a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:38.882044 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba03fad-259d-47c2-adff-8e29fbe578a0 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:38.896795 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1002/2022] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:51:38.901505 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba03fad-259d-47c2-adff-8e29fbe578a0 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:38.911094 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba03fad-259d-47c2-adff-8e29fbe578a0 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:38.915801 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024b28c-97f7-43cb-a533-406a2a4bf719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:38.916555 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024b28c-97f7-43cb-a533-406a2a4bf719 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:38.916927 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024b28c-97f7-43cb-a533-406a2a4bf719 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:38.917517 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024b28c-97f7-43cb-a533-406a2a4bf719 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:38.918038 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024b28c-97f7-43cb-a533-406a2a4bf719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:38.919994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024b28c-97f7-43cb-a533-406a2a4bf719 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:38.926618 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1021/2023] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:38.939156 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281eb54c-2b46-43f1-85a1-3bf55d300f4d None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:38.940678 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-281eb54c-2b46-43f1-85a1-3bf55d300f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:38.952952 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1003/2024] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:38 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:51:38.954265 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024b28c-97f7-43cb-a533-406a2a4bf719 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:39.000820 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281eb54c-2b46-43f1-85a1-3bf55d300f4d None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:39.032324 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024b28c-97f7-43cb-a533-406a2a4bf719 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:39.038226 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6b612-d01f-43ca-8d15-88dabdd07f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:39.038951 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6b612-d01f-43ca-8d15-88dabdd07f22 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:39.039237 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6b612-d01f-43ca-8d15-88dabdd07f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:39.039514 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6b612-d01f-43ca-8d15-88dabdd07f22 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:39.040241 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6b612-d01f-43ca-8d15-88dabdd07f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:39.042337 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6b612-d01f-43ca-8d15-88dabdd07f22 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:39.062477 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63abba-00ef-4959-9982-97705c9e27da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:39.063525 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63abba-00ef-4959-9982-97705c9e27da service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:39.064131 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63abba-00ef-4959-9982-97705c9e27da service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:39.064622 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63abba-00ef-4959-9982-97705c9e27da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:39.065492 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1004/2025] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:38 2022] POST /identity/v3/users => generated 285 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:39.069768 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6b612-d01f-43ca-8d15-88dabdd07f22 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:39.070926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-6b63abba-00ef-4959-9982-97705c9e27da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:39.080249 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6b612-d01f-43ca-8d15-88dabdd07f22 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:39.085348 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023cbd3-46db-4132-8e5e-f3f024762f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:39.086033 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023cbd3-46db-4132-8e5e-f3f024762f1b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:39.086324 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023cbd3-46db-4132-8e5e-f3f024762f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:39.086604 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023cbd3-46db-4132-8e5e-f3f024762f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:39.087386 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023cbd3-46db-4132-8e5e-f3f024762f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:39.089188 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023cbd3-46db-4132-8e5e-f3f024762f1b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:39.103745 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1005/2026] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:51:39.107909 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023cbd3-46db-4132-8e5e-f3f024762f1b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:39.117973 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023cbd3-46db-4132-8e5e-f3f024762f1b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:39.123453 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1af3a-ecf4-40a8-a80d-8de54bb66867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:39.124308 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1af3a-ecf4-40a8-a80d-8de54bb66867 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:39.124598 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1af3a-ecf4-40a8-a80d-8de54bb66867 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:39.124929 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1af3a-ecf4-40a8-a80d-8de54bb66867 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:39.125689 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1af3a-ecf4-40a8-a80d-8de54bb66867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:39.127518 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1af3a-ecf4-40a8-a80d-8de54bb66867 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:39.144761 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1006/2027] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:39.147643 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63abba-00ef-4959-9982-97705c9e27da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:39.149247 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1af3a-ecf4-40a8-a80d-8de54bb66867 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:39.150046 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63abba-00ef-4959-9982-97705c9e27da service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:39.159323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1af3a-ecf4-40a8-a80d-8de54bb66867 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:39.162499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1022/2028] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:51:39.174559 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31500e-e65a-4e3c-8ead-5892d67019d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:39.176975 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31500e-e65a-4e3c-8ead-5892d67019d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:39.176975 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31500e-e65a-4e3c-8ead-5892d67019d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:39.176975 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31500e-e65a-4e3c-8ead-5892d67019d6 admin admin] PATH_INFO: `/v3/projects/e516ec0d15a5419da922c318a3f9fd09/users/96ab74b4c80646fcbd7755ef7c3ba8cb/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:39.197181 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31500e-e65a-4e3c-8ead-5892d67019d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e516ec0d15a5419da922c318a3f9fd09, user_id=96ab74b4c80646fcbd7755ef7c3ba8cb, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:39.200380 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31500e-e65a-4e3c-8ead-5892d67019d6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:39.218351 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1007/2029] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:39 2022] PUT /identity/v3/projects/e516ec0d15a5419da922c318a3f9fd09/users/96ab74b4c80646fcbd7755ef7c3ba8cb/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:39.230082 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0643e-173c-4d6f-9055-29dffc74e320 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:39.230461 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0643e-173c-4d6f-9055-29dffc74e320 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:39.230861 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0643e-173c-4d6f-9055-29dffc74e320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:39.261200 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-75e0643e-173c-4d6f-9055-29dffc74e320 None None] MFA Rules not processed for user `96ab74b4c80646fcbd7755ef7c3ba8cb`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:39.262524 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-75e0643e-173c-4d6f-9055-29dffc74e320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:39.375938 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1023/2030] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:39.380042 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31500e-e65a-4e3c-8ead-5892d67019d6 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:39.474095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31500e-e65a-4e3c-8ead-5892d67019d6 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:39.476042 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecd0a8-dfba-4708-b33f-39d66a0ef9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:39.476992 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecd0a8-dfba-4708-b33f-39d66a0ef9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:39.477282 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecd0a8-dfba-4708-b33f-39d66a0ef9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:39.477607 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecd0a8-dfba-4708-b33f-39d66a0ef9f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:39.478967 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecd0a8-dfba-4708-b33f-39d66a0ef9f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:39.481121 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecd0a8-dfba-4708-b33f-39d66a0ef9f2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:39.519215 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1008/2031] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:39 2022] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:51:39.524224 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0643e-173c-4d6f-9055-29dffc74e320 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:39.540132 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0643e-173c-4d6f-9055-29dffc74e320 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:39.630980 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcaa29-0aa9-4b19-8a18-a7754adbaef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:39.631731 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcaa29-0aa9-4b19-8a18-a7754adbaef6 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:39.632021 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcaa29-0aa9-4b19-8a18-a7754adbaef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:39.632442 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcaa29-0aa9-4b19-8a18-a7754adbaef6 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:39.633233 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcaa29-0aa9-4b19-8a18-a7754adbaef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:39.635524 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcaa29-0aa9-4b19-8a18-a7754adbaef6 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:39.678415 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1024/2032] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:39 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:39.680685 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecd0a8-dfba-4708-b33f-39d66a0ef9f2 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:39.693818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecd0a8-dfba-4708-b33f-39d66a0ef9f2 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:39.701639 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07c8d6-6387-435e-9b05-2da3c0b64567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:39.702333 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07c8d6-6387-435e-9b05-2da3c0b64567 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:39.702739 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07c8d6-6387-435e-9b05-2da3c0b64567 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:39.702879 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07c8d6-6387-435e-9b05-2da3c0b64567 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:39.703889 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07c8d6-6387-435e-9b05-2da3c0b64567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:39.705569 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07c8d6-6387-435e-9b05-2da3c0b64567 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:39.740614 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1009/2033] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:39.751603 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcaa29-0aa9-4b19-8a18-a7754adbaef6 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:39.764368 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcaa29-0aa9-4b19-8a18-a7754adbaef6 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:39.781158 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b3b26-41b6-40c2-bc17-4db9fc641056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:39.782105 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b3b26-41b6-40c2-bc17-4db9fc641056 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:39.782401 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b3b26-41b6-40c2-bc17-4db9fc641056 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:39.782655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b3b26-41b6-40c2-bc17-4db9fc641056 admin admin] PATH_INFO: `/v3/projects/5a60831736f54c02a8843a79e15368b1/users/eea7290588774eb0b4b3ebc55a302848/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:39.817891 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b3b26-41b6-40c2-bc17-4db9fc641056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a60831736f54c02a8843a79e15368b1, user_id=eea7290588774eb0b4b3ebc55a302848, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:39.822450 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b3b26-41b6-40c2-bc17-4db9fc641056 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:39.876696 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1025/2034] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:39 2022] PUT /identity/v3/projects/5a60831736f54c02a8843a79e15368b1/users/eea7290588774eb0b4b3ebc55a302848/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:39.880634 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07c8d6-6387-435e-9b05-2da3c0b64567 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:39.894098 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07c8d6-6387-435e-9b05-2da3c0b64567 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:39.971236 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3be91f-1777-4214-8c68-16497acefc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:39.971901 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3be91f-1777-4214-8c68-16497acefc4d admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:39.972182 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3be91f-1777-4214-8c68-16497acefc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:39.972455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3be91f-1777-4214-8c68-16497acefc4d admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:39.973230 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3be91f-1777-4214-8c68-16497acefc4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:39.974960 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3be91f-1777-4214-8c68-16497acefc4d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:39.985994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1010/2035] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:51:39.990381 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b3b26-41b6-40c2-bc17-4db9fc641056 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:40.001545 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b3b26-41b6-40c2-bc17-4db9fc641056 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:40.006793 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ffe35-bd12-4113-a9eb-2a881d00d549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:40.007683 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ffe35-bd12-4113-a9eb-2a881d00d549 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:40.007963 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ffe35-bd12-4113-a9eb-2a881d00d549 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:40.008454 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ffe35-bd12-4113-a9eb-2a881d00d549 admin admin] PATH_INFO: `/v3/projects/5a60831736f54c02a8843a79e15368b1/users/eea7290588774eb0b4b3ebc55a302848/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:40.010665 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ffe35-bd12-4113-a9eb-2a881d00d549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a60831736f54c02a8843a79e15368b1, user_id=eea7290588774eb0b4b3ebc55a302848, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:40.013344 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ffe35-bd12-4113-a9eb-2a881d00d549 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:40.024837 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1026/2036] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:39 2022] PUT /identity/v3/projects/5a60831736f54c02a8843a79e15368b1/users/eea7290588774eb0b4b3ebc55a302848/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:40.034840 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5218df-9574-4216-bbf3-21b509c3bac8 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:40.035134 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5218df-9574-4216-bbf3-21b509c3bac8 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:40.035503 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5218df-9574-4216-bbf3-21b509c3bac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:40.066494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-0b5218df-9574-4216-bbf3-21b509c3bac8 None None] MFA Rules not processed for user `eea7290588774eb0b4b3ebc55a302848`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:40.067718 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-0b5218df-9574-4216-bbf3-21b509c3bac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:40.134780 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1011/2037] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:40 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:40.145804 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ffe35-bd12-4113-a9eb-2a881d00d549 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:40.147507 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-9f9ffe35-bd12-4113-a9eb-2a881d00d549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:40.209877 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ffe35-bd12-4113-a9eb-2a881d00d549 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:40.213694 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b4205-87f3-45a1-99b2-49f003503b44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:40.214357 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b4205-87f3-45a1-99b2-49f003503b44 service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:40.214774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b4205-87f3-45a1-99b2-49f003503b44 service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:40.215056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b4205-87f3-45a1-99b2-49f003503b44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:40.224712 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b4205-87f3-45a1-99b2-49f003503b44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:40.226175 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b4205-87f3-45a1-99b2-49f003503b44 service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:40.237690 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1027/2038] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:40 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:51:41.190399 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5218df-9574-4216-bbf3-21b509c3bac8 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:41.192281 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-0b5218df-9574-4216-bbf3-21b509c3bac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:41.281280 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5218df-9574-4216-bbf3-21b509c3bac8 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:41.286187 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc3f54-e77d-459e-b2f2-fd4719908f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:41.287096 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc3f54-e77d-459e-b2f2-fd4719908f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:41.287411 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc3f54-e77d-459e-b2f2-fd4719908f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:41.287685 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc3f54-e77d-459e-b2f2-fd4719908f82 admin admin] PATH_INFO: `/v3/users/f6d805c96d014759af3492a04c7d8318` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:41.288928 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc3f54-e77d-459e-b2f2-fd4719908f82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d805c96d014759af3492a04c7d8318)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:41.290861 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc3f54-e77d-459e-b2f2-fd4719908f82 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:41.350757 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-ccbc3f54-e77d-459e-b2f2-fd4719908f82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d805c96d014759af3492a04c7d8318'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:41.362877 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-ccbc3f54-e77d-459e-b2f2-fd4719908f82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d805c96d014759af3492a04c7d8318'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:41.371123 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-ccbc3f54-e77d-459e-b2f2-fd4719908f82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d805c96d014759af3492a04c7d8318'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:41.383815 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-ccbc3f54-e77d-459e-b2f2-fd4719908f82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d805c96d014759af3492a04c7d8318'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:41.384556 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-ccbc3f54-e77d-459e-b2f2-fd4719908f82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d805c96d014759af3492a04c7d8318'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:41.394192 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1012/2039] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:41 2022] DELETE /identity/v3/users/f6d805c96d014759af3492a04c7d8318 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:41.401423 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcf0c8-5a23-4378-abd6-77d392c61d01 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:41.402505 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcf0c8-5a23-4378-abd6-77d392c61d01 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:41.402969 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcf0c8-5a23-4378-abd6-77d392c61d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:41.429034 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-c2dcf0c8-5a23-4378-abd6-77d392c61d01 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:41.430443 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-c2dcf0c8-5a23-4378-abd6-77d392c61d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:41.507018 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1028/2040] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:41.522965 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc3f54-e77d-459e-b2f2-fd4719908f82 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:41.525177 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-ccbc3f54-e77d-459e-b2f2-fd4719908f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:41.595886 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc3f54-e77d-459e-b2f2-fd4719908f82 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:41.603968 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c85587-bc0d-4c6c-a53b-ffd3c7e2583b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:41.604638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c85587-bc0d-4c6c-a53b-ffd3c7e2583b service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:41.606384 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c85587-bc0d-4c6c-a53b-ffd3c7e2583b service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:41.606384 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c85587-bc0d-4c6c-a53b-ffd3c7e2583b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:41.623054 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c85587-bc0d-4c6c-a53b-ffd3c7e2583b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:41.624506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c85587-bc0d-4c6c-a53b-ffd3c7e2583b service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:41.641873 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1013/2041] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:41.943395 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcf0c8-5a23-4378-abd6-77d392c61d01 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:41.944810 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-c2dcf0c8-5a23-4378-abd6-77d392c61d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:41.956720 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcf0c8-5a23-4378-abd6-77d392c61d01 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:41.961315 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0c67a-6898-4dd9-a50f-38ee7a03359e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:41.962221 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0c67a-6898-4dd9-a50f-38ee7a03359e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:41.962507 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0c67a-6898-4dd9-a50f-38ee7a03359e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:41.962779 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0c67a-6898-4dd9-a50f-38ee7a03359e admin admin] PATH_INFO: `/v3/users/96ab74b4c80646fcbd7755ef7c3ba8cb` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:41.964165 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0c67a-6898-4dd9-a50f-38ee7a03359e admin admin] RBAC: Authorizing `identity:delete_user(user_id=96ab74b4c80646fcbd7755ef7c3ba8cb)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:41.966303 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0c67a-6898-4dd9-a50f-38ee7a03359e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:42.035972 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-dcd0c67a-6898-4dd9-a50f-38ee7a03359e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96ab74b4c80646fcbd7755ef7c3ba8cb'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.036747 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-dcd0c67a-6898-4dd9-a50f-38ee7a03359e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96ab74b4c80646fcbd7755ef7c3ba8cb'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.037592 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-dcd0c67a-6898-4dd9-a50f-38ee7a03359e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96ab74b4c80646fcbd7755ef7c3ba8cb'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.053880 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-dcd0c67a-6898-4dd9-a50f-38ee7a03359e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96ab74b4c80646fcbd7755ef7c3ba8cb'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.061777 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-dcd0c67a-6898-4dd9-a50f-38ee7a03359e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96ab74b4c80646fcbd7755ef7c3ba8cb'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.075462 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1029/2042] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:41 2022] DELETE /identity/v3/users/96ab74b4c80646fcbd7755ef7c3ba8cb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:42.080206 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c3dc6-b599-4337-bed4-b2f642cb2c13 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:42.080494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c3dc6-b599-4337-bed4-b2f642cb2c13 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:42.080788 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c3dc6-b599-4337-bed4-b2f642cb2c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:42.098404 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-d58c3dc6-b599-4337-bed4-b2f642cb2c13 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:42.099704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-d58c3dc6-b599-4337-bed4-b2f642cb2c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:42.166255 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1014/2043] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:42.177044 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0c67a-6898-4dd9-a50f-38ee7a03359e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:42.179171 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-dcd0c67a-6898-4dd9-a50f-38ee7a03359e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:42.250084 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c3dc6-b599-4337-bed4-b2f642cb2c13 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:42.252284 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-d58c3dc6-b599-4337-bed4-b2f642cb2c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:42.273118 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0c67a-6898-4dd9-a50f-38ee7a03359e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:42.275743 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c3dc6-b599-4337-bed4-b2f642cb2c13 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:42.279147 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005125a-ed75-41d8-97b4-940cc1319c97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:42.280737 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005125a-ed75-41d8-97b4-940cc1319c97 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:42.281244 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005125a-ed75-41d8-97b4-940cc1319c97 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:42.281676 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005125a-ed75-41d8-97b4-940cc1319c97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:42.293581 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2258e-4c04-4aef-af47-5f00ed16839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:42.294498 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2258e-4c04-4aef-af47-5f00ed16839a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:42.294778 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2258e-4c04-4aef-af47-5f00ed16839a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:42.295385 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2258e-4c04-4aef-af47-5f00ed16839a admin admin] PATH_INFO: `/v3/projects/cea99edc1a6246c08482f900b7b7f63b` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:42.296308 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005125a-ed75-41d8-97b4-940cc1319c97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:42.298028 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005125a-ed75-41d8-97b4-940cc1319c97 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:42.302978 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2258e-4c04-4aef-af47-5f00ed16839a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cea99edc1a6246c08482f900b7b7f63b)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:42.309885 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2258e-4c04-4aef-af47-5f00ed16839a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:42.318804 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1030/2044] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:42.319803 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005125a-ed75-41d8-97b4-940cc1319c97 service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:42.321152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-6005125a-ed75-41d8-97b4-940cc1319c97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:42.339970 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005125a-ed75-41d8-97b4-940cc1319c97 service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:42.345414 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039caac3-3104-4829-b65e-3549b76a2126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:42.347216 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039caac3-3104-4829-b65e-3549b76a2126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:42.347504 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039caac3-3104-4829-b65e-3549b76a2126 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:42.347793 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039caac3-3104-4829-b65e-3549b76a2126 admin admin] PATH_INFO: `/v3/users/c1b5d04c5442400286d6dce123a2dd59` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:42.349708 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039caac3-3104-4829-b65e-3549b76a2126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b5d04c5442400286d6dce123a2dd59)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:42.351904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039caac3-3104-4829-b65e-3549b76a2126 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:42.403943 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-cac2258e-4c04-4aef-af47-5f00ed16839a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cea99edc1a6246c08482f900b7b7f63b', 'request_id': 'req-cac2258e-4c04-4aef-af47-5f00ed16839a'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.412394 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-cac2258e-4c04-4aef-af47-5f00ed16839a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cea99edc1a6246c08482f900b7b7f63b', 'request_id': 'req-cac2258e-4c04-4aef-af47-5f00ed16839a'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.423122 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-cac2258e-4c04-4aef-af47-5f00ed16839a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cea99edc1a6246c08482f900b7b7f63b', 'request_id': 'req-cac2258e-4c04-4aef-af47-5f00ed16839a'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.437297 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-cac2258e-4c04-4aef-af47-5f00ed16839a admin admin] The token cache is being invalidate because project cea99edc1a6246c08482f900b7b7f63b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:42.438147 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-cac2258e-4c04-4aef-af47-5f00ed16839a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.439105 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-cac2258e-4c04-4aef-af47-5f00ed16839a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.441429 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1015/2045] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:42 2022] DELETE /identity/v3/projects/cea99edc1a6246c08482f900b7b7f63b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:42.442257 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-039caac3-3104-4829-b65e-3549b76a2126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b5d04c5442400286d6dce123a2dd59'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.443068 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-039caac3-3104-4829-b65e-3549b76a2126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b5d04c5442400286d6dce123a2dd59'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.443770 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-039caac3-3104-4829-b65e-3549b76a2126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b5d04c5442400286d6dce123a2dd59'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.445202 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2258e-4c04-4aef-af47-5f00ed16839a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:42.447067 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-cac2258e-4c04-4aef-af47-5f00ed16839a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:42.459558 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-039caac3-3104-4829-b65e-3549b76a2126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b5d04c5442400286d6dce123a2dd59'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.481680 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-039caac3-3104-4829-b65e-3549b76a2126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b5d04c5442400286d6dce123a2dd59'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.501256 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1031/2046] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:42 2022] DELETE /identity/v3/users/c1b5d04c5442400286d6dce123a2dd59 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:42.508844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec62f4c-49ff-4a6b-927e-0727494b6b40 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:42.509558 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec62f4c-49ff-4a6b-927e-0727494b6b40 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:42.510132 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec62f4c-49ff-4a6b-927e-0727494b6b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:42.520386 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2258e-4c04-4aef-af47-5f00ed16839a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:42.536644 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-3ec62f4c-49ff-4a6b-927e-0727494b6b40 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:42.538529 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-3ec62f4c-49ff-4a6b-927e-0727494b6b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:42.612551 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2599631-7605-4e5b-9059-c377d976e44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:42.613591 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2599631-7605-4e5b-9059-c377d976e44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:42.613947 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2599631-7605-4e5b-9059-c377d976e44c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:42.614904 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2599631-7605-4e5b-9059-c377d976e44c admin admin] PATH_INFO: `/v3/users/948143fe86d9407e99eff9ec6c3f1dc8` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:42.615812 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2599631-7605-4e5b-9059-c377d976e44c admin admin] RBAC: Authorizing `identity:delete_user(user_id=948143fe86d9407e99eff9ec6c3f1dc8)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:42.617971 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2599631-7605-4e5b-9059-c377d976e44c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:42.646534 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1032/2047] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:42.664372 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec62f4c-49ff-4a6b-927e-0727494b6b40 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:42.667309 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-3ec62f4c-49ff-4a6b-927e-0727494b6b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:42.703633 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e2599631-7605-4e5b-9059-c377d976e44c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948143fe86d9407e99eff9ec6c3f1dc8'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.731312 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e2599631-7605-4e5b-9059-c377d976e44c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948143fe86d9407e99eff9ec6c3f1dc8'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.742075 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e2599631-7605-4e5b-9059-c377d976e44c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948143fe86d9407e99eff9ec6c3f1dc8'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.761100 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e2599631-7605-4e5b-9059-c377d976e44c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948143fe86d9407e99eff9ec6c3f1dc8'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.761746 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e2599631-7605-4e5b-9059-c377d976e44c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948143fe86d9407e99eff9ec6c3f1dc8'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.771005 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1016/2048] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:42 2022] DELETE /identity/v3/users/948143fe86d9407e99eff9ec6c3f1dc8 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:42.775260 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2599631-7605-4e5b-9059-c377d976e44c admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:42.779173 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-e2599631-7605-4e5b-9059-c377d976e44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:42.792523 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec62f4c-49ff-4a6b-927e-0727494b6b40 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:42.853469 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2599631-7605-4e5b-9059-c377d976e44c admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:42.858526 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a5d5d-31b3-4095-a3d5-a5aa2f7cce34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:42.859725 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a5d5d-31b3-4095-a3d5-a5aa2f7cce34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:42.860072 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a5d5d-31b3-4095-a3d5-a5aa2f7cce34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:42.860345 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a5d5d-31b3-4095-a3d5-a5aa2f7cce34 admin admin] PATH_INFO: `/v3/projects/e516ec0d15a5419da922c318a3f9fd09` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:42.861626 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a5d5d-31b3-4095-a3d5-a5aa2f7cce34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e516ec0d15a5419da922c318a3f9fd09)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:42.863598 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a5d5d-31b3-4095-a3d5-a5aa2f7cce34 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:42.866031 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1489e0-acee-445f-b000-f985d5dceec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:42.866683 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1489e0-acee-445f-b000-f985d5dceec9 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:42.866968 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1489e0-acee-445f-b000-f985d5dceec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:42.867246 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1489e0-acee-445f-b000-f985d5dceec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:42.869114 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-0a1489e0-acee-445f-b000-f985d5dceec9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:42.881901 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1489e0-acee-445f-b000-f985d5dceec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:42.883338 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1489e0-acee-445f-b000-f985d5dceec9 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:42.895937 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1033/2049] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:42.916180 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c54a5d5d-31b3-4095-a3d5-a5aa2f7cce34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e516ec0d15a5419da922c318a3f9fd09', 'request_id': 'req-c54a5d5d-31b3-4095-a3d5-a5aa2f7cce34'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.922748 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c54a5d5d-31b3-4095-a3d5-a5aa2f7cce34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e516ec0d15a5419da922c318a3f9fd09', 'request_id': 'req-c54a5d5d-31b3-4095-a3d5-a5aa2f7cce34'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.930862 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c54a5d5d-31b3-4095-a3d5-a5aa2f7cce34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e516ec0d15a5419da922c318a3f9fd09', 'request_id': 'req-c54a5d5d-31b3-4095-a3d5-a5aa2f7cce34'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.943981 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c54a5d5d-31b3-4095-a3d5-a5aa2f7cce34 admin admin] The token cache is being invalidate because project e516ec0d15a5419da922c318a3f9fd09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:42.944255 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c54a5d5d-31b3-4095-a3d5-a5aa2f7cce34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.945013 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c54a5d5d-31b3-4095-a3d5-a5aa2f7cce34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:42.946588 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1017/2050] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:42 2022] DELETE /identity/v3/projects/e516ec0d15a5419da922c318a3f9fd09 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:42.950656 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1489e0-acee-445f-b000-f985d5dceec9 service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:42.960601 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1489e0-acee-445f-b000-f985d5dceec9 service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:43.033142 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab698d3-ad45-4d7d-8973-77efb8409b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:43.034406 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab698d3-ad45-4d7d-8973-77efb8409b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:43.035200 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab698d3-ad45-4d7d-8973-77efb8409b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:43.035200 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab698d3-ad45-4d7d-8973-77efb8409b28 admin admin] PATH_INFO: `/v3/users/eea7290588774eb0b4b3ebc55a302848` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:43.036560 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab698d3-ad45-4d7d-8973-77efb8409b28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eea7290588774eb0b4b3ebc55a302848)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:43.038663 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab698d3-ad45-4d7d-8973-77efb8409b28 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:43.114387 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6ab698d3-ad45-4d7d-8973-77efb8409b28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eea7290588774eb0b4b3ebc55a302848'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.115083 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6ab698d3-ad45-4d7d-8973-77efb8409b28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eea7290588774eb0b4b3ebc55a302848'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.115716 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6ab698d3-ad45-4d7d-8973-77efb8409b28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eea7290588774eb0b4b3ebc55a302848'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.130150 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6ab698d3-ad45-4d7d-8973-77efb8409b28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eea7290588774eb0b4b3ebc55a302848'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.137752 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6ab698d3-ad45-4d7d-8973-77efb8409b28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eea7290588774eb0b4b3ebc55a302848'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.157812 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1034/2051] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:42 2022] DELETE /identity/v3/users/eea7290588774eb0b4b3ebc55a302848 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:43.331653 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a5d5d-31b3-4095-a3d5-a5aa2f7cce34 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:43.333151 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-c54a5d5d-31b3-4095-a3d5-a5aa2f7cce34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:43.347360 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a5d5d-31b3-4095-a3d5-a5aa2f7cce34 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:43.446773 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389e594-ecca-481f-81db-e731488e4790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:43.447847 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389e594-ecca-481f-81db-e731488e4790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:43.448196 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389e594-ecca-481f-81db-e731488e4790 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:43.448536 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389e594-ecca-481f-81db-e731488e4790 admin admin] PATH_INFO: `/v3/projects/d83ec0b1aad845aba51719c375b6c06d` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:43.450263 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389e594-ecca-481f-81db-e731488e4790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d83ec0b1aad845aba51719c375b6c06d)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:43.452568 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389e594-ecca-481f-81db-e731488e4790 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:43.504173 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-3389e594-ecca-481f-81db-e731488e4790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd83ec0b1aad845aba51719c375b6c06d', 'request_id': 'req-3389e594-ecca-481f-81db-e731488e4790'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.527319 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-3389e594-ecca-481f-81db-e731488e4790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd83ec0b1aad845aba51719c375b6c06d', 'request_id': 'req-3389e594-ecca-481f-81db-e731488e4790'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.539690 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-3389e594-ecca-481f-81db-e731488e4790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd83ec0b1aad845aba51719c375b6c06d', 'request_id': 'req-3389e594-ecca-481f-81db-e731488e4790'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.556656 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab698d3-ad45-4d7d-8973-77efb8409b28 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:43.557708 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-3389e594-ecca-481f-81db-e731488e4790 admin admin] The token cache is being invalidate because project d83ec0b1aad845aba51719c375b6c06d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:43.557995 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-3389e594-ecca-481f-81db-e731488e4790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.558107 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-6ab698d3-ad45-4d7d-8973-77efb8409b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:43.558783 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-3389e594-ecca-481f-81db-e731488e4790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.563295 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1018/2052] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:43 2022] DELETE /identity/v3/projects/d83ec0b1aad845aba51719c375b6c06d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:43.564978 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389e594-ecca-481f-81db-e731488e4790 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:43.566286 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-3389e594-ecca-481f-81db-e731488e4790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:43.613411 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab698d3-ad45-4d7d-8973-77efb8409b28 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:43.652343 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389e594-ecca-481f-81db-e731488e4790 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:43.657844 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95d665-6b2d-448b-b964-eb04e21c0dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:43.658737 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95d665-6b2d-448b-b964-eb04e21c0dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:43.660478 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95d665-6b2d-448b-b964-eb04e21c0dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:43.660478 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95d665-6b2d-448b-b964-eb04e21c0dbb admin admin] PATH_INFO: `/v3/users/093cc60ab0954690bf85d5048d2af2a8` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:43.660478 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95d665-6b2d-448b-b964-eb04e21c0dbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=093cc60ab0954690bf85d5048d2af2a8)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:43.662529 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95d665-6b2d-448b-b964-eb04e21c0dbb admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:43.694682 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829a6b3-3ad1-4675-9de4-a8a9fb8275b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:43.695606 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829a6b3-3ad1-4675-9de4-a8a9fb8275b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:43.695888 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829a6b3-3ad1-4675-9de4-a8a9fb8275b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:43.696419 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829a6b3-3ad1-4675-9de4-a8a9fb8275b4 admin admin] PATH_INFO: `/v3/projects/86585fdba5604a99a7cd38964c217480` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:43.697854 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829a6b3-3ad1-4675-9de4-a8a9fb8275b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86585fdba5604a99a7cd38964c217480)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:43.700402 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829a6b3-3ad1-4675-9de4-a8a9fb8275b4 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:43.732620 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4a95d665-6b2d-448b-b964-eb04e21c0dbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093cc60ab0954690bf85d5048d2af2a8'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.746796 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4a95d665-6b2d-448b-b964-eb04e21c0dbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093cc60ab0954690bf85d5048d2af2a8'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.753704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4a95d665-6b2d-448b-b964-eb04e21c0dbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093cc60ab0954690bf85d5048d2af2a8'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.762263 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-9829a6b3-3ad1-4675-9de4-a8a9fb8275b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86585fdba5604a99a7cd38964c217480', 'request_id': 'req-9829a6b3-3ad1-4675-9de4-a8a9fb8275b4'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.762585 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4a95d665-6b2d-448b-b964-eb04e21c0dbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093cc60ab0954690bf85d5048d2af2a8'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.763218 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4a95d665-6b2d-448b-b964-eb04e21c0dbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093cc60ab0954690bf85d5048d2af2a8'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.768432 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-9829a6b3-3ad1-4675-9de4-a8a9fb8275b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86585fdba5604a99a7cd38964c217480', 'request_id': 'req-9829a6b3-3ad1-4675-9de4-a8a9fb8275b4'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.777108 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1019/2053] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:43 2022] DELETE /identity/v3/users/093cc60ab0954690bf85d5048d2af2a8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:43.783400 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-9829a6b3-3ad1-4675-9de4-a8a9fb8275b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86585fdba5604a99a7cd38964c217480', 'request_id': 'req-9829a6b3-3ad1-4675-9de4-a8a9fb8275b4'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.797220 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-9829a6b3-3ad1-4675-9de4-a8a9fb8275b4 admin admin] The token cache is being invalidate because project 86585fdba5604a99a7cd38964c217480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:43.797587 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-9829a6b3-3ad1-4675-9de4-a8a9fb8275b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.798178 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-9829a6b3-3ad1-4675-9de4-a8a9fb8275b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.799949 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1035/2054] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:43 2022] DELETE /identity/v3/projects/86585fdba5604a99a7cd38964c217480 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:43.803937 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95d665-6b2d-448b-b964-eb04e21c0dbb admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:43.806147 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-4a95d665-6b2d-448b-b964-eb04e21c0dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:43.881398 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95d665-6b2d-448b-b964-eb04e21c0dbb admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:43.887682 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948333b-677a-45ad-bb9b-63e1341d8aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:43.888681 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948333b-677a-45ad-bb9b-63e1341d8aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:43.889028 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948333b-677a-45ad-bb9b-63e1341d8aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:43.889278 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948333b-677a-45ad-bb9b-63e1341d8aa7 admin admin] PATH_INFO: `/v3/users/9e84b758c2a742c69c22e1627490e772` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:43.891693 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948333b-677a-45ad-bb9b-63e1341d8aa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e84b758c2a742c69c22e1627490e772)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:43.894135 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948333b-677a-45ad-bb9b-63e1341d8aa7 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:43.953202 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a948333b-677a-45ad-bb9b-63e1341d8aa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e84b758c2a742c69c22e1627490e772'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.975450 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a948333b-677a-45ad-bb9b-63e1341d8aa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e84b758c2a742c69c22e1627490e772'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.984085 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a948333b-677a-45ad-bb9b-63e1341d8aa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e84b758c2a742c69c22e1627490e772'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.991953 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a948333b-677a-45ad-bb9b-63e1341d8aa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e84b758c2a742c69c22e1627490e772'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.992696 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a948333b-677a-45ad-bb9b-63e1341d8aa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e84b758c2a742c69c22e1627490e772'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:43.998532 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829a6b3-3ad1-4675-9de4-a8a9fb8275b4 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:43.999427 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1020/2055] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:43 2022] DELETE /identity/v3/users/9e84b758c2a742c69c22e1627490e772 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:44.000031 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-9829a6b3-3ad1-4675-9de4-a8a9fb8275b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:44.101092 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829a6b3-3ad1-4675-9de4-a8a9fb8275b4 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:44.175098 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948333b-677a-45ad-bb9b-63e1341d8aa7 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:44.176537 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-a948333b-677a-45ad-bb9b-63e1341d8aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:44.176650 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a7c6e-cd9e-458d-8c74-002c202e12cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:44.179326 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a7c6e-cd9e-458d-8c74-002c202e12cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.179471 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a7c6e-cd9e-458d-8c74-002c202e12cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.179956 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a7c6e-cd9e-458d-8c74-002c202e12cd admin admin] PATH_INFO: `/v3/projects/5a60831736f54c02a8843a79e15368b1` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.181711 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a7c6e-cd9e-458d-8c74-002c202e12cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a60831736f54c02a8843a79e15368b1)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:44.184262 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a7c6e-cd9e-458d-8c74-002c202e12cd admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:44.193553 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948333b-677a-45ad-bb9b-63e1341d8aa7 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:44.200184 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e11622-9748-43e5-8a8b-a8b84c98d03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:44.201122 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e11622-9748-43e5-8a8b-a8b84c98d03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.201405 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e11622-9748-43e5-8a8b-a8b84c98d03d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.201685 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e11622-9748-43e5-8a8b-a8b84c98d03d admin admin] PATH_INFO: `/v3/projects/bf3688fb1ded4fcfbc118e4d02cb6ae6` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.204907 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e11622-9748-43e5-8a8b-a8b84c98d03d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf3688fb1ded4fcfbc118e4d02cb6ae6)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:44.207595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e11622-9748-43e5-8a8b-a8b84c98d03d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:44.262822 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-26e11622-9748-43e5-8a8b-a8b84c98d03d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf3688fb1ded4fcfbc118e4d02cb6ae6', 'request_id': 'req-26e11622-9748-43e5-8a8b-a8b84c98d03d'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:44.266890 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-884a7c6e-cd9e-458d-8c74-002c202e12cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a60831736f54c02a8843a79e15368b1', 'request_id': 'req-884a7c6e-cd9e-458d-8c74-002c202e12cd'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:44.270637 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-26e11622-9748-43e5-8a8b-a8b84c98d03d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf3688fb1ded4fcfbc118e4d02cb6ae6', 'request_id': 'req-26e11622-9748-43e5-8a8b-a8b84c98d03d'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:44.274854 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-884a7c6e-cd9e-458d-8c74-002c202e12cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a60831736f54c02a8843a79e15368b1', 'request_id': 'req-884a7c6e-cd9e-458d-8c74-002c202e12cd'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:44.281374 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-26e11622-9748-43e5-8a8b-a8b84c98d03d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf3688fb1ded4fcfbc118e4d02cb6ae6', 'request_id': 'req-26e11622-9748-43e5-8a8b-a8b84c98d03d'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:44.286185 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-884a7c6e-cd9e-458d-8c74-002c202e12cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a60831736f54c02a8843a79e15368b1', 'request_id': 'req-884a7c6e-cd9e-458d-8c74-002c202e12cd'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:44.297626 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-26e11622-9748-43e5-8a8b-a8b84c98d03d admin admin] The token cache is being invalidate because project bf3688fb1ded4fcfbc118e4d02cb6ae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:44.297949 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-26e11622-9748-43e5-8a8b-a8b84c98d03d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:44.298618 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-26e11622-9748-43e5-8a8b-a8b84c98d03d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:44.298847 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-884a7c6e-cd9e-458d-8c74-002c202e12cd admin admin] The token cache is being invalidate because project 5a60831736f54c02a8843a79e15368b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:44.299133 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-884a7c6e-cd9e-458d-8c74-002c202e12cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:44.299769 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-884a7c6e-cd9e-458d-8c74-002c202e12cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:44.300818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1021/2056] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:44 2022] DELETE /identity/v3/projects/bf3688fb1ded4fcfbc118e4d02cb6ae6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:44.305372 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1036/2057] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:43 2022] DELETE /identity/v3/projects/5a60831736f54c02a8843a79e15368b1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:44.306407 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac194b-f779-44df-a587-95d5545bfcfc None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.307050 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7365d-f85b-45d6-8897-1e419c76258b None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.307307 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac194b-f779-44df-a587-95d5545bfcfc None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.307637 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7365d-f85b-45d6-8897-1e419c76258b None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.307761 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac194b-f779-44df-a587-95d5545bfcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.308001 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7365d-f85b-45d6-8897-1e419c76258b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.327204 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-25ac194b-f779-44df-a587-95d5545bfcfc None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:44.328374 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-25ac194b-f779-44df-a587-95d5545bfcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:44.332998 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-99b7365d-f85b-45d6-8897-1e419c76258b None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:44.334238 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-99b7365d-f85b-45d6-8897-1e419c76258b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:44.388911 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1022/2058] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:44.396485 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a0470-1d31-4df4-a371-bad1f13eeea0 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.396941 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a0470-1d31-4df4-a371-bad1f13eeea0 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.397179 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a0470-1d31-4df4-a371-bad1f13eeea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.405704 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1037/2059] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:44.415230 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2af3b9-f369-4d6c-8b51-393cc1a6de25 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.415522 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2af3b9-f369-4d6c-8b51-393cc1a6de25 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.415801 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2af3b9-f369-4d6c-8b51-393cc1a6de25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.416667 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-754a0470-1d31-4df4-a371-bad1f13eeea0 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:44.417972 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-754a0470-1d31-4df4-a371-bad1f13eeea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:44.426098 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1023/2060] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:44.430997 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a0470-1d31-4df4-a371-bad1f13eeea0 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:44.432318 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-754a0470-1d31-4df4-a371-bad1f13eeea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:44.434520 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-2d2af3b9-f369-4d6c-8b51-393cc1a6de25 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:44.435681 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-2d2af3b9-f369-4d6c-8b51-393cc1a6de25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:44.444922 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a0470-1d31-4df4-a371-bad1f13eeea0 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:44.445082 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1038/2061] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:44.448799 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2af3b9-f369-4d6c-8b51-393cc1a6de25 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:44.450687 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a37d9e-aa8f-4b66-925f-d357eb6958dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:44.451573 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a37d9e-aa8f-4b66-925f-d357eb6958dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.451853 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a37d9e-aa8f-4b66-925f-d357eb6958dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.452125 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a37d9e-aa8f-4b66-925f-d357eb6958dc admin admin] PATH_INFO: `/v3/projects/6ddb249d1a0c43ae8af96c501a25e8d4` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.455801 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a37d9e-aa8f-4b66-925f-d357eb6958dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ddb249d1a0c43ae8af96c501a25e8d4)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:44.455801 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a37d9e-aa8f-4b66-925f-d357eb6958dc admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:44.461859 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2af3b9-f369-4d6c-8b51-393cc1a6de25 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:44.467191 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e76520-f71f-4f68-bff6-e8c3635c06f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:44.467849 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e76520-f71f-4f68-bff6-e8c3635c06f2 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.468130 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e76520-f71f-4f68-bff6-e8c3635c06f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.468403 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e76520-f71f-4f68-bff6-e8c3635c06f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.469221 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e76520-f71f-4f68-bff6-e8c3635c06f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:51:44.469528 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e76520-f71f-4f68-bff6-e8c3635c06f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:44.471196 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e76520-f71f-4f68-bff6-e8c3635c06f2 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:44.482805 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1039/2062] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:51:44.483762 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e76520-f71f-4f68-bff6-e8c3635c06f2 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:44.495152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e76520-f71f-4f68-bff6-e8c3635c06f2 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:44.505069 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f9a37d9e-aa8f-4b66-925f-d357eb6958dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ddb249d1a0c43ae8af96c501a25e8d4', 'request_id': 'req-f9a37d9e-aa8f-4b66-925f-d357eb6958dc'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:44.511019 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f9a37d9e-aa8f-4b66-925f-d357eb6958dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ddb249d1a0c43ae8af96c501a25e8d4', 'request_id': 'req-f9a37d9e-aa8f-4b66-925f-d357eb6958dc'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:44.519140 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f9a37d9e-aa8f-4b66-925f-d357eb6958dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ddb249d1a0c43ae8af96c501a25e8d4', 'request_id': 'req-f9a37d9e-aa8f-4b66-925f-d357eb6958dc'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:44.530083 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f9a37d9e-aa8f-4b66-925f-d357eb6958dc admin admin] The token cache is being invalidate because project 6ddb249d1a0c43ae8af96c501a25e8d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:44.530372 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f9a37d9e-aa8f-4b66-925f-d357eb6958dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:44.531028 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f9a37d9e-aa8f-4b66-925f-d357eb6958dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:44.534296 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1024/2063] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:44 2022] DELETE /identity/v3/projects/6ddb249d1a0c43ae8af96c501a25e8d4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:44.534296 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a37d9e-aa8f-4b66-925f-d357eb6958dc admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:44.538575 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-f9a37d9e-aa8f-4b66-925f-d357eb6958dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:44.555950 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce405e76-d135-40c2-bf75-67ae18e0bbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:44.556621 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce405e76-d135-40c2-bf75-67ae18e0bbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.556931 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce405e76-d135-40c2-bf75-67ae18e0bbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.557498 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce405e76-d135-40c2-bf75-67ae18e0bbb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.557937 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce405e76-d135-40c2-bf75-67ae18e0bbb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:51:44.558246 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce405e76-d135-40c2-bf75-67ae18e0bbb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:44.559840 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce405e76-d135-40c2-bf75-67ae18e0bbb6 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:44.574891 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1040/2064] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:51:44.574891 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c17ee8-4276-4906-a031-111a92c15083 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.574891 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c17ee8-4276-4906-a031-111a92c15083 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.574891 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c17ee8-4276-4906-a031-111a92c15083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.591107 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-a3c17ee8-4276-4906-a031-111a92c15083 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:44.592334 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a3c17ee8-4276-4906-a031-111a92c15083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:44.600493 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1041/2065] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:44.601397 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c17ee8-4276-4906-a031-111a92c15083 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:44.603345 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a3c17ee8-4276-4906-a031-111a92c15083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:44.605899 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a37d9e-aa8f-4b66-925f-d357eb6958dc admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:44.612019 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb41e5-c802-4233-b76d-5582136c341c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:44.612686 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb41e5-c802-4233-b76d-5582136c341c admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.613002 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb41e5-c802-4233-b76d-5582136c341c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.613273 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb41e5-c802-4233-b76d-5582136c341c admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.613983 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb41e5-c802-4233-b76d-5582136c341c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:44.615946 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb41e5-c802-4233-b76d-5582136c341c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:44.616266 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c17ee8-4276-4906-a031-111a92c15083 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:44.621157 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc1afb-0ff2-4f07-8e03-160d9e835637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:44.621808 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc1afb-0ff2-4f07-8e03-160d9e835637 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.622092 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc1afb-0ff2-4f07-8e03-160d9e835637 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.622390 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc1afb-0ff2-4f07-8e03-160d9e835637 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.623103 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc1afb-0ff2-4f07-8e03-160d9e835637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:44.625091 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc1afb-0ff2-4f07-8e03-160d9e835637 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:44.643686 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1025/2066] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:44 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:44.645232 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402076d-ad99-47a1-946e-f351989ada93 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.645603 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402076d-ad99-47a1-946e-f351989ada93 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.645998 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402076d-ad99-47a1-946e-f351989ada93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.653616 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1042/2067] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:44 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:44.654624 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc1afb-0ff2-4f07-8e03-160d9e835637 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:44.671607 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-3402076d-ad99-47a1-946e-f351989ada93 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:44.673063 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-3402076d-ad99-47a1-946e-f351989ada93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:44.722507 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc1afb-0ff2-4f07-8e03-160d9e835637 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:44.727537 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a47b45-b073-42f3-bb91-ee1574bc84d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:44.728219 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a47b45-b073-42f3-bb91-ee1574bc84d7 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.728495 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a47b45-b073-42f3-bb91-ee1574bc84d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.728770 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a47b45-b073-42f3-bb91-ee1574bc84d7 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.729516 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a47b45-b073-42f3-bb91-ee1574bc84d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:44.731628 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a47b45-b073-42f3-bb91-ee1574bc84d7 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:44.751677 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1026/2068] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:44.754887 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1043/2069] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:44 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:44.754887 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a47b45-b073-42f3-bb91-ee1574bc84d7 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:44.757249 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402076d-ad99-47a1-946e-f351989ada93 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:44.767229 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a47b45-b073-42f3-bb91-ee1574bc84d7 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:44.768135 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402076d-ad99-47a1-946e-f351989ada93 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:44.771881 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784a2b2-9475-4df3-8310-ead0e8f15028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:44.772253 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f928da-589c-41b4-8df2-1db41ca5c298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:44.772800 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784a2b2-9475-4df3-8310-ead0e8f15028 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.772951 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f928da-589c-41b4-8df2-1db41ca5c298 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.773940 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784a2b2-9475-4df3-8310-ead0e8f15028 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.774061 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f928da-589c-41b4-8df2-1db41ca5c298 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.774139 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784a2b2-9475-4df3-8310-ead0e8f15028 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.774209 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f928da-589c-41b4-8df2-1db41ca5c298 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.774415 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784a2b2-9475-4df3-8310-ead0e8f15028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:44.774528 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f928da-589c-41b4-8df2-1db41ca5c298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:51:44.774833 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f928da-589c-41b4-8df2-1db41ca5c298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:44.776347 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784a2b2-9475-4df3-8310-ead0e8f15028 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:44.776455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f928da-589c-41b4-8df2-1db41ca5c298 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:44.792544 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1027/2070] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:51:44.792544 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f928da-589c-41b4-8df2-1db41ca5c298 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:44.804699 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f928da-589c-41b4-8df2-1db41ca5c298 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:44.808893 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1044/2071] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:44 2022] POST /identity/v3/users => generated 293 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:44.808893 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784a2b2-9475-4df3-8310-ead0e8f15028 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:44.813795 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9aa5f-d8b3-41a8-a320-7b925d63ebb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:44.814653 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9aa5f-d8b3-41a8-a320-7b925d63ebb5 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.815038 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9aa5f-d8b3-41a8-a320-7b925d63ebb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.815421 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9aa5f-d8b3-41a8-a320-7b925d63ebb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.816268 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9aa5f-d8b3-41a8-a320-7b925d63ebb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:44.818016 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9aa5f-d8b3-41a8-a320-7b925d63ebb5 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:44.822900 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784a2b2-9475-4df3-8310-ead0e8f15028 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:44.829353 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1028/2072] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:44.830466 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9aa5f-d8b3-41a8-a320-7b925d63ebb5 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:44.834692 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1ad13-84f1-4297-a1b4-6ec57174e2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:44.835499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1ad13-84f1-4297-a1b4-6ec57174e2b7 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.835886 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1ad13-84f1-4297-a1b4-6ec57174e2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.836261 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1ad13-84f1-4297-a1b4-6ec57174e2b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.837108 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1ad13-84f1-4297-a1b4-6ec57174e2b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:44.839156 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1ad13-84f1-4297-a1b4-6ec57174e2b7 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:44.843979 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9aa5f-d8b3-41a8-a320-7b925d63ebb5 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:44.848720 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c18f8-b7fd-430a-9141-7ffaba82dc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:44.849418 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c18f8-b7fd-430a-9141-7ffaba82dc06 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.849705 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c18f8-b7fd-430a-9141-7ffaba82dc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.850107 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c18f8-b7fd-430a-9141-7ffaba82dc06 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.850856 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c18f8-b7fd-430a-9141-7ffaba82dc06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:44.852443 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c18f8-b7fd-430a-9141-7ffaba82dc06 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:44.863452 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1029/2073] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:44.864323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c18f8-b7fd-430a-9141-7ffaba82dc06 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:44.870559 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1045/2074] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:44 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:44.871364 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1ad13-84f1-4297-a1b4-6ec57174e2b7 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:44.874270 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c18f8-b7fd-430a-9141-7ffaba82dc06 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:44.933142 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fe468-0c4e-4aad-9709-d29435940c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:44.933884 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fe468-0c4e-4aad-9709-d29435940c82 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.934043 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1ad13-84f1-4297-a1b4-6ec57174e2b7 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:44.934285 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fe468-0c4e-4aad-9709-d29435940c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.934619 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fe468-0c4e-4aad-9709-d29435940c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.935531 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fe468-0c4e-4aad-9709-d29435940c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:44.937228 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fe468-0c4e-4aad-9709-d29435940c82 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:44.939478 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bdd36-d1a4-4c18-a9f4-e8a8a5fdd263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:44.940223 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bdd36-d1a4-4c18-a9f4-e8a8a5fdd263 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.940507 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bdd36-d1a4-4c18-a9f4-e8a8a5fdd263 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.941022 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bdd36-d1a4-4c18-a9f4-e8a8a5fdd263 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.941856 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bdd36-d1a4-4c18-a9f4-e8a8a5fdd263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:44.945783 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bdd36-d1a4-4c18-a9f4-e8a8a5fdd263 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:44.951305 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1030/2075] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:44.952448 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fe468-0c4e-4aad-9709-d29435940c82 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:44.954201 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1046/2076] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:44.955531 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bdd36-d1a4-4c18-a9f4-e8a8a5fdd263 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:44.964806 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fe468-0c4e-4aad-9709-d29435940c82 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:44.967283 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bdd36-d1a4-4c18-a9f4-e8a8a5fdd263 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:44.969478 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c5307-32e8-490a-970c-e11f467139c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:44.970138 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c5307-32e8-490a-970c-e11f467139c8 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.970415 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c5307-32e8-490a-970c-e11f467139c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.970756 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c5307-32e8-490a-970c-e11f467139c8 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.971385 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c5307-32e8-490a-970c-e11f467139c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:44.972096 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818b368-288e-438f-922b-16a50347e942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:44.973226 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818b368-288e-438f-922b-16a50347e942 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:44.973394 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c5307-32e8-490a-970c-e11f467139c8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:44.974118 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818b368-288e-438f-922b-16a50347e942 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:44.974403 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818b368-288e-438f-922b-16a50347e942 admin admin] PATH_INFO: `/v3/projects/3009e50ec2514783902558a115bb4362/users/fb5f92e5ec44444f878b0e5aab9eccd1/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:44.992120 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818b368-288e-438f-922b-16a50347e942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3009e50ec2514783902558a115bb4362, user_id=fb5f92e5ec44444f878b0e5aab9eccd1, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:44.994786 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818b368-288e-438f-922b-16a50347e942 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:45.000996 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1031/2077] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:44 2022] POST /identity/v3/users => generated 292 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:45.001842 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c5307-32e8-490a-970c-e11f467139c8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:45.011468 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1047/2078] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:44 2022] PUT /identity/v3/projects/3009e50ec2514783902558a115bb4362/users/fb5f92e5ec44444f878b0e5aab9eccd1/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:45.012417 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818b368-288e-438f-922b-16a50347e942 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:45.012550 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c5307-32e8-490a-970c-e11f467139c8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:45.075868 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f1482-e2dd-4d62-babc-a1e1f5466284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:45.077129 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f1482-e2dd-4d62-babc-a1e1f5466284 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:45.077656 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f1482-e2dd-4d62-babc-a1e1f5466284 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:45.078188 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f1482-e2dd-4d62-babc-a1e1f5466284 admin admin] PATH_INFO: `/v3/projects/533930ff4f6e49568e5245f6ea67ed39/users/8873d3561acc4478818db80495d474aa/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:45.083056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818b368-288e-438f-922b-16a50347e942 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:45.088079 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9d2e4-0cbf-4c3a-8aa7-eec01ec49b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:45.088938 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9d2e4-0cbf-4c3a-8aa7-eec01ec49b82 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:45.089241 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9d2e4-0cbf-4c3a-8aa7-eec01ec49b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:45.089594 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9d2e4-0cbf-4c3a-8aa7-eec01ec49b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:45.090399 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9d2e4-0cbf-4c3a-8aa7-eec01ec49b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:45.092357 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9d2e4-0cbf-4c3a-8aa7-eec01ec49b82 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:45.099176 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f1482-e2dd-4d62-babc-a1e1f5466284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=533930ff4f6e49568e5245f6ea67ed39, user_id=8873d3561acc4478818db80495d474aa, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:45.101983 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f1482-e2dd-4d62-babc-a1e1f5466284 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:45.102643 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1048/2079] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:45.103880 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edad07-61ca-4dab-8038-516b63250e14 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:45.104164 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edad07-61ca-4dab-8038-516b63250e14 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:45.104440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edad07-61ca-4dab-8038-516b63250e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:45.120946 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1032/2080] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:45 2022] PUT /identity/v3/projects/533930ff4f6e49568e5245f6ea67ed39/users/8873d3561acc4478818db80495d474aa/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:45.121751 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f1482-e2dd-4d62-babc-a1e1f5466284 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:45.131363 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-72edad07-61ca-4dab-8038-516b63250e14 None None] MFA Rules not processed for user `fb5f92e5ec44444f878b0e5aab9eccd1`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:45.132716 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-72edad07-61ca-4dab-8038-516b63250e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:45.182956 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f1482-e2dd-4d62-babc-a1e1f5466284 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:45.190777 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881f5aa-5f8b-4f97-aa33-c96aca166e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:45.191664 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881f5aa-5f8b-4f97-aa33-c96aca166e87 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:45.191755 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881f5aa-5f8b-4f97-aa33-c96aca166e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:45.191996 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881f5aa-5f8b-4f97-aa33-c96aca166e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:45.192755 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881f5aa-5f8b-4f97-aa33-c96aca166e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:45.194400 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881f5aa-5f8b-4f97-aa33-c96aca166e87 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:45.198430 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1049/2081] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:45.199531 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d84fe-ea4d-4f0d-84ad-03cefc0425f3 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:45.199816 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d84fe-ea4d-4f0d-84ad-03cefc0425f3 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:45.200089 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d84fe-ea4d-4f0d-84ad-03cefc0425f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:45.209097 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1033/2082] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:45.209929 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881f5aa-5f8b-4f97-aa33-c96aca166e87 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:45.211598 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-d881f5aa-5f8b-4f97-aa33-c96aca166e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:45.227852 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-437d84fe-ea4d-4f0d-84ad-03cefc0425f3 None None] MFA Rules not processed for user `8873d3561acc4478818db80495d474aa`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:45.229187 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-437d84fe-ea4d-4f0d-84ad-03cefc0425f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:45.278799 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881f5aa-5f8b-4f97-aa33-c96aca166e87 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:45.282494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6019973-b1cc-4e0d-a734-31f43536f77a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:45.283139 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6019973-b1cc-4e0d-a734-31f43536f77a service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:45.283425 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6019973-b1cc-4e0d-a734-31f43536f77a service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:45.283703 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6019973-b1cc-4e0d-a734-31f43536f77a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:45.292290 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6019973-b1cc-4e0d-a734-31f43536f77a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:45.293894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6019973-b1cc-4e0d-a734-31f43536f77a service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:45.297756 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1050/2083] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:45.298650 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d84fe-ea4d-4f0d-84ad-03cefc0425f3 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:45.306670 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1034/2084] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:45 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:45.307357 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6019973-b1cc-4e0d-a734-31f43536f77a service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:45.309752 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d84fe-ea4d-4f0d-84ad-03cefc0425f3 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:45.316086 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd170cdf-524a-43dc-98fc-b724e2afdee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:45.318716 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd170cdf-524a-43dc-98fc-b724e2afdee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:45.318716 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd170cdf-524a-43dc-98fc-b724e2afdee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:45.318716 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd170cdf-524a-43dc-98fc-b724e2afdee1 admin admin] PATH_INFO: `/v3/projects/1d1be6e70eae4239af291ca5ad4f7b90/users/7cdbab6190f246e3b9675ee473c80f7f/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:45.319049 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6019973-b1cc-4e0d-a734-31f43536f77a service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:45.331609 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de6b96-0f17-484b-a258-10da1dd14d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:45.332588 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de6b96-0f17-484b-a258-10da1dd14d04 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:45.333159 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de6b96-0f17-484b-a258-10da1dd14d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:45.333450 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de6b96-0f17-484b-a258-10da1dd14d04 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:45.334202 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de6b96-0f17-484b-a258-10da1dd14d04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:45.337188 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de6b96-0f17-484b-a258-10da1dd14d04 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:45.342773 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd170cdf-524a-43dc-98fc-b724e2afdee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1be6e70eae4239af291ca5ad4f7b90, user_id=7cdbab6190f246e3b9675ee473c80f7f, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:45.348779 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd170cdf-524a-43dc-98fc-b724e2afdee1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:45.371552 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1051/2085] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:45 2022] PUT /identity/v3/projects/1d1be6e70eae4239af291ca5ad4f7b90/users/7cdbab6190f246e3b9675ee473c80f7f/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:45.375643 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1035/2086] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:45 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:45.376971 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd170cdf-524a-43dc-98fc-b724e2afdee1 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:45.381935 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8eacf5-569e-4e62-9920-9b863af134a1 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:45.382317 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8eacf5-569e-4e62-9920-9b863af134a1 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:45.382672 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8eacf5-569e-4e62-9920-9b863af134a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:45.410725 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-3b8eacf5-569e-4e62-9920-9b863af134a1 None None] MFA Rules not processed for user `7cdbab6190f246e3b9675ee473c80f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:45.412338 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-3b8eacf5-569e-4e62-9920-9b863af134a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:45.446142 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd170cdf-524a-43dc-98fc-b724e2afdee1 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:45.488974 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1036/2087] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:45.501174 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8eacf5-569e-4e62-9920-9b863af134a1 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:45.502657 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-3b8eacf5-569e-4e62-9920-9b863af134a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:45.515895 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeaae33-e102-4917-986a-ed04e3ae117a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:45.516784 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaae33-e102-4917-986a-ed04e3ae117a admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:45.517505 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaae33-e102-4917-986a-ed04e3ae117a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:45.517922 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaae33-e102-4917-986a-ed04e3ae117a admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:45.518776 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeaae33-e102-4917-986a-ed04e3ae117a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:45.520750 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeaae33-e102-4917-986a-ed04e3ae117a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:45.547164 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1052/2088] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:45 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:51:45.551525 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeaae33-e102-4917-986a-ed04e3ae117a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:45.565089 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeaae33-e102-4917-986a-ed04e3ae117a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:45.569944 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2d8e4-285a-451b-9cf6-0f62711da739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:45.570605 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2d8e4-285a-451b-9cf6-0f62711da739 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:45.570884 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2d8e4-285a-451b-9cf6-0f62711da739 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:45.573775 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2d8e4-285a-451b-9cf6-0f62711da739 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:45.573775 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2d8e4-285a-451b-9cf6-0f62711da739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:45.573775 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2d8e4-285a-451b-9cf6-0f62711da739 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:45.582117 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8eacf5-569e-4e62-9920-9b863af134a1 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:45.587285 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1053/2089] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:51:45.588664 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2d8e4-285a-451b-9cf6-0f62711da739 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:45.591076 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e495267-b178-4718-9d94-5d3535e32347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:45.591984 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e495267-b178-4718-9d94-5d3535e32347 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:45.592362 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e495267-b178-4718-9d94-5d3535e32347 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:45.592711 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e495267-b178-4718-9d94-5d3535e32347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:45.603362 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2d8e4-285a-451b-9cf6-0f62711da739 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:45.603524 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e495267-b178-4718-9d94-5d3535e32347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:45.605551 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e495267-b178-4718-9d94-5d3535e32347 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:45.614004 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bfbd9-a8fa-41b6-abe8-92a46d1a4e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:45.615066 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bfbd9-a8fa-41b6-abe8-92a46d1a4e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:45.615366 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bfbd9-a8fa-41b6-abe8-92a46d1a4e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:45.615761 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bfbd9-a8fa-41b6-abe8-92a46d1a4e41 admin admin] PATH_INFO: `/v3/projects/c8e801e30a5d4b3ca45de2f9c563328d/users/6105236e727346f8b32fb0a9bafadada/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:45.622425 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1037/2090] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:51:45.637420 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bfbd9-a8fa-41b6-abe8-92a46d1a4e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e801e30a5d4b3ca45de2f9c563328d, user_id=6105236e727346f8b32fb0a9bafadada, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:45.644817 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bfbd9-a8fa-41b6-abe8-92a46d1a4e41 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:45.662635 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1054/2091] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:45 2022] PUT /identity/v3/projects/c8e801e30a5d4b3ca45de2f9c563328d/users/6105236e727346f8b32fb0a9bafadada/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:45.666698 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e495267-b178-4718-9d94-5d3535e32347 service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:45.677748 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e495267-b178-4718-9d94-5d3535e32347 service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:45.737106 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef77d3e-fbfa-4adf-8727-edc87443add0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:45.737503 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef77d3e-fbfa-4adf-8727-edc87443add0 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:45.737788 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef77d3e-fbfa-4adf-8727-edc87443add0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:45.738064 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef77d3e-fbfa-4adf-8727-edc87443add0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:45.738804 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef77d3e-fbfa-4adf-8727-edc87443add0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:45.740418 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef77d3e-fbfa-4adf-8727-edc87443add0 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:45.750907 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1038/2092] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:51:45.755318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bfbd9-a8fa-41b6-abe8-92a46d1a4e41 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:45.766353 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bfbd9-a8fa-41b6-abe8-92a46d1a4e41 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:45.771104 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2fdc6-e493-4317-93fc-2efa879f6875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:45.771979 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2fdc6-e493-4317-93fc-2efa879f6875 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:45.772260 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2fdc6-e493-4317-93fc-2efa879f6875 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:45.772534 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2fdc6-e493-4317-93fc-2efa879f6875 admin admin] PATH_INFO: `/v3/projects/c8e801e30a5d4b3ca45de2f9c563328d/users/6105236e727346f8b32fb0a9bafadada/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:45.774996 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2fdc6-e493-4317-93fc-2efa879f6875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e801e30a5d4b3ca45de2f9c563328d, user_id=6105236e727346f8b32fb0a9bafadada, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:45.777684 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2fdc6-e493-4317-93fc-2efa879f6875 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:45.788594 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1055/2093] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:45 2022] PUT /identity/v3/projects/c8e801e30a5d4b3ca45de2f9c563328d/users/6105236e727346f8b32fb0a9bafadada/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:45.798727 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68913add-2161-4335-8007-3f71841b36d4 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:45.799021 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68913add-2161-4335-8007-3f71841b36d4 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:45.799305 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68913add-2161-4335-8007-3f71841b36d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:45.827416 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-68913add-2161-4335-8007-3f71841b36d4 None None] MFA Rules not processed for user `6105236e727346f8b32fb0a9bafadada`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:45.829092 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-68913add-2161-4335-8007-3f71841b36d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:45.921032 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1039/2094] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:45.933713 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2fdc6-e493-4317-93fc-2efa879f6875 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:46.013498 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2fdc6-e493-4317-93fc-2efa879f6875 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:46.017681 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688887e3-eb58-4807-9058-194c0f38559a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:46.018310 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688887e3-eb58-4807-9058-194c0f38559a service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:46.020894 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688887e3-eb58-4807-9058-194c0f38559a service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:46.020894 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688887e3-eb58-4807-9058-194c0f38559a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:46.034650 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688887e3-eb58-4807-9058-194c0f38559a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:46.036094 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688887e3-eb58-4807-9058-194c0f38559a service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:46.045237 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1056/2095] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:46.073373 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68913add-2161-4335-8007-3f71841b36d4 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:46.139098 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68913add-2161-4335-8007-3f71841b36d4 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:46.145168 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eba35d-9fa8-4018-a304-f45d875218d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:46.146153 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eba35d-9fa8-4018-a304-f45d875218d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:46.146449 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eba35d-9fa8-4018-a304-f45d875218d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:46.146698 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eba35d-9fa8-4018-a304-f45d875218d8 admin admin] PATH_INFO: `/v3/users/8873d3561acc4478818db80495d474aa` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:46.148032 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eba35d-9fa8-4018-a304-f45d875218d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8873d3561acc4478818db80495d474aa)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:46.150332 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eba35d-9fa8-4018-a304-f45d875218d8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:46.201037 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f6eba35d-9fa8-4018-a304-f45d875218d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8873d3561acc4478818db80495d474aa'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:46.212794 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f6eba35d-9fa8-4018-a304-f45d875218d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8873d3561acc4478818db80495d474aa'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:46.219460 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f6eba35d-9fa8-4018-a304-f45d875218d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8873d3561acc4478818db80495d474aa'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:46.228700 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f6eba35d-9fa8-4018-a304-f45d875218d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8873d3561acc4478818db80495d474aa'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:46.229471 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f6eba35d-9fa8-4018-a304-f45d875218d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8873d3561acc4478818db80495d474aa'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:46.236829 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1040/2096] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:46 2022] DELETE /identity/v3/users/8873d3561acc4478818db80495d474aa => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:46.242938 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee770eb-6635-47c9-8175-4220e840fdf9 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:46.243246 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee770eb-6635-47c9-8175-4220e840fdf9 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:46.243767 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee770eb-6635-47c9-8175-4220e840fdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:46.266501 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-1ee770eb-6635-47c9-8175-4220e840fdf9 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:46.268086 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-1ee770eb-6635-47c9-8175-4220e840fdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:46.326882 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1057/2097] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:46.337214 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eba35d-9fa8-4018-a304-f45d875218d8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:46.339354 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-f6eba35d-9fa8-4018-a304-f45d875218d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:46.399225 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eba35d-9fa8-4018-a304-f45d875218d8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:46.403349 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c2471-dfba-47bc-910b-d163d6d8023b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:46.403973 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c2471-dfba-47bc-910b-d163d6d8023b service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:46.404350 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c2471-dfba-47bc-910b-d163d6d8023b service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:46.404526 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c2471-dfba-47bc-910b-d163d6d8023b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:46.414602 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c2471-dfba-47bc-910b-d163d6d8023b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:46.416049 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c2471-dfba-47bc-910b-d163d6d8023b service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:46.426404 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1041/2098] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:46.704994 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee770eb-6635-47c9-8175-4220e840fdf9 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:46.706422 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-1ee770eb-6635-47c9-8175-4220e840fdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:46.718597 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee770eb-6635-47c9-8175-4220e840fdf9 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:46.726562 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37e1d0-e8bd-4ae7-80c4-aeb6d3beac73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:46.727447 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37e1d0-e8bd-4ae7-80c4-aeb6d3beac73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:46.727720 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37e1d0-e8bd-4ae7-80c4-aeb6d3beac73 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:46.727991 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37e1d0-e8bd-4ae7-80c4-aeb6d3beac73 admin admin] PATH_INFO: `/v3/projects/533930ff4f6e49568e5245f6ea67ed39` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:46.729233 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37e1d0-e8bd-4ae7-80c4-aeb6d3beac73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=533930ff4f6e49568e5245f6ea67ed39)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:46.731201 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37e1d0-e8bd-4ae7-80c4-aeb6d3beac73 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:46.784730 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-3f37e1d0-e8bd-4ae7-80c4-aeb6d3beac73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '533930ff4f6e49568e5245f6ea67ed39', 'request_id': 'req-3f37e1d0-e8bd-4ae7-80c4-aeb6d3beac73'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:46.793226 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-3f37e1d0-e8bd-4ae7-80c4-aeb6d3beac73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '533930ff4f6e49568e5245f6ea67ed39', 'request_id': 'req-3f37e1d0-e8bd-4ae7-80c4-aeb6d3beac73'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:46.803346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-3f37e1d0-e8bd-4ae7-80c4-aeb6d3beac73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '533930ff4f6e49568e5245f6ea67ed39', 'request_id': 'req-3f37e1d0-e8bd-4ae7-80c4-aeb6d3beac73'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:46.814856 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-3f37e1d0-e8bd-4ae7-80c4-aeb6d3beac73 admin admin] The token cache is being invalidate because project 533930ff4f6e49568e5245f6ea67ed39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:46.815144 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-3f37e1d0-e8bd-4ae7-80c4-aeb6d3beac73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:46.815799 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-3f37e1d0-e8bd-4ae7-80c4-aeb6d3beac73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:46.817374 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1058/2099] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:46 2022] DELETE /identity/v3/projects/533930ff4f6e49568e5245f6ea67ed39 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:46.821207 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c2471-dfba-47bc-910b-d163d6d8023b service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:46.830759 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c2471-dfba-47bc-910b-d163d6d8023b service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:46.891114 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1776dc-77dc-4eb1-9fa5-fc0e2cc3b720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:46.892014 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1776dc-77dc-4eb1-9fa5-fc0e2cc3b720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:46.892260 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1776dc-77dc-4eb1-9fa5-fc0e2cc3b720 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:46.892532 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1776dc-77dc-4eb1-9fa5-fc0e2cc3b720 admin admin] PATH_INFO: `/v3/users/6105236e727346f8b32fb0a9bafadada` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:46.893752 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1776dc-77dc-4eb1-9fa5-fc0e2cc3b720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6105236e727346f8b32fb0a9bafadada)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:46.895659 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1776dc-77dc-4eb1-9fa5-fc0e2cc3b720 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:46.949892 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-9d1776dc-77dc-4eb1-9fa5-fc0e2cc3b720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6105236e727346f8b32fb0a9bafadada'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:46.968091 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-9d1776dc-77dc-4eb1-9fa5-fc0e2cc3b720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6105236e727346f8b32fb0a9bafadada'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:46.975375 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-9d1776dc-77dc-4eb1-9fa5-fc0e2cc3b720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6105236e727346f8b32fb0a9bafadada'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:46.986061 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-9d1776dc-77dc-4eb1-9fa5-fc0e2cc3b720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6105236e727346f8b32fb0a9bafadada'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:46.986759 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-9d1776dc-77dc-4eb1-9fa5-fc0e2cc3b720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6105236e727346f8b32fb0a9bafadada'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:46.999316 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1042/2100] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:46 2022] DELETE /identity/v3/users/6105236e727346f8b32fb0a9bafadada => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:47.514987 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37e1d0-e8bd-4ae7-80c4-aeb6d3beac73 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:47.516530 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-3f37e1d0-e8bd-4ae7-80c4-aeb6d3beac73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:47.533371 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37e1d0-e8bd-4ae7-80c4-aeb6d3beac73 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:47.591126 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df2640-7966-40b4-91f4-19648b39f206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:47.591994 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df2640-7966-40b4-91f4-19648b39f206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:47.592342 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df2640-7966-40b4-91f4-19648b39f206 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:47.592618 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df2640-7966-40b4-91f4-19648b39f206 admin admin] PATH_INFO: `/v3/projects/c8e801e30a5d4b3ca45de2f9c563328d` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:47.593880 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df2640-7966-40b4-91f4-19648b39f206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e801e30a5d4b3ca45de2f9c563328d)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:47.595839 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df2640-7966-40b4-91f4-19648b39f206 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:47.642810 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b0df2640-7966-40b4-91f4-19648b39f206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e801e30a5d4b3ca45de2f9c563328d', 'request_id': 'req-b0df2640-7966-40b4-91f4-19648b39f206'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:47.648146 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b0df2640-7966-40b4-91f4-19648b39f206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e801e30a5d4b3ca45de2f9c563328d', 'request_id': 'req-b0df2640-7966-40b4-91f4-19648b39f206'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:47.656826 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b0df2640-7966-40b4-91f4-19648b39f206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e801e30a5d4b3ca45de2f9c563328d', 'request_id': 'req-b0df2640-7966-40b4-91f4-19648b39f206'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:47.670864 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b0df2640-7966-40b4-91f4-19648b39f206 admin admin] The token cache is being invalidate because project c8e801e30a5d4b3ca45de2f9c563328d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:47.671191 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b0df2640-7966-40b4-91f4-19648b39f206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:47.671821 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b0df2640-7966-40b4-91f4-19648b39f206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:47.673575 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1059/2101] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:47 2022] DELETE /identity/v3/projects/c8e801e30a5d4b3ca45de2f9c563328d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:47.679454 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99751f5-a69d-4b98-8d57-61b45ddbb2e5 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:47.679958 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99751f5-a69d-4b98-8d57-61b45ddbb2e5 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:47.680069 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99751f5-a69d-4b98-8d57-61b45ddbb2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:47.698412 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-c99751f5-a69d-4b98-8d57-61b45ddbb2e5 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:47.699661 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-c99751f5-a69d-4b98-8d57-61b45ddbb2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:47.760277 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1043/2102] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:47.773547 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7afc7-9441-4977-9cb9-5e9a00057693 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:47.774090 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7afc7-9441-4977-9cb9-5e9a00057693 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:47.774090 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7afc7-9441-4977-9cb9-5e9a00057693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:47.796659 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-ada7afc7-9441-4977-9cb9-5e9a00057693 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:47.797890 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-ada7afc7-9441-4977-9cb9-5e9a00057693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:47.806626 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1060/2103] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:47.811201 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99751f5-a69d-4b98-8d57-61b45ddbb2e5 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:47.821353 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99751f5-a69d-4b98-8d57-61b45ddbb2e5 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:47.827178 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e0217-b542-4c2d-8e98-90b58e9532f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:47.827838 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e0217-b542-4c2d-8e98-90b58e9532f4 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:47.828117 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e0217-b542-4c2d-8e98-90b58e9532f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:47.828388 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e0217-b542-4c2d-8e98-90b58e9532f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:47.829178 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e0217-b542-4c2d-8e98-90b58e9532f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:51:47.829506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e0217-b542-4c2d-8e98-90b58e9532f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:47.831160 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e0217-b542-4c2d-8e98-90b58e9532f4 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:47.843153 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1044/2104] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:51:47.847534 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7afc7-9441-4977-9cb9-5e9a00057693 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:47.857124 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7afc7-9441-4977-9cb9-5e9a00057693 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:47.863140 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5514d4c-04f5-46e3-b703-3350798c5962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:47.863795 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5514d4c-04f5-46e3-b703-3350798c5962 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:47.864064 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5514d4c-04f5-46e3-b703-3350798c5962 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:47.864333 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5514d4c-04f5-46e3-b703-3350798c5962 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:47.865080 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5514d4c-04f5-46e3-b703-3350798c5962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:47.866979 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5514d4c-04f5-46e3-b703-3350798c5962 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:47.896631 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1061/2105] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:47 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:51:47.901727 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e0217-b542-4c2d-8e98-90b58e9532f4 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:47.913305 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e0217-b542-4c2d-8e98-90b58e9532f4 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:47.971007 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983487a-c048-41cf-b443-5c4841b75bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:47.971683 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983487a-c048-41cf-b443-5c4841b75bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:47.971965 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983487a-c048-41cf-b443-5c4841b75bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:47.972245 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983487a-c048-41cf-b443-5c4841b75bf3 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:47.972984 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983487a-c048-41cf-b443-5c4841b75bf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:47.974952 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983487a-c048-41cf-b443-5c4841b75bf3 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:47.996872 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1045/2106] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:47 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:48.001255 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5514d4c-04f5-46e3-b703-3350798c5962 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:48.011474 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5514d4c-04f5-46e3-b703-3350798c5962 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:48.016207 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9342d74-823a-4ab0-96eb-cdb3cd505afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:48.016874 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9342d74-823a-4ab0-96eb-cdb3cd505afc admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:48.017145 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9342d74-823a-4ab0-96eb-cdb3cd505afc admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:48.017388 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9342d74-823a-4ab0-96eb-cdb3cd505afc admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:48.018128 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9342d74-823a-4ab0-96eb-cdb3cd505afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:48.019701 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9342d74-823a-4ab0-96eb-cdb3cd505afc admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:48.031645 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1062/2107] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:48.035864 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983487a-c048-41cf-b443-5c4841b75bf3 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:48.045738 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983487a-c048-41cf-b443-5c4841b75bf3 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:48.050721 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c1700-3dc4-4a88-b1e2-1f128454cf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:48.051304 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c1700-3dc4-4a88-b1e2-1f128454cf4c admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:48.051581 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c1700-3dc4-4a88-b1e2-1f128454cf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:48.051853 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c1700-3dc4-4a88-b1e2-1f128454cf4c admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:48.052607 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c1700-3dc4-4a88-b1e2-1f128454cf4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:48.054243 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c1700-3dc4-4a88-b1e2-1f128454cf4c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:48.064662 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1046/2108] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:48.068629 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9342d74-823a-4ab0-96eb-cdb3cd505afc admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:48.078973 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9342d74-823a-4ab0-96eb-cdb3cd505afc admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:48.084470 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759e561-cc42-4761-ba87-867c52c11192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:48.085371 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759e561-cc42-4761-ba87-867c52c11192 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:48.085651 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759e561-cc42-4761-ba87-867c52c11192 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:48.085920 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759e561-cc42-4761-ba87-867c52c11192 admin admin] PATH_INFO: `/v3/projects/e4d1f6bfc587457cb44df2e8ec2f242e/users/7a840e1741dd44de958eabc7aa9f3b2e/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:48.102203 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759e561-cc42-4761-ba87-867c52c11192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d1f6bfc587457cb44df2e8ec2f242e, user_id=7a840e1741dd44de958eabc7aa9f3b2e, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:48.104828 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759e561-cc42-4761-ba87-867c52c11192 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:48.120984 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1063/2109] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:48 2022] PUT /identity/v3/projects/e4d1f6bfc587457cb44df2e8ec2f242e/users/7a840e1741dd44de958eabc7aa9f3b2e/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:48.131286 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c8c27-ad9a-41e3-88e7-0f3b5ba721fc None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:48.131576 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c8c27-ad9a-41e3-88e7-0f3b5ba721fc None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:48.131854 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c8c27-ad9a-41e3-88e7-0f3b5ba721fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:48.161140 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-617c8c27-ad9a-41e3-88e7-0f3b5ba721fc None None] MFA Rules not processed for user `7a840e1741dd44de958eabc7aa9f3b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:48.162405 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-617c8c27-ad9a-41e3-88e7-0f3b5ba721fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:48.222780 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759e561-cc42-4761-ba87-867c52c11192 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:48.224925 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-5759e561-cc42-4761-ba87-867c52c11192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:48.233294 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1047/2110] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:48.238687 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c8c27-ad9a-41e3-88e7-0f3b5ba721fc None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:48.293449 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759e561-cc42-4761-ba87-867c52c11192 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:48.298271 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb00ee-90bd-4c75-a3af-a5249863b6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:48.299177 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb00ee-90bd-4c75-a3af-a5249863b6d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:48.299466 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb00ee-90bd-4c75-a3af-a5249863b6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:48.299740 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb00ee-90bd-4c75-a3af-a5249863b6d9 admin admin] PATH_INFO: `/v3/users/7cdbab6190f246e3b9675ee473c80f7f` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:48.301061 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb00ee-90bd-4c75-a3af-a5249863b6d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cdbab6190f246e3b9675ee473c80f7f)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:48.301186 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c8c27-ad9a-41e3-88e7-0f3b5ba721fc None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:48.302916 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb00ee-90bd-4c75-a3af-a5249863b6d9 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:48.305979 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435510df-b261-4f63-8c98-fa3eca37d523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:48.306942 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435510df-b261-4f63-8c98-fa3eca37d523 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:48.307280 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435510df-b261-4f63-8c98-fa3eca37d523 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:48.307610 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435510df-b261-4f63-8c98-fa3eca37d523 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:48.308504 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435510df-b261-4f63-8c98-fa3eca37d523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:48.310483 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435510df-b261-4f63-8c98-fa3eca37d523 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:48.343119 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1048/2111] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:48 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:48.348336 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435510df-b261-4f63-8c98-fa3eca37d523 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:48.355317 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-3ccb00ee-90bd-4c75-a3af-a5249863b6d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cdbab6190f246e3b9675ee473c80f7f'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:48.356319 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-3ccb00ee-90bd-4c75-a3af-a5249863b6d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cdbab6190f246e3b9675ee473c80f7f'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:48.358257 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-3ccb00ee-90bd-4c75-a3af-a5249863b6d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cdbab6190f246e3b9675ee473c80f7f'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:48.376414 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-3ccb00ee-90bd-4c75-a3af-a5249863b6d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cdbab6190f246e3b9675ee473c80f7f'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:48.386077 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-3ccb00ee-90bd-4c75-a3af-a5249863b6d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cdbab6190f246e3b9675ee473c80f7f'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:48.412183 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1064/2112] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:48 2022] DELETE /identity/v3/users/7cdbab6190f246e3b9675ee473c80f7f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:48.418566 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ba6d8-ef97-4c8c-bcf1-63c462a8570c None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:48.419032 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ba6d8-ef97-4c8c-bcf1-63c462a8570c None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:48.419511 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ba6d8-ef97-4c8c-bcf1-63c462a8570c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:48.448921 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-2f5ba6d8-ef97-4c8c-bcf1-63c462a8570c None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:48.450836 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-2f5ba6d8-ef97-4c8c-bcf1-63c462a8570c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:48.460533 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435510df-b261-4f63-8c98-fa3eca37d523 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:48.583433 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1065/2113] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:51:48.589778 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ba6d8-ef97-4c8c-bcf1-63c462a8570c None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:48.591193 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c86e9c-c61b-4134-8969-808d318c8fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:48.591373 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-2f5ba6d8-ef97-4c8c-bcf1-63c462a8570c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:48.592154 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c86e9c-c61b-4134-8969-808d318c8fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:48.592445 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c86e9c-c61b-4134-8969-808d318c8fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:48.592706 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c86e9c-c61b-4134-8969-808d318c8fe5 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:48.593477 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c86e9c-c61b-4134-8969-808d318c8fe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:48.595440 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c86e9c-c61b-4134-8969-808d318c8fe5 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:48.653006 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1049/2114] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:48 2022] POST /identity/v3/users => generated 300 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:51:48.656636 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c86e9c-c61b-4134-8969-808d318c8fe5 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:48.658736 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-51c86e9c-c61b-4134-8969-808d318c8fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:48.666743 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ba6d8-ef97-4c8c-bcf1-63c462a8570c None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:48.680748 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c86e9c-c61b-4134-8969-808d318c8fe5 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:48.681318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca140efd-be73-4221-9234-d92b2a0c9394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:48.681318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca140efd-be73-4221-9234-d92b2a0c9394 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:48.681318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca140efd-be73-4221-9234-d92b2a0c9394 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:48.681318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca140efd-be73-4221-9234-d92b2a0c9394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:48.681644 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c37103-846a-49df-bcd8-e49d8d9003d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:48.684746 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c37103-846a-49df-bcd8-e49d8d9003d3 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:48.685134 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c37103-846a-49df-bcd8-e49d8d9003d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:48.685498 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c37103-846a-49df-bcd8-e49d8d9003d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:48.686333 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c37103-846a-49df-bcd8-e49d8d9003d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:48.687390 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca140efd-be73-4221-9234-d92b2a0c9394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:48.688909 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca140efd-be73-4221-9234-d92b2a0c9394 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:48.689847 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c37103-846a-49df-bcd8-e49d8d9003d3 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:48.700906 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1066/2115] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:51:48.701682 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1050/2116] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:51:48.705828 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca140efd-be73-4221-9234-d92b2a0c9394 service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:48.715348 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca140efd-be73-4221-9234-d92b2a0c9394 service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:48.720361 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e74dc9-60f1-47b9-b304-38a8f0e3bfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:48.721329 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e74dc9-60f1-47b9-b304-38a8f0e3bfc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:48.721586 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e74dc9-60f1-47b9-b304-38a8f0e3bfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:48.721848 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e74dc9-60f1-47b9-b304-38a8f0e3bfc5 admin admin] PATH_INFO: `/v3/projects/6e9c99b40b5941f6bd26fb368c9ea7e9/users/f42d48d3cb05458b88f453ddba5c46c6/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:48.750063 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e74dc9-60f1-47b9-b304-38a8f0e3bfc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9c99b40b5941f6bd26fb368c9ea7e9, user_id=f42d48d3cb05458b88f453ddba5c46c6, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:48.756464 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e74dc9-60f1-47b9-b304-38a8f0e3bfc5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:48.776034 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1067/2117] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:48 2022] PUT /identity/v3/projects/6e9c99b40b5941f6bd26fb368c9ea7e9/users/f42d48d3cb05458b88f453ddba5c46c6/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:48.782418 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c37103-846a-49df-bcd8-e49d8d9003d3 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:48.796830 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c37103-846a-49df-bcd8-e49d8d9003d3 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:48.869739 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5f7d7-22aa-41c2-8c7a-47982d3f8fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:48.870603 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5f7d7-22aa-41c2-8c7a-47982d3f8fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:48.871064 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5f7d7-22aa-41c2-8c7a-47982d3f8fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:48.872073 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5f7d7-22aa-41c2-8c7a-47982d3f8fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:48.873183 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5f7d7-22aa-41c2-8c7a-47982d3f8fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:48.875075 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5f7d7-22aa-41c2-8c7a-47982d3f8fa8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:48.889082 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1051/2118] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:48.894062 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e74dc9-60f1-47b9-b304-38a8f0e3bfc5 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:48.908222 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e74dc9-60f1-47b9-b304-38a8f0e3bfc5 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:48.913578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb81a6-9800-41a0-93c8-bfc8f5f321e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:48.914479 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb81a6-9800-41a0-93c8-bfc8f5f321e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:48.914761 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb81a6-9800-41a0-93c8-bfc8f5f321e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:48.915155 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb81a6-9800-41a0-93c8-bfc8f5f321e6 admin admin] PATH_INFO: `/v3/projects/6e9c99b40b5941f6bd26fb368c9ea7e9/users/f42d48d3cb05458b88f453ddba5c46c6/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:48.917111 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb81a6-9800-41a0-93c8-bfc8f5f321e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9c99b40b5941f6bd26fb368c9ea7e9, user_id=f42d48d3cb05458b88f453ddba5c46c6, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:48.919902 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb81a6-9800-41a0-93c8-bfc8f5f321e6 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:48.933859 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1068/2119] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:48 2022] PUT /identity/v3/projects/6e9c99b40b5941f6bd26fb368c9ea7e9/users/f42d48d3cb05458b88f453ddba5c46c6/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:48.944808 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50afc5-5d38-42f0-85e5-284f6d93f3b4 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:48.945206 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50afc5-5d38-42f0-85e5-284f6d93f3b4 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:48.945859 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50afc5-5d38-42f0-85e5-284f6d93f3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:48.976315 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-bf50afc5-5d38-42f0-85e5-284f6d93f3b4 None None] MFA Rules not processed for user `f42d48d3cb05458b88f453ddba5c46c6`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:48.977739 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-bf50afc5-5d38-42f0-85e5-284f6d93f3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:49.043537 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb81a6-9800-41a0-93c8-bfc8f5f321e6 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:49.045831 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-8adb81a6-9800-41a0-93c8-bfc8f5f321e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:49.069369 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1052/2120] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:49.079702 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50afc5-5d38-42f0-85e5-284f6d93f3b4 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:49.081268 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-bf50afc5-5d38-42f0-85e5-284f6d93f3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:49.135279 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb81a6-9800-41a0-93c8-bfc8f5f321e6 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:49.140794 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f23e3-1254-447d-8f98-79fa6f5c4459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:49.141693 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f23e3-1254-447d-8f98-79fa6f5c4459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:49.142581 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f23e3-1254-447d-8f98-79fa6f5c4459 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:49.143311 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f23e3-1254-447d-8f98-79fa6f5c4459 admin admin] PATH_INFO: `/v3/projects/1d1be6e70eae4239af291ca5ad4f7b90` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:49.144921 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f23e3-1254-447d-8f98-79fa6f5c4459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1be6e70eae4239af291ca5ad4f7b90)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:49.147525 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f23e3-1254-447d-8f98-79fa6f5c4459 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:49.153529 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50afc5-5d38-42f0-85e5-284f6d93f3b4 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:49.157179 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19201012-7ae8-4bb7-851d-d91977a5d555 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:49.157820 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19201012-7ae8-4bb7-851d-d91977a5d555 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:49.158095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19201012-7ae8-4bb7-851d-d91977a5d555 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:49.158366 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19201012-7ae8-4bb7-851d-d91977a5d555 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:49.167832 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19201012-7ae8-4bb7-851d-d91977a5d555 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:49.169293 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19201012-7ae8-4bb7-851d-d91977a5d555 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:49.178316 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1053/2121] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:51:49.198052 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-dd4f23e3-1254-447d-8f98-79fa6f5c4459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1be6e70eae4239af291ca5ad4f7b90', 'request_id': 'req-dd4f23e3-1254-447d-8f98-79fa6f5c4459'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:49.203532 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-dd4f23e3-1254-447d-8f98-79fa6f5c4459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1be6e70eae4239af291ca5ad4f7b90', 'request_id': 'req-dd4f23e3-1254-447d-8f98-79fa6f5c4459'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:49.211923 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-dd4f23e3-1254-447d-8f98-79fa6f5c4459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1be6e70eae4239af291ca5ad4f7b90', 'request_id': 'req-dd4f23e3-1254-447d-8f98-79fa6f5c4459'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:49.223167 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-dd4f23e3-1254-447d-8f98-79fa6f5c4459 admin admin] The token cache is being invalidate because project 1d1be6e70eae4239af291ca5ad4f7b90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:49.223443 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-dd4f23e3-1254-447d-8f98-79fa6f5c4459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:49.224093 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-dd4f23e3-1254-447d-8f98-79fa6f5c4459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:49.225655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1069/2122] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:49 2022] DELETE /identity/v3/projects/1d1be6e70eae4239af291ca5ad4f7b90 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:49.231395 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09238033-f0a7-46a0-b78d-a42adfff7bbd None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:49.232401 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09238033-f0a7-46a0-b78d-a42adfff7bbd None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:49.232752 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09238033-f0a7-46a0-b78d-a42adfff7bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:49.251617 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-09238033-f0a7-46a0-b78d-a42adfff7bbd None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:49.252826 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-09238033-f0a7-46a0-b78d-a42adfff7bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:49.319084 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1054/2123] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:49.327488 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223a27f-328b-4757-9d53-c8ce525c3fa9 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:49.327703 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223a27f-328b-4757-9d53-c8ce525c3fa9 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:49.327987 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223a27f-328b-4757-9d53-c8ce525c3fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:49.347241 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-6223a27f-328b-4757-9d53-c8ce525c3fa9 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:49.348444 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-6223a27f-328b-4757-9d53-c8ce525c3fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:49.356732 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1070/2124] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:49.361338 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09238033-f0a7-46a0-b78d-a42adfff7bbd None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:49.371356 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09238033-f0a7-46a0-b78d-a42adfff7bbd None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:49.376273 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1e068-94ed-49dd-9a59-bc585041a4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:49.377003 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1e068-94ed-49dd-9a59-bc585041a4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:49.377283 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1e068-94ed-49dd-9a59-bc585041a4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:49.377556 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1e068-94ed-49dd-9a59-bc585041a4d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:49.378318 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1e068-94ed-49dd-9a59-bc585041a4d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:51:49.378622 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1e068-94ed-49dd-9a59-bc585041a4d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:49.380324 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1e068-94ed-49dd-9a59-bc585041a4d7 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:49.397452 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1055/2125] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:51:49.398898 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223a27f-328b-4757-9d53-c8ce525c3fa9 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:49.409757 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223a27f-328b-4757-9d53-c8ce525c3fa9 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:49.416394 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27588c42-77a2-4319-8f30-c9d39e922be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:49.417133 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27588c42-77a2-4319-8f30-c9d39e922be4 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:49.417769 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27588c42-77a2-4319-8f30-c9d39e922be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:49.418041 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27588c42-77a2-4319-8f30-c9d39e922be4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:49.419375 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27588c42-77a2-4319-8f30-c9d39e922be4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:49.421336 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27588c42-77a2-4319-8f30-c9d39e922be4 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:49.461197 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1071/2126] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:49 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:51:49.465345 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1e068-94ed-49dd-9a59-bc585041a4d7 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:49.475479 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1e068-94ed-49dd-9a59-bc585041a4d7 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:49.531470 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6e88d-0876-4a51-8850-3efb6c4cf874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:49.532145 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6e88d-0876-4a51-8850-3efb6c4cf874 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:49.532430 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6e88d-0876-4a51-8850-3efb6c4cf874 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:49.532724 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6e88d-0876-4a51-8850-3efb6c4cf874 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:49.533451 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6e88d-0876-4a51-8850-3efb6c4cf874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:49.535403 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6e88d-0876-4a51-8850-3efb6c4cf874 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:49.562117 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27588c42-77a2-4319-8f30-c9d39e922be4 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:49.563237 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1056/2127] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:49 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:49.574492 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27588c42-77a2-4319-8f30-c9d39e922be4 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:49.580266 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f82b5-c2e6-4db4-961d-0835f3c2a26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:49.581043 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f82b5-c2e6-4db4-961d-0835f3c2a26f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:49.581491 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f82b5-c2e6-4db4-961d-0835f3c2a26f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:49.581889 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f82b5-c2e6-4db4-961d-0835f3c2a26f admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:49.582668 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f82b5-c2e6-4db4-961d-0835f3c2a26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:49.584360 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f82b5-c2e6-4db4-961d-0835f3c2a26f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:49.596817 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1072/2128] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:49.600618 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6e88d-0876-4a51-8850-3efb6c4cf874 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:49.612654 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6e88d-0876-4a51-8850-3efb6c4cf874 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:49.619854 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cd062-4ca4-4d8d-9d39-a231ffb3c7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:49.620630 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cd062-4ca4-4d8d-9d39-a231ffb3c7ed admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:49.621062 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cd062-4ca4-4d8d-9d39-a231ffb3c7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:49.621463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cd062-4ca4-4d8d-9d39-a231ffb3c7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:49.622617 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51cd062-4ca4-4d8d-9d39-a231ffb3c7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:49.624122 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51cd062-4ca4-4d8d-9d39-a231ffb3c7ed admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:49.638989 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1057/2129] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:49.644352 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f82b5-c2e6-4db4-961d-0835f3c2a26f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:49.656168 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f82b5-c2e6-4db4-961d-0835f3c2a26f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:49.661393 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa9988-a669-4da2-b37e-ad77c31b9654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:49.662287 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa9988-a669-4da2-b37e-ad77c31b9654 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:49.662572 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa9988-a669-4da2-b37e-ad77c31b9654 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:49.662852 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa9988-a669-4da2-b37e-ad77c31b9654 admin admin] PATH_INFO: `/v3/projects/1534037e5ef84fb3927b7b675a9a77d3/users/a4bb1aab9d3b4a8e982edc6bf1ce634f/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:49.679394 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa9988-a669-4da2-b37e-ad77c31b9654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1534037e5ef84fb3927b7b675a9a77d3, user_id=a4bb1aab9d3b4a8e982edc6bf1ce634f, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:49.684346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa9988-a669-4da2-b37e-ad77c31b9654 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:49.700401 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1073/2130] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:49 2022] PUT /identity/v3/projects/1534037e5ef84fb3927b7b675a9a77d3/users/a4bb1aab9d3b4a8e982edc6bf1ce634f/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:49.711982 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f4db0-d9b1-443e-80cf-30b1ef71735b None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:49.712523 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f4db0-d9b1-443e-80cf-30b1ef71735b None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:49.713241 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f4db0-d9b1-443e-80cf-30b1ef71735b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:49.755246 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-da3f4db0-d9b1-443e-80cf-30b1ef71735b None None] MFA Rules not processed for user `a4bb1aab9d3b4a8e982edc6bf1ce634f`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:49.756622 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-da3f4db0-d9b1-443e-80cf-30b1ef71735b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:49.853294 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1058/2131] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:49.862555 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa9988-a669-4da2-b37e-ad77c31b9654 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:49.864303 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-8baa9988-a669-4da2-b37e-ad77c31b9654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:49.940375 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f4db0-d9b1-443e-80cf-30b1ef71735b None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:49.941870 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-da3f4db0-d9b1-443e-80cf-30b1ef71735b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:49.944253 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa9988-a669-4da2-b37e-ad77c31b9654 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:49.949517 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bce006-cd8e-4b5f-9826-5cd7c95d672e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:49.950479 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bce006-cd8e-4b5f-9826-5cd7c95d672e service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:49.950990 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bce006-cd8e-4b5f-9826-5cd7c95d672e service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:49.951435 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bce006-cd8e-4b5f-9826-5cd7c95d672e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:49.962242 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bce006-cd8e-4b5f-9826-5cd7c95d672e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:49.963923 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bce006-cd8e-4b5f-9826-5cd7c95d672e service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:49.985004 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1074/2132] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:50.024541 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f4db0-d9b1-443e-80cf-30b1ef71735b None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:50.029088 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6728f-a477-43b5-80fb-fc9595003a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:50.029960 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6728f-a477-43b5-80fb-fc9595003a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:50.030273 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6728f-a477-43b5-80fb-fc9595003a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:50.030550 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6728f-a477-43b5-80fb-fc9595003a63 admin admin] PATH_INFO: `/v3/users/7a840e1741dd44de958eabc7aa9f3b2e` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:50.031960 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6728f-a477-43b5-80fb-fc9595003a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a840e1741dd44de958eabc7aa9f3b2e)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:50.033924 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6728f-a477-43b5-80fb-fc9595003a63 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:50.080794 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-02b6728f-a477-43b5-80fb-fc9595003a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a840e1741dd44de958eabc7aa9f3b2e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:50.092257 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-02b6728f-a477-43b5-80fb-fc9595003a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a840e1741dd44de958eabc7aa9f3b2e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:50.098922 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-02b6728f-a477-43b5-80fb-fc9595003a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a840e1741dd44de958eabc7aa9f3b2e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:50.108655 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-02b6728f-a477-43b5-80fb-fc9595003a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a840e1741dd44de958eabc7aa9f3b2e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:50.109306 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-02b6728f-a477-43b5-80fb-fc9595003a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a840e1741dd44de958eabc7aa9f3b2e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:50.115155 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1059/2133] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:49 2022] DELETE /identity/v3/users/7a840e1741dd44de958eabc7aa9f3b2e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:51:50.119718 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895db00-90b1-4bcd-bcb1-e85fe84c135e None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:50.120011 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895db00-90b1-4bcd-bcb1-e85fe84c135e None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:50.120287 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895db00-90b1-4bcd-bcb1-e85fe84c135e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:50.137614 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-b895db00-90b1-4bcd-bcb1-e85fe84c135e None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:50.138885 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b895db00-90b1-4bcd-bcb1-e85fe84c135e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:50.198564 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1075/2134] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:50.208765 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6728f-a477-43b5-80fb-fc9595003a63 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:50.210185 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-02b6728f-a477-43b5-80fb-fc9595003a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:50.266768 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6728f-a477-43b5-80fb-fc9595003a63 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:50.271288 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606366a-5972-410d-8837-b0a2fb249175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:50.272103 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606366a-5972-410d-8837-b0a2fb249175 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:50.272396 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606366a-5972-410d-8837-b0a2fb249175 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:50.272714 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606366a-5972-410d-8837-b0a2fb249175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:50.283400 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606366a-5972-410d-8837-b0a2fb249175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:50.285118 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606366a-5972-410d-8837-b0a2fb249175 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:50.297062 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1060/2135] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:50.558087 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895db00-90b1-4bcd-bcb1-e85fe84c135e None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:50.559582 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b895db00-90b1-4bcd-bcb1-e85fe84c135e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:50.571420 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895db00-90b1-4bcd-bcb1-e85fe84c135e None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:50.576952 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfae94a-41a6-413d-8490-d6f07d2e7840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:50.577819 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfae94a-41a6-413d-8490-d6f07d2e7840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:50.578139 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfae94a-41a6-413d-8490-d6f07d2e7840 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:50.578412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfae94a-41a6-413d-8490-d6f07d2e7840 admin admin] PATH_INFO: `/v3/projects/e4d1f6bfc587457cb44df2e8ec2f242e` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:50.579703 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfae94a-41a6-413d-8490-d6f07d2e7840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d1f6bfc587457cb44df2e8ec2f242e)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:50.581655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfae94a-41a6-413d-8490-d6f07d2e7840 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:50.629713 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-1bfae94a-41a6-413d-8490-d6f07d2e7840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d1f6bfc587457cb44df2e8ec2f242e', 'request_id': 'req-1bfae94a-41a6-413d-8490-d6f07d2e7840'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:50.634950 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-1bfae94a-41a6-413d-8490-d6f07d2e7840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d1f6bfc587457cb44df2e8ec2f242e', 'request_id': 'req-1bfae94a-41a6-413d-8490-d6f07d2e7840'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:50.643572 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-1bfae94a-41a6-413d-8490-d6f07d2e7840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d1f6bfc587457cb44df2e8ec2f242e', 'request_id': 'req-1bfae94a-41a6-413d-8490-d6f07d2e7840'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:50.654619 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-1bfae94a-41a6-413d-8490-d6f07d2e7840 admin admin] The token cache is being invalidate because project e4d1f6bfc587457cb44df2e8ec2f242e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:50.654928 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-1bfae94a-41a6-413d-8490-d6f07d2e7840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:50.655586 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-1bfae94a-41a6-413d-8490-d6f07d2e7840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:50.657228 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1076/2136] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:50 2022] DELETE /identity/v3/projects/e4d1f6bfc587457cb44df2e8ec2f242e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:50.661228 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606366a-5972-410d-8837-b0a2fb249175 service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:50.670681 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606366a-5972-410d-8837-b0a2fb249175 service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:50.730498 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd600eb-2594-4b58-b120-587055a985c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:50.731376 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd600eb-2594-4b58-b120-587055a985c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:50.731651 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd600eb-2594-4b58-b120-587055a985c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:50.731917 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd600eb-2594-4b58-b120-587055a985c3 admin admin] PATH_INFO: `/v3/users/f42d48d3cb05458b88f453ddba5c46c6` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:50.733248 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd600eb-2594-4b58-b120-587055a985c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f42d48d3cb05458b88f453ddba5c46c6)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:50.735232 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd600eb-2594-4b58-b120-587055a985c3 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:50.787323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-cbd600eb-2594-4b58-b120-587055a985c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f42d48d3cb05458b88f453ddba5c46c6'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:50.800957 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-cbd600eb-2594-4b58-b120-587055a985c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f42d48d3cb05458b88f453ddba5c46c6'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:50.808581 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-cbd600eb-2594-4b58-b120-587055a985c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f42d48d3cb05458b88f453ddba5c46c6'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:50.815668 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-cbd600eb-2594-4b58-b120-587055a985c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f42d48d3cb05458b88f453ddba5c46c6'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:50.816456 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-cbd600eb-2594-4b58-b120-587055a985c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f42d48d3cb05458b88f453ddba5c46c6'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:50.823194 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1061/2137] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:50 2022] DELETE /identity/v3/users/f42d48d3cb05458b88f453ddba5c46c6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:51.209987 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfae94a-41a6-413d-8490-d6f07d2e7840 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:51.211548 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-1bfae94a-41a6-413d-8490-d6f07d2e7840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:51.224157 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfae94a-41a6-413d-8490-d6f07d2e7840 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:51.290086 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea666714-e9a8-4a94-8d20-b7f92f803fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:51.290949 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea666714-e9a8-4a94-8d20-b7f92f803fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:51.291267 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea666714-e9a8-4a94-8d20-b7f92f803fab admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:51.291521 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea666714-e9a8-4a94-8d20-b7f92f803fab admin admin] PATH_INFO: `/v3/projects/6e9c99b40b5941f6bd26fb368c9ea7e9` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:51.292714 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea666714-e9a8-4a94-8d20-b7f92f803fab admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9c99b40b5941f6bd26fb368c9ea7e9)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:51.294653 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea666714-e9a8-4a94-8d20-b7f92f803fab admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:51.342530 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ea666714-e9a8-4a94-8d20-b7f92f803fab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9c99b40b5941f6bd26fb368c9ea7e9', 'request_id': 'req-ea666714-e9a8-4a94-8d20-b7f92f803fab'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:51.348152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ea666714-e9a8-4a94-8d20-b7f92f803fab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9c99b40b5941f6bd26fb368c9ea7e9', 'request_id': 'req-ea666714-e9a8-4a94-8d20-b7f92f803fab'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:51.357205 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ea666714-e9a8-4a94-8d20-b7f92f803fab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9c99b40b5941f6bd26fb368c9ea7e9', 'request_id': 'req-ea666714-e9a8-4a94-8d20-b7f92f803fab'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:51.380288 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ea666714-e9a8-4a94-8d20-b7f92f803fab admin admin] The token cache is being invalidate because project 6e9c99b40b5941f6bd26fb368c9ea7e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:51.380583 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ea666714-e9a8-4a94-8d20-b7f92f803fab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:51.381366 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ea666714-e9a8-4a94-8d20-b7f92f803fab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:51.383335 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1077/2138] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:51 2022] DELETE /identity/v3/projects/6e9c99b40b5941f6bd26fb368c9ea7e9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:51.390748 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0cba5-3f05-403c-aad2-3844acf910f5 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:51.391034 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0cba5-3f05-403c-aad2-3844acf910f5 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:51.391311 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0cba5-3f05-403c-aad2-3844acf910f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:51.414891 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-60f0cba5-3f05-403c-aad2-3844acf910f5 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:51.416083 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-60f0cba5-3f05-403c-aad2-3844acf910f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:51.484720 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1062/2139] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:51.494022 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d2db7-c78c-4363-b7ce-f93b473abd81 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:51.494323 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d2db7-c78c-4363-b7ce-f93b473abd81 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:51.494601 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d2db7-c78c-4363-b7ce-f93b473abd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:51.517169 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-311d2db7-c78c-4363-b7ce-f93b473abd81 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:51.518477 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-311d2db7-c78c-4363-b7ce-f93b473abd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:51.527892 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1078/2140] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:51.532221 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0cba5-3f05-403c-aad2-3844acf910f5 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:51.543865 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0cba5-3f05-403c-aad2-3844acf910f5 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:51.557814 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4465eba-ed48-4e93-a865-b7f3278da8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:51.558685 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4465eba-ed48-4e93-a865-b7f3278da8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:51.559056 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4465eba-ed48-4e93-a865-b7f3278da8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:51.559334 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4465eba-ed48-4e93-a865-b7f3278da8e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:51.560206 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4465eba-ed48-4e93-a865-b7f3278da8e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:51:51.560554 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4465eba-ed48-4e93-a865-b7f3278da8e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:51.562491 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4465eba-ed48-4e93-a865-b7f3278da8e1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:51.575740 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1063/2141] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:51:51.579969 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d2db7-c78c-4363-b7ce-f93b473abd81 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:51.589800 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d2db7-c78c-4363-b7ce-f93b473abd81 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:51.597514 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adb257-a6fd-4c8c-a826-84c6eff043b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:51.598186 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adb257-a6fd-4c8c-a826-84c6eff043b6 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:51.598497 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adb257-a6fd-4c8c-a826-84c6eff043b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:51.598732 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adb257-a6fd-4c8c-a826-84c6eff043b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:51.599549 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adb257-a6fd-4c8c-a826-84c6eff043b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:51.601579 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adb257-a6fd-4c8c-a826-84c6eff043b6 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:51.627977 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1079/2142] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:51:51 2022] POST /identity/v3/projects => generated 359 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:51.632631 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4465eba-ed48-4e93-a865-b7f3278da8e1 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:51.643361 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4465eba-ed48-4e93-a865-b7f3278da8e1 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:51.704359 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef508fe1-3fe0-49e9-9281-032c2c0f9974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:51.705148 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef508fe1-3fe0-49e9-9281-032c2c0f9974 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:51.705507 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef508fe1-3fe0-49e9-9281-032c2c0f9974 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:51.705846 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef508fe1-3fe0-49e9-9281-032c2c0f9974 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:51.706688 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef508fe1-3fe0-49e9-9281-032c2c0f9974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:51.708681 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef508fe1-3fe0-49e9-9281-032c2c0f9974 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:51.730721 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1064/2143] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:51:51 2022] POST /identity/v3/users => generated 280 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:51:51.734983 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adb257-a6fd-4c8c-a826-84c6eff043b6 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:51.746215 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adb257-a6fd-4c8c-a826-84c6eff043b6 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:51.750882 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da35a4-a5d3-4eef-9cc9-76647fcde172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:51.751558 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da35a4-a5d3-4eef-9cc9-76647fcde172 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:51.751836 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da35a4-a5d3-4eef-9cc9-76647fcde172 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:51.752138 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da35a4-a5d3-4eef-9cc9-76647fcde172 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:51.753073 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da35a4-a5d3-4eef-9cc9-76647fcde172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:51.754760 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da35a4-a5d3-4eef-9cc9-76647fcde172 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:51.765619 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1080/2144] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:51:51.769747 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef508fe1-3fe0-49e9-9281-032c2c0f9974 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:51.780017 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef508fe1-3fe0-49e9-9281-032c2c0f9974 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:51.785345 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315dd9c-7a95-42d4-9e87-773837810c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:51.786007 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315dd9c-7a95-42d4-9e87-773837810c34 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:51.786296 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315dd9c-7a95-42d4-9e87-773837810c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:51.786561 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315dd9c-7a95-42d4-9e87-773837810c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:51.787314 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315dd9c-7a95-42d4-9e87-773837810c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:51.789064 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315dd9c-7a95-42d4-9e87-773837810c34 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:51.799607 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1065/2145] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:51:51.803780 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da35a4-a5d3-4eef-9cc9-76647fcde172 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:51.813787 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da35a4-a5d3-4eef-9cc9-76647fcde172 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:51.818810 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d245e-fb8b-4418-8ecb-a3aaca367803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:51.819682 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d245e-fb8b-4418-8ecb-a3aaca367803 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:51.819960 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d245e-fb8b-4418-8ecb-a3aaca367803 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:51.820228 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d245e-fb8b-4418-8ecb-a3aaca367803 admin admin] PATH_INFO: `/v3/projects/adeda89718424450890902a8aab55e04/users/68bbdee6b09d4abe9757a93a3822adb5/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:51.835927 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d245e-fb8b-4418-8ecb-a3aaca367803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adeda89718424450890902a8aab55e04, user_id=68bbdee6b09d4abe9757a93a3822adb5, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:51.838613 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d245e-fb8b-4418-8ecb-a3aaca367803 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:51.853524 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1081/2146] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:51:51 2022] PUT /identity/v3/projects/adeda89718424450890902a8aab55e04/users/68bbdee6b09d4abe9757a93a3822adb5/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:51.863916 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd27f22-0767-4686-93e6-e0b48a23963f None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:51.864204 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd27f22-0767-4686-93e6-e0b48a23963f None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:51.864481 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd27f22-0767-4686-93e6-e0b48a23963f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:51.890636 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-cdd27f22-0767-4686-93e6-e0b48a23963f None None] MFA Rules not processed for user `68bbdee6b09d4abe9757a93a3822adb5`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:51.891833 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-cdd27f22-0767-4686-93e6-e0b48a23963f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:51.962128 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1066/2147] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:51 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:51.989173 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d245e-fb8b-4418-8ecb-a3aaca367803 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:51.991175 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-9c3d245e-fb8b-4418-8ecb-a3aaca367803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:52.051482 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d245e-fb8b-4418-8ecb-a3aaca367803 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:52.057303 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041713c4-9c7e-4547-9e43-29c96cb8a746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:52.058318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041713c4-9c7e-4547-9e43-29c96cb8a746 service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:52.058877 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041713c4-9c7e-4547-9e43-29c96cb8a746 service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:52.059528 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041713c4-9c7e-4547-9e43-29c96cb8a746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:52.071356 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041713c4-9c7e-4547-9e43-29c96cb8a746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:52.072816 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041713c4-9c7e-4547-9e43-29c96cb8a746 service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:52.083491 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1082/2148] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:51 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:52.098845 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd27f22-0767-4686-93e6-e0b48a23963f None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:52.161999 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd27f22-0767-4686-93e6-e0b48a23963f None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:52.167345 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edc283-06fa-4741-be7c-2071ae99055b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:52.168203 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edc283-06fa-4741-be7c-2071ae99055b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:52.168572 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edc283-06fa-4741-be7c-2071ae99055b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:52.168809 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edc283-06fa-4741-be7c-2071ae99055b admin admin] PATH_INFO: `/v3/users/68bbdee6b09d4abe9757a93a3822adb5` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:52.170042 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edc283-06fa-4741-be7c-2071ae99055b admin admin] RBAC: Authorizing `identity:delete_user(user_id=68bbdee6b09d4abe9757a93a3822adb5)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:52.171946 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edc283-06fa-4741-be7c-2071ae99055b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:52.218903 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-62edc283-06fa-4741-be7c-2071ae99055b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68bbdee6b09d4abe9757a93a3822adb5'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:52.231763 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-62edc283-06fa-4741-be7c-2071ae99055b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68bbdee6b09d4abe9757a93a3822adb5'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:52.241172 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-62edc283-06fa-4741-be7c-2071ae99055b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68bbdee6b09d4abe9757a93a3822adb5'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:52.252211 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-62edc283-06fa-4741-be7c-2071ae99055b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68bbdee6b09d4abe9757a93a3822adb5'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:52.253175 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-62edc283-06fa-4741-be7c-2071ae99055b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68bbdee6b09d4abe9757a93a3822adb5'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:52.261239 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1067/2149] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:51:52 2022] DELETE /identity/v3/users/68bbdee6b09d4abe9757a93a3822adb5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:51:52.266692 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e41c14-c2e7-4a73-a91a-44d04820b0a5 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:52.267197 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e41c14-c2e7-4a73-a91a-44d04820b0a5 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:52.267411 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e41c14-c2e7-4a73-a91a-44d04820b0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:52.294688 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-a1e41c14-c2e7-4a73-a91a-44d04820b0a5 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:51:52.296785 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a1e41c14-c2e7-4a73-a91a-44d04820b0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:52.368212 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1083/2150] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:51:52.378281 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edc283-06fa-4741-be7c-2071ae99055b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:52.379946 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-62edc283-06fa-4741-be7c-2071ae99055b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:52.437312 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edc283-06fa-4741-be7c-2071ae99055b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:52.441665 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a31c0-580c-4efa-8903-3283de51c95d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:52.442310 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a31c0-580c-4efa-8903-3283de51c95d service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:52.442589 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a31c0-580c-4efa-8903-3283de51c95d service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:52.442864 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a31c0-580c-4efa-8903-3283de51c95d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:52.453029 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a31c0-580c-4efa-8903-3283de51c95d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:52.454564 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a31c0-580c-4efa-8903-3283de51c95d service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:52.464103 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1068/2151] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:51:52.747347 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e41c14-c2e7-4a73-a91a-44d04820b0a5 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:51:52.748932 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a1e41c14-c2e7-4a73-a91a-44d04820b0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:51:52.767994 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e41c14-c2e7-4a73-a91a-44d04820b0a5 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:51:52.773948 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0794b69-6860-4d2d-9fb6-e0e00d5c193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:51:52.775421 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0794b69-6860-4d2d-9fb6-e0e00d5c193a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:51:52.775421 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0794b69-6860-4d2d-9fb6-e0e00d5c193a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:51:52.775421 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0794b69-6860-4d2d-9fb6-e0e00d5c193a admin admin] PATH_INFO: `/v3/projects/adeda89718424450890902a8aab55e04` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:51:52.776563 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0794b69-6860-4d2d-9fb6-e0e00d5c193a admin admin] RBAC: Authorizing `identity:delete_project(project_id=adeda89718424450890902a8aab55e04)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:51:52.778485 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0794b69-6860-4d2d-9fb6-e0e00d5c193a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:51:52.832280 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d0794b69-6860-4d2d-9fb6-e0e00d5c193a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adeda89718424450890902a8aab55e04', 'request_id': 'req-d0794b69-6860-4d2d-9fb6-e0e00d5c193a'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:52.839815 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d0794b69-6860-4d2d-9fb6-e0e00d5c193a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adeda89718424450890902a8aab55e04', 'request_id': 'req-d0794b69-6860-4d2d-9fb6-e0e00d5c193a'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:52.848339 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d0794b69-6860-4d2d-9fb6-e0e00d5c193a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adeda89718424450890902a8aab55e04', 'request_id': 'req-d0794b69-6860-4d2d-9fb6-e0e00d5c193a'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:52.861050 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d0794b69-6860-4d2d-9fb6-e0e00d5c193a admin admin] The token cache is being invalidate because project adeda89718424450890902a8aab55e04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:51:52.861338 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d0794b69-6860-4d2d-9fb6-e0e00d5c193a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:52.862040 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d0794b69-6860-4d2d-9fb6-e0e00d5c193a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:51:52.864007 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1084/2152] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:51:52 2022] DELETE /identity/v3/projects/adeda89718424450890902a8aab55e04 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:52:06.203269 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a31c0-580c-4efa-8903-3283de51c95d service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:06.204750 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-8e2a31c0-580c-4efa-8903-3283de51c95d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:06.217873 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a31c0-580c-4efa-8903-3283de51c95d service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:06.272222 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8f507-5b19-4c2f-bbee-a35fd2863f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:06.273544 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8f507-5b19-4c2f-bbee-a35fd2863f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:06.273959 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8f507-5b19-4c2f-bbee-a35fd2863f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:06.274235 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8f507-5b19-4c2f-bbee-a35fd2863f85 admin admin] PATH_INFO: `/v3/users/a4bb1aab9d3b4a8e982edc6bf1ce634f` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:06.275422 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8f507-5b19-4c2f-bbee-a35fd2863f85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4bb1aab9d3b4a8e982edc6bf1ce634f)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:06.277707 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8f507-5b19-4c2f-bbee-a35fd2863f85 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:06.328671 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-38e8f507-5b19-4c2f-bbee-a35fd2863f85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4bb1aab9d3b4a8e982edc6bf1ce634f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:06.340491 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-38e8f507-5b19-4c2f-bbee-a35fd2863f85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4bb1aab9d3b4a8e982edc6bf1ce634f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:06.347295 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-38e8f507-5b19-4c2f-bbee-a35fd2863f85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4bb1aab9d3b4a8e982edc6bf1ce634f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:06.355611 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-38e8f507-5b19-4c2f-bbee-a35fd2863f85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4bb1aab9d3b4a8e982edc6bf1ce634f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:06.356122 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-38e8f507-5b19-4c2f-bbee-a35fd2863f85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4bb1aab9d3b4a8e982edc6bf1ce634f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:06.363298 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1069/2153] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:52:06 2022] DELETE /identity/v3/users/a4bb1aab9d3b4a8e982edc6bf1ce634f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:52:06.367396 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da533e3-a5c5-41c9-828d-465c54aa59d8 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:06.367864 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da533e3-a5c5-41c9-828d-465c54aa59d8 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:06.367981 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da533e3-a5c5-41c9-828d-465c54aa59d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:06.386031 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-4da533e3-a5c5-41c9-828d-465c54aa59d8 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:06.387345 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-4da533e3-a5c5-41c9-828d-465c54aa59d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:06.446777 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1085/2154] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:52:06.456376 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8f507-5b19-4c2f-bbee-a35fd2863f85 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:06.457890 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-38e8f507-5b19-4c2f-bbee-a35fd2863f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:06.516045 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8f507-5b19-4c2f-bbee-a35fd2863f85 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:06.520205 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa130d4-789b-4ca5-b0ad-d1b3e55e0595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:06.520877 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa130d4-789b-4ca5-b0ad-d1b3e55e0595 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:06.521367 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa130d4-789b-4ca5-b0ad-d1b3e55e0595 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:06.521647 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa130d4-789b-4ca5-b0ad-d1b3e55e0595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:06.532026 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa130d4-789b-4ca5-b0ad-d1b3e55e0595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:06.533518 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa130d4-789b-4ca5-b0ad-d1b3e55e0595 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:06.542997 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1070/2155] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:52:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:52:06.839279 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da533e3-a5c5-41c9-828d-465c54aa59d8 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:06.841273 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-4da533e3-a5c5-41c9-828d-465c54aa59d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:06.861728 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da533e3-a5c5-41c9-828d-465c54aa59d8 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:06.866369 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a88c0-f9b9-4c84-a592-8fa696269e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:06.867221 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a88c0-f9b9-4c84-a592-8fa696269e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:06.867497 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a88c0-f9b9-4c84-a592-8fa696269e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:06.867845 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a88c0-f9b9-4c84-a592-8fa696269e58 admin admin] PATH_INFO: `/v3/projects/1534037e5ef84fb3927b7b675a9a77d3` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:06.868985 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a88c0-f9b9-4c84-a592-8fa696269e58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1534037e5ef84fb3927b7b675a9a77d3)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:06.871034 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a88c0-f9b9-4c84-a592-8fa696269e58 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:06.917436 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d62a88c0-f9b9-4c84-a592-8fa696269e58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1534037e5ef84fb3927b7b675a9a77d3', 'request_id': 'req-d62a88c0-f9b9-4c84-a592-8fa696269e58'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:06.922958 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d62a88c0-f9b9-4c84-a592-8fa696269e58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1534037e5ef84fb3927b7b675a9a77d3', 'request_id': 'req-d62a88c0-f9b9-4c84-a592-8fa696269e58'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:06.931968 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d62a88c0-f9b9-4c84-a592-8fa696269e58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1534037e5ef84fb3927b7b675a9a77d3', 'request_id': 'req-d62a88c0-f9b9-4c84-a592-8fa696269e58'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:06.943044 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d62a88c0-f9b9-4c84-a592-8fa696269e58 admin admin] The token cache is being invalidate because project 1534037e5ef84fb3927b7b675a9a77d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:52:06.943328 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d62a88c0-f9b9-4c84-a592-8fa696269e58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:06.943974 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d62a88c0-f9b9-4c84-a592-8fa696269e58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:06.945575 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1086/2156] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:52:06 2022] DELETE /identity/v3/projects/1534037e5ef84fb3927b7b675a9a77d3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:52:08.366733 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa130d4-789b-4ca5-b0ad-d1b3e55e0595 service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:08.368308 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-8aa130d4-789b-4ca5-b0ad-d1b3e55e0595 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:08.381517 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa130d4-789b-4ca5-b0ad-d1b3e55e0595 service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:08.437622 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d8dba-da03-4e89-8107-3666189cd8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:08.438500 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d8dba-da03-4e89-8107-3666189cd8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:08.438762 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d8dba-da03-4e89-8107-3666189cd8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:08.439045 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d8dba-da03-4e89-8107-3666189cd8f9 admin admin] PATH_INFO: `/v3/users/d4283e40300a4708a177e53ef95cedda` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:08.440386 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d8dba-da03-4e89-8107-3666189cd8f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4283e40300a4708a177e53ef95cedda)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:08.442347 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d8dba-da03-4e89-8107-3666189cd8f9 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:08.492938 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d91d8dba-da03-4e89-8107-3666189cd8f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4283e40300a4708a177e53ef95cedda'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:08.504309 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d91d8dba-da03-4e89-8107-3666189cd8f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4283e40300a4708a177e53ef95cedda'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:08.511100 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d91d8dba-da03-4e89-8107-3666189cd8f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4283e40300a4708a177e53ef95cedda'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:08.519779 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d91d8dba-da03-4e89-8107-3666189cd8f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4283e40300a4708a177e53ef95cedda'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:08.520427 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d91d8dba-da03-4e89-8107-3666189cd8f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4283e40300a4708a177e53ef95cedda'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:08.527351 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1071/2157] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:52:08 2022] DELETE /identity/v3/users/d4283e40300a4708a177e53ef95cedda => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:52:08.534524 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf9ac3-bc70-447e-8093-b097108b23ce None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:08.534524 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf9ac3-bc70-447e-8093-b097108b23ce None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:08.534524 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf9ac3-bc70-447e-8093-b097108b23ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:08.551635 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-48cf9ac3-bc70-447e-8093-b097108b23ce None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:08.552816 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-48cf9ac3-bc70-447e-8093-b097108b23ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:08.613150 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1087/2158] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:52:08.623447 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d8dba-da03-4e89-8107-3666189cd8f9 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:08.625159 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-d91d8dba-da03-4e89-8107-3666189cd8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:08.691896 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d8dba-da03-4e89-8107-3666189cd8f9 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:08.695685 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21017a-1f62-4b45-b1ca-2a05033668f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:08.696643 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21017a-1f62-4b45-b1ca-2a05033668f3 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:08.696961 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21017a-1f62-4b45-b1ca-2a05033668f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:08.697231 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21017a-1f62-4b45-b1ca-2a05033668f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:08.707236 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21017a-1f62-4b45-b1ca-2a05033668f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:08.708709 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21017a-1f62-4b45-b1ca-2a05033668f3 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:08.720999 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1072/2159] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:52:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:52:09.022775 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf9ac3-bc70-447e-8093-b097108b23ce None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:09.024976 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-48cf9ac3-bc70-447e-8093-b097108b23ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:09.037502 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf9ac3-bc70-447e-8093-b097108b23ce None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:09.042437 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e58656-1ef6-4337-bbc8-869b0937d9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:09.043303 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e58656-1ef6-4337-bbc8-869b0937d9bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:09.043582 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e58656-1ef6-4337-bbc8-869b0937d9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:09.043857 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e58656-1ef6-4337-bbc8-869b0937d9bc admin admin] PATH_INFO: `/v3/projects/8c0804e4f9b742cb82e550f4258d98e5` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:09.045115 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e58656-1ef6-4337-bbc8-869b0937d9bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c0804e4f9b742cb82e550f4258d98e5)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:09.047158 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e58656-1ef6-4337-bbc8-869b0937d9bc admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:09.095923 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-86e58656-1ef6-4337-bbc8-869b0937d9bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c0804e4f9b742cb82e550f4258d98e5', 'request_id': 'req-86e58656-1ef6-4337-bbc8-869b0937d9bc'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:09.101774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-86e58656-1ef6-4337-bbc8-869b0937d9bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c0804e4f9b742cb82e550f4258d98e5', 'request_id': 'req-86e58656-1ef6-4337-bbc8-869b0937d9bc'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:09.111933 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-86e58656-1ef6-4337-bbc8-869b0937d9bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c0804e4f9b742cb82e550f4258d98e5', 'request_id': 'req-86e58656-1ef6-4337-bbc8-869b0937d9bc'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:09.129762 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-86e58656-1ef6-4337-bbc8-869b0937d9bc admin admin] The token cache is being invalidate because project 8c0804e4f9b742cb82e550f4258d98e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:52:09.130190 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-86e58656-1ef6-4337-bbc8-869b0937d9bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:09.131244 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-86e58656-1ef6-4337-bbc8-869b0937d9bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:09.133364 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1088/2160] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:52:09 2022] DELETE /identity/v3/projects/8c0804e4f9b742cb82e550f4258d98e5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:52:09.139322 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dc017-0b8c-4443-b570-68315406523f None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:09.139504 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dc017-0b8c-4443-b570-68315406523f None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:09.139678 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dc017-0b8c-4443-b570-68315406523f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:09.168474 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-366dc017-0b8c-4443-b570-68315406523f None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:09.170584 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-366dc017-0b8c-4443-b570-68315406523f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:09.245760 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1073/2161] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:52:09.253909 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5951a-0ec1-4813-b2f1-10158b04408b None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:09.254391 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5951a-0ec1-4813-b2f1-10158b04408b None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:09.254671 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5951a-0ec1-4813-b2f1-10158b04408b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:09.275120 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-00c5951a-0ec1-4813-b2f1-10158b04408b None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:09.276391 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-00c5951a-0ec1-4813-b2f1-10158b04408b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:09.288102 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1089/2162] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:52:09.293403 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dc017-0b8c-4443-b570-68315406523f None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:09.304567 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dc017-0b8c-4443-b570-68315406523f None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:09.309685 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c29e4-0c4a-4d27-92c9-54526423ea0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:09.310512 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c29e4-0c4a-4d27-92c9-54526423ea0d admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:09.310741 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c29e4-0c4a-4d27-92c9-54526423ea0d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:09.311096 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c29e4-0c4a-4d27-92c9-54526423ea0d admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:09.311937 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c29e4-0c4a-4d27-92c9-54526423ea0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:52:09.312167 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c29e4-0c4a-4d27-92c9-54526423ea0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:09.316019 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c29e4-0c4a-4d27-92c9-54526423ea0d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:09.331951 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1074/2163] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:52:09.334841 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5951a-0ec1-4813-b2f1-10158b04408b None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:09.346246 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5951a-0ec1-4813-b2f1-10158b04408b None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:09.351785 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8375c-0a9f-4e9c-a88e-99f0bc1751b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:09.352718 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8375c-0a9f-4e9c-a88e-99f0bc1751b8 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:09.353087 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8375c-0a9f-4e9c-a88e-99f0bc1751b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:09.353376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8375c-0a9f-4e9c-a88e-99f0bc1751b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:09.354429 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8375c-0a9f-4e9c-a88e-99f0bc1751b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:09.356591 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8375c-0a9f-4e9c-a88e-99f0bc1751b8 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:09.384887 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1090/2164] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:52:09 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:52:09.389489 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c29e4-0c4a-4d27-92c9-54526423ea0d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:09.403925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c29e4-0c4a-4d27-92c9-54526423ea0d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:09.462525 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add80ec-3c7d-4fff-80af-fdef2af3f38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:09.463203 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add80ec-3c7d-4fff-80af-fdef2af3f38a admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:09.463510 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add80ec-3c7d-4fff-80af-fdef2af3f38a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:09.463785 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add80ec-3c7d-4fff-80af-fdef2af3f38a admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:09.464506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add80ec-3c7d-4fff-80af-fdef2af3f38a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:09.466485 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add80ec-3c7d-4fff-80af-fdef2af3f38a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:09.488346 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1075/2165] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:52:09 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:52:09.497733 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8375c-0a9f-4e9c-a88e-99f0bc1751b8 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:09.509212 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8375c-0a9f-4e9c-a88e-99f0bc1751b8 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:09.514685 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc95154-3043-46cf-8c59-f0e2e6281c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:09.515484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc95154-3043-46cf-8c59-f0e2e6281c0c admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:09.515831 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc95154-3043-46cf-8c59-f0e2e6281c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:09.516112 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc95154-3043-46cf-8c59-f0e2e6281c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:09.516896 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc95154-3043-46cf-8c59-f0e2e6281c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:09.518547 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc95154-3043-46cf-8c59-f0e2e6281c0c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:09.530038 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1091/2166] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:52:09.534117 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add80ec-3c7d-4fff-80af-fdef2af3f38a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:09.545477 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add80ec-3c7d-4fff-80af-fdef2af3f38a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:09.550402 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28331e4d-ae9d-4da4-9d25-34e16578dd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:09.550936 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28331e4d-ae9d-4da4-9d25-34e16578dd72 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:09.551224 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28331e4d-ae9d-4da4-9d25-34e16578dd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:09.551501 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28331e4d-ae9d-4da4-9d25-34e16578dd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:09.552254 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28331e4d-ae9d-4da4-9d25-34e16578dd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:09.553917 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28331e4d-ae9d-4da4-9d25-34e16578dd72 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:09.563830 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1076/2167] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:52:09.568867 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc95154-3043-46cf-8c59-f0e2e6281c0c admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:09.578919 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc95154-3043-46cf-8c59-f0e2e6281c0c admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:09.583659 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64064be4-71e9-4a00-bc61-9a3c5edddc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:09.584545 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64064be4-71e9-4a00-bc61-9a3c5edddc6b admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:09.584834 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64064be4-71e9-4a00-bc61-9a3c5edddc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:09.585119 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64064be4-71e9-4a00-bc61-9a3c5edddc6b admin admin] PATH_INFO: `/v3/projects/5132ffa32785494cb3d85fd060715085/users/b8981285eabd462e9700d756f7c5bf9f/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:09.601129 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64064be4-71e9-4a00-bc61-9a3c5edddc6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5132ffa32785494cb3d85fd060715085, user_id=b8981285eabd462e9700d756f7c5bf9f, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:09.603884 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64064be4-71e9-4a00-bc61-9a3c5edddc6b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:09.619713 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1092/2168] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:52:09 2022] PUT /identity/v3/projects/5132ffa32785494cb3d85fd060715085/users/b8981285eabd462e9700d756f7c5bf9f/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:52:09.630759 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0870c68-9d3a-458c-88d3-6c21ab6b9948 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:09.631044 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0870c68-9d3a-458c-88d3-6c21ab6b9948 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:09.631331 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0870c68-9d3a-458c-88d3-6c21ab6b9948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:09.659819 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-f0870c68-9d3a-458c-88d3-6c21ab6b9948 None None] MFA Rules not processed for user `b8981285eabd462e9700d756f7c5bf9f`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:09.661109 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-f0870c68-9d3a-458c-88d3-6c21ab6b9948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:09.736425 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1077/2169] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:52:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:52:09.745946 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64064be4-71e9-4a00-bc61-9a3c5edddc6b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:09.747840 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-64064be4-71e9-4a00-bc61-9a3c5edddc6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:09.807875 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64064be4-71e9-4a00-bc61-9a3c5edddc6b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:09.811569 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615a806-ad10-45fa-ba20-003f7dbd0dbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:09.812496 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615a806-ad10-45fa-ba20-003f7dbd0dbd service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:09.812781 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615a806-ad10-45fa-ba20-003f7dbd0dbd service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:09.813088 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615a806-ad10-45fa-ba20-003f7dbd0dbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:09.821650 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615a806-ad10-45fa-ba20-003f7dbd0dbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:09.823091 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615a806-ad10-45fa-ba20-003f7dbd0dbd service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:09.839643 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1093/2170] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:52:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:52:11.569509 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37addc2f-9ef7-4ef8-8192-5bae06c38840 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:11.570055 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37addc2f-9ef7-4ef8-8192-5bae06c38840 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:11.570353 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37addc2f-9ef7-4ef8-8192-5bae06c38840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:11.588635 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-37addc2f-9ef7-4ef8-8192-5bae06c38840 None None] MFA Rules not processed for user `3284aee452cd4b0483a2044d36a3e357`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:11.589843 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-37addc2f-9ef7-4ef8-8192-5bae06c38840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:11.654819 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1078/2171] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:52:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:52:30.149135 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615a806-ad10-45fa-ba20-003f7dbd0dbd service cinder] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:30.211135 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615a806-ad10-45fa-ba20-003f7dbd0dbd service cinder] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:30.215897 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca446f1-2e22-4f3b-97c9-fdc9eb0303ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:30.216761 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca446f1-2e22-4f3b-97c9-fdc9eb0303ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:30.217068 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca446f1-2e22-4f3b-97c9-fdc9eb0303ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:30.217338 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca446f1-2e22-4f3b-97c9-fdc9eb0303ea admin admin] PATH_INFO: `/v3/users/b8981285eabd462e9700d756f7c5bf9f` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:30.218563 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca446f1-2e22-4f3b-97c9-fdc9eb0303ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8981285eabd462e9700d756f7c5bf9f)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:30.220478 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca446f1-2e22-4f3b-97c9-fdc9eb0303ea admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:30.268811 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-9ca446f1-2e22-4f3b-97c9-fdc9eb0303ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8981285eabd462e9700d756f7c5bf9f'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:30.269567 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-9ca446f1-2e22-4f3b-97c9-fdc9eb0303ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8981285eabd462e9700d756f7c5bf9f'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:30.270272 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-9ca446f1-2e22-4f3b-97c9-fdc9eb0303ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8981285eabd462e9700d756f7c5bf9f'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:30.283793 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-9ca446f1-2e22-4f3b-97c9-fdc9eb0303ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8981285eabd462e9700d756f7c5bf9f'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:30.291288 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-9ca446f1-2e22-4f3b-97c9-fdc9eb0303ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8981285eabd462e9700d756f7c5bf9f'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:30.305408 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1094/2172] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:52:30 2022] DELETE /identity/v3/users/b8981285eabd462e9700d756f7c5bf9f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:52:30.310229 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8ca0c-1d8f-4a44-a975-6644c8e45235 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:30.310905 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8ca0c-1d8f-4a44-a975-6644c8e45235 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:30.310905 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8ca0c-1d8f-4a44-a975-6644c8e45235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:30.328827 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-a4d8ca0c-1d8f-4a44-a975-6644c8e45235 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:30.330200 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-a4d8ca0c-1d8f-4a44-a975-6644c8e45235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:30.389204 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1079/2173] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:52:30.400199 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca446f1-2e22-4f3b-97c9-fdc9eb0303ea admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:30.402027 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-9ca446f1-2e22-4f3b-97c9-fdc9eb0303ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:30.456448 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca446f1-2e22-4f3b-97c9-fdc9eb0303ea admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:30.460141 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f51dc-fc0a-431f-8278-63b7895ad048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:30.460775 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f51dc-fc0a-431f-8278-63b7895ad048 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:30.461084 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f51dc-fc0a-431f-8278-63b7895ad048 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:30.461354 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f51dc-fc0a-431f-8278-63b7895ad048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:30.470435 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f51dc-fc0a-431f-8278-63b7895ad048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:30.471879 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f51dc-fc0a-431f-8278-63b7895ad048 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:30.481140 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1095/2174] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:52:30.794968 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8ca0c-1d8f-4a44-a975-6644c8e45235 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:30.797540 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-a4d8ca0c-1d8f-4a44-a975-6644c8e45235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:30.812804 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8ca0c-1d8f-4a44-a975-6644c8e45235 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:30.819824 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c6c8a-a804-4536-a320-c01ee26beb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:30.821206 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c6c8a-a804-4536-a320-c01ee26beb2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:30.821638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c6c8a-a804-4536-a320-c01ee26beb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:30.821985 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c6c8a-a804-4536-a320-c01ee26beb2b admin admin] PATH_INFO: `/v3/projects/5132ffa32785494cb3d85fd060715085` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:30.823467 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c6c8a-a804-4536-a320-c01ee26beb2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5132ffa32785494cb3d85fd060715085)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:30.826137 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c6c8a-a804-4536-a320-c01ee26beb2b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:30.882280 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a24c6c8a-a804-4536-a320-c01ee26beb2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5132ffa32785494cb3d85fd060715085', 'request_id': 'req-a24c6c8a-a804-4536-a320-c01ee26beb2b'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:30.888787 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a24c6c8a-a804-4536-a320-c01ee26beb2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5132ffa32785494cb3d85fd060715085', 'request_id': 'req-a24c6c8a-a804-4536-a320-c01ee26beb2b'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:30.899313 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a24c6c8a-a804-4536-a320-c01ee26beb2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5132ffa32785494cb3d85fd060715085', 'request_id': 'req-a24c6c8a-a804-4536-a320-c01ee26beb2b'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:30.910369 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a24c6c8a-a804-4536-a320-c01ee26beb2b admin admin] The token cache is being invalidate because project 5132ffa32785494cb3d85fd060715085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:52:30.910660 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a24c6c8a-a804-4536-a320-c01ee26beb2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:30.911315 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a24c6c8a-a804-4536-a320-c01ee26beb2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:30.912887 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1080/2175] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:52:30 2022] DELETE /identity/v3/projects/5132ffa32785494cb3d85fd060715085 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:52:30.921011 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb5c7d-8618-4070-b800-e527c5351497 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:30.921393 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb5c7d-8618-4070-b800-e527c5351497 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:30.921668 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb5c7d-8618-4070-b800-e527c5351497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:30.939925 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-47eb5c7d-8618-4070-b800-e527c5351497 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:30.941153 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-47eb5c7d-8618-4070-b800-e527c5351497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:31.000113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1096/2176] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:52:31.007718 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee34c21-28fd-4cc3-b62d-34cf42dcf408 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:31.008004 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee34c21-28fd-4cc3-b62d-34cf42dcf408 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:31.008280 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee34c21-28fd-4cc3-b62d-34cf42dcf408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:31.027154 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-dee34c21-28fd-4cc3-b62d-34cf42dcf408 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:31.028315 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-dee34c21-28fd-4cc3-b62d-34cf42dcf408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:31.036459 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1081/2177] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:52:31.040930 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb5c7d-8618-4070-b800-e527c5351497 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:31.050617 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb5c7d-8618-4070-b800-e527c5351497 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:31.055364 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0feec-68df-4e98-90ec-2320494abccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:31.056006 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0feec-68df-4e98-90ec-2320494abccc admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:31.056290 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0feec-68df-4e98-90ec-2320494abccc admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:31.056566 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0feec-68df-4e98-90ec-2320494abccc admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:31.057334 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0feec-68df-4e98-90ec-2320494abccc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:52:31.057643 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0feec-68df-4e98-90ec-2320494abccc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:31.059240 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0feec-68df-4e98-90ec-2320494abccc admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:31.070578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1097/2178] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:52:31.074768 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee34c21-28fd-4cc3-b62d-34cf42dcf408 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:31.084467 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee34c21-28fd-4cc3-b62d-34cf42dcf408 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:31.090710 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4857f1-0632-4b31-a4d5-c1c4a6c4bf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:31.091516 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4857f1-0632-4b31-a4d5-c1c4a6c4bf59 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:31.091800 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4857f1-0632-4b31-a4d5-c1c4a6c4bf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:31.092254 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4857f1-0632-4b31-a4d5-c1c4a6c4bf59 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:31.093008 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4857f1-0632-4b31-a4d5-c1c4a6c4bf59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:31.094970 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4857f1-0632-4b31-a4d5-c1c4a6c4bf59 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:31.098095 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0feec-68df-4e98-90ec-2320494abccc admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:31.099787 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-d0f0feec-68df-4e98-90ec-2320494abccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:31.112579 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0feec-68df-4e98-90ec-2320494abccc admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:31.118628 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd746d7c-aa19-4a5c-8b0a-c9d22de9d24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:31.119524 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd746d7c-aa19-4a5c-8b0a-c9d22de9d24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:31.119770 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd746d7c-aa19-4a5c-8b0a-c9d22de9d24e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:31.120072 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd746d7c-aa19-4a5c-8b0a-c9d22de9d24e admin admin] PATH_INFO: `/v3/users/fb5f92e5ec44444f878b0e5aab9eccd1` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:31.121382 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd746d7c-aa19-4a5c-8b0a-c9d22de9d24e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb5f92e5ec44444f878b0e5aab9eccd1)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:31.123493 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd746d7c-aa19-4a5c-8b0a-c9d22de9d24e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:31.127370 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1082/2179] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:52:31 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:52:31.131174 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4857f1-0632-4b31-a4d5-c1c4a6c4bf59 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:31.172738 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-cd746d7c-aa19-4a5c-8b0a-c9d22de9d24e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb5f92e5ec44444f878b0e5aab9eccd1'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:31.173465 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-cd746d7c-aa19-4a5c-8b0a-c9d22de9d24e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb5f92e5ec44444f878b0e5aab9eccd1'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:31.174037 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-cd746d7c-aa19-4a5c-8b0a-c9d22de9d24e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb5f92e5ec44444f878b0e5aab9eccd1'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:31.185360 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-cd746d7c-aa19-4a5c-8b0a-c9d22de9d24e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb5f92e5ec44444f878b0e5aab9eccd1'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:31.189946 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4857f1-0632-4b31-a4d5-c1c4a6c4bf59 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:31.191865 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-cd746d7c-aa19-4a5c-8b0a-c9d22de9d24e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb5f92e5ec44444f878b0e5aab9eccd1'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:31.194605 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8ad5b-c036-4a97-a191-408b45a11342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:31.195278 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8ad5b-c036-4a97-a191-408b45a11342 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:31.195560 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8ad5b-c036-4a97-a191-408b45a11342 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:31.195831 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8ad5b-c036-4a97-a191-408b45a11342 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:31.196541 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b8ad5b-c036-4a97-a191-408b45a11342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:31.198484 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b8ad5b-c036-4a97-a191-408b45a11342 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:31.205160 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1098/2180] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:52:31 2022] DELETE /identity/v3/users/fb5f92e5ec44444f878b0e5aab9eccd1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:52:31.209493 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897f312-c533-4e1f-b2c7-66a2bdbfcc32 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:31.209777 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897f312-c533-4e1f-b2c7-66a2bdbfcc32 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:31.210058 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897f312-c533-4e1f-b2c7-66a2bdbfcc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:31.219952 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1083/2181] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:52:31 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:52:31.223957 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8ad5b-c036-4a97-a191-408b45a11342 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:31.225783 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-38b8ad5b-c036-4a97-a191-408b45a11342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:31.226843 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-a897f312-c533-4e1f-b2c7-66a2bdbfcc32 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:31.227999 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a897f312-c533-4e1f-b2c7-66a2bdbfcc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:31.238424 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8ad5b-c036-4a97-a191-408b45a11342 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:31.286602 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1099/2182] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:52:31.294685 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674452ff-400a-40ae-9ff8-3aa08ae957e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:31.295435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674452ff-400a-40ae-9ff8-3aa08ae957e9 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:31.295749 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674452ff-400a-40ae-9ff8-3aa08ae957e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:31.296025 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674452ff-400a-40ae-9ff8-3aa08ae957e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:31.296275 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897f312-c533-4e1f-b2c7-66a2bdbfcc32 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:31.296769 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674452ff-400a-40ae-9ff8-3aa08ae957e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:31.297666 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a897f312-c533-4e1f-b2c7-66a2bdbfcc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:31.298443 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674452ff-400a-40ae-9ff8-3aa08ae957e9 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:31.308894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1084/2183] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:52:31.312208 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674452ff-400a-40ae-9ff8-3aa08ae957e9 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:31.321289 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674452ff-400a-40ae-9ff8-3aa08ae957e9 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:31.325782 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf38080-5254-40d5-9dc9-dc4d9cb933b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:31.326419 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf38080-5254-40d5-9dc9-dc4d9cb933b2 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:31.326703 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf38080-5254-40d5-9dc9-dc4d9cb933b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:31.327005 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf38080-5254-40d5-9dc9-dc4d9cb933b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:31.327737 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf38080-5254-40d5-9dc9-dc4d9cb933b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:31.329358 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf38080-5254-40d5-9dc9-dc4d9cb933b2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:31.341924 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1085/2184] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:52:31.342915 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf38080-5254-40d5-9dc9-dc4d9cb933b2 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:31.351480 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897f312-c533-4e1f-b2c7-66a2bdbfcc32 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:31.352097 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf38080-5254-40d5-9dc9-dc4d9cb933b2 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:31.355059 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70394100-588e-44a0-bd7f-8bd8a6f1c2f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:31.355699 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70394100-588e-44a0-bd7f-8bd8a6f1c2f1 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:31.355997 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70394100-588e-44a0-bd7f-8bd8a6f1c2f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:31.356258 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70394100-588e-44a0-bd7f-8bd8a6f1c2f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:31.356617 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d652eb-b28b-49a1-aa0c-a5b68482b095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:31.357520 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d652eb-b28b-49a1-aa0c-a5b68482b095 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:31.357802 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d652eb-b28b-49a1-aa0c-a5b68482b095 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:31.358079 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d652eb-b28b-49a1-aa0c-a5b68482b095 admin admin] PATH_INFO: `/v3/projects/ad60695fc58746f490b20a5b2459b6ae/users/4636015d590c40fca1f4c9996a871b57/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:31.365305 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70394100-588e-44a0-bd7f-8bd8a6f1c2f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:31.366740 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70394100-588e-44a0-bd7f-8bd8a6f1c2f1 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:31.372629 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d652eb-b28b-49a1-aa0c-a5b68482b095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad60695fc58746f490b20a5b2459b6ae, user_id=4636015d590c40fca1f4c9996a871b57, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:31.375417 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d652eb-b28b-49a1-aa0c-a5b68482b095 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:31.376152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1100/2185] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:52:31.389480 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1086/2186] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:52:31 2022] PUT /identity/v3/projects/ad60695fc58746f490b20a5b2459b6ae/users/4636015d590c40fca1f4c9996a871b57/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:52:31.394438 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1cfa8-87bd-4e48-955a-24587c628988 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:31.394919 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1cfa8-87bd-4e48-955a-24587c628988 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:31.395202 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1cfa8-87bd-4e48-955a-24587c628988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:31.412979 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-a1d1cfa8-87bd-4e48-955a-24587c628988 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:31.414180 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a1d1cfa8-87bd-4e48-955a-24587c628988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:31.481569 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1101/2187] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:52:31.491017 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d652eb-b28b-49a1-aa0c-a5b68482b095 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:31.492904 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-04d652eb-b28b-49a1-aa0c-a5b68482b095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:31.564765 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d652eb-b28b-49a1-aa0c-a5b68482b095 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:31.568723 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfa4d7-0c26-4dc0-8d37-658957e408c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:31.569152 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfa4d7-0c26-4dc0-8d37-658957e408c6 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:31.569435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfa4d7-0c26-4dc0-8d37-658957e408c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:31.569711 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfa4d7-0c26-4dc0-8d37-658957e408c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:31.579521 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfa4d7-0c26-4dc0-8d37-658957e408c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:31.580995 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfa4d7-0c26-4dc0-8d37-658957e408c6 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:31.590846 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1087/2188] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:52:31.723481 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1cfa8-87bd-4e48-955a-24587c628988 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:31.725400 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a1d1cfa8-87bd-4e48-955a-24587c628988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:31.737860 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1cfa8-87bd-4e48-955a-24587c628988 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:31.743164 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acbe08-8f66-42b8-9a31-5e04fbe57784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:31.744122 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acbe08-8f66-42b8-9a31-5e04fbe57784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:31.744493 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acbe08-8f66-42b8-9a31-5e04fbe57784 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:31.744869 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acbe08-8f66-42b8-9a31-5e04fbe57784 admin admin] PATH_INFO: `/v3/projects/3009e50ec2514783902558a115bb4362` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:31.746206 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0acbe08-8f66-42b8-9a31-5e04fbe57784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3009e50ec2514783902558a115bb4362)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:31.748137 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0acbe08-8f66-42b8-9a31-5e04fbe57784 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:31.796874 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-e0acbe08-8f66-42b8-9a31-5e04fbe57784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3009e50ec2514783902558a115bb4362', 'request_id': 'req-e0acbe08-8f66-42b8-9a31-5e04fbe57784'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:31.802709 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-e0acbe08-8f66-42b8-9a31-5e04fbe57784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3009e50ec2514783902558a115bb4362', 'request_id': 'req-e0acbe08-8f66-42b8-9a31-5e04fbe57784'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:31.809532 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-e0acbe08-8f66-42b8-9a31-5e04fbe57784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3009e50ec2514783902558a115bb4362', 'request_id': 'req-e0acbe08-8f66-42b8-9a31-5e04fbe57784'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:31.821615 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-e0acbe08-8f66-42b8-9a31-5e04fbe57784 admin admin] The token cache is being invalidate because project 3009e50ec2514783902558a115bb4362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:52:31.821905 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-e0acbe08-8f66-42b8-9a31-5e04fbe57784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:31.822539 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-e0acbe08-8f66-42b8-9a31-5e04fbe57784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:31.824122 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1102/2189] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:52:31 2022] DELETE /identity/v3/projects/3009e50ec2514783902558a115bb4362 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:52:31.830465 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef2e79-ff53-4309-ba05-9013f828606d None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:31.830911 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef2e79-ff53-4309-ba05-9013f828606d None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:31.831270 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef2e79-ff53-4309-ba05-9013f828606d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:31.851201 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-a5ef2e79-ff53-4309-ba05-9013f828606d None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:31.852514 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-a5ef2e79-ff53-4309-ba05-9013f828606d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:31.920929 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1088/2190] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:52:31.928789 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e40cf-81c0-4d4d-8494-c9568b8be5c3 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:31.929115 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e40cf-81c0-4d4d-8494-c9568b8be5c3 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:31.929395 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e40cf-81c0-4d4d-8494-c9568b8be5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:31.947660 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-fd4e40cf-81c0-4d4d-8494-c9568b8be5c3 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:31.948878 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-fd4e40cf-81c0-4d4d-8494-c9568b8be5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:31.957122 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1103/2191] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:52:31.961547 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef2e79-ff53-4309-ba05-9013f828606d None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:31.971806 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef2e79-ff53-4309-ba05-9013f828606d None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:31.976896 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7ed71-9a4c-4f72-af2e-2020410a588a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:31.977567 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7ed71-9a4c-4f72-af2e-2020410a588a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:31.977850 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7ed71-9a4c-4f72-af2e-2020410a588a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:31.978124 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7ed71-9a4c-4f72-af2e-2020410a588a admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:31.978865 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7ed71-9a4c-4f72-af2e-2020410a588a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:52:31.979171 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7ed71-9a4c-4f72-af2e-2020410a588a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:31.980785 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7ed71-9a4c-4f72-af2e-2020410a588a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:31.996180 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1089/2192] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:52:31.997761 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e40cf-81c0-4d4d-8494-c9568b8be5c3 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:32.009599 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e40cf-81c0-4d4d-8494-c9568b8be5c3 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:32.015417 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3de86b-e623-4681-bc68-a39e8e1f74c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:32.016193 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3de86b-e623-4681-bc68-a39e8e1f74c1 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:32.016546 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3de86b-e623-4681-bc68-a39e8e1f74c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:32.016917 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3de86b-e623-4681-bc68-a39e8e1f74c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:32.017712 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3de86b-e623-4681-bc68-a39e8e1f74c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:32.020580 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3de86b-e623-4681-bc68-a39e8e1f74c1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:32.051000 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1104/2193] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:52:31 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:52:32.056427 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7ed71-9a4c-4f72-af2e-2020410a588a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:32.068407 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7ed71-9a4c-4f72-af2e-2020410a588a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:32.131779 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704832d-afdc-47b0-9a5d-5b780077e89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:32.132613 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704832d-afdc-47b0-9a5d-5b780077e89b admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:32.133141 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704832d-afdc-47b0-9a5d-5b780077e89b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:32.133522 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704832d-afdc-47b0-9a5d-5b780077e89b admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:32.135457 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704832d-afdc-47b0-9a5d-5b780077e89b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:32.138808 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704832d-afdc-47b0-9a5d-5b780077e89b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:32.161374 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1090/2194] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:52:32 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:52:32.166499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3de86b-e623-4681-bc68-a39e8e1f74c1 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:32.182137 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3de86b-e623-4681-bc68-a39e8e1f74c1 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:32.193156 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5920f-4ed5-4a18-9ebc-ee47bb2ee3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:32.194305 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5920f-4ed5-4a18-9ebc-ee47bb2ee3fa admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:32.194664 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5920f-4ed5-4a18-9ebc-ee47bb2ee3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:32.195152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5920f-4ed5-4a18-9ebc-ee47bb2ee3fa admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:32.196138 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e5920f-4ed5-4a18-9ebc-ee47bb2ee3fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:32.197956 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e5920f-4ed5-4a18-9ebc-ee47bb2ee3fa admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:32.211661 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1105/2195] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:52:32.213180 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704832d-afdc-47b0-9a5d-5b780077e89b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:32.223948 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704832d-afdc-47b0-9a5d-5b780077e89b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:32.229809 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da818e-3a43-4f8b-9e9f-e52ba82a4c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:32.230507 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da818e-3a43-4f8b-9e9f-e52ba82a4c63 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:32.230796 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da818e-3a43-4f8b-9e9f-e52ba82a4c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:32.231073 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da818e-3a43-4f8b-9e9f-e52ba82a4c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:32.231820 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da818e-3a43-4f8b-9e9f-e52ba82a4c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:32.233707 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da818e-3a43-4f8b-9e9f-e52ba82a4c63 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:32.244366 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1091/2196] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:52:32.248736 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5920f-4ed5-4a18-9ebc-ee47bb2ee3fa admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:32.259743 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5920f-4ed5-4a18-9ebc-ee47bb2ee3fa admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:32.265075 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8c589-0007-4a63-9ddb-99f87a298674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:32.265974 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8c589-0007-4a63-9ddb-99f87a298674 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:32.266257 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8c589-0007-4a63-9ddb-99f87a298674 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:32.266542 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8c589-0007-4a63-9ddb-99f87a298674 admin admin] PATH_INFO: `/v3/projects/a23e09d357c24fc495617bd6f65a357f/users/bbd8d01c612149e390abf000c7d6277a/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:32.293645 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8c589-0007-4a63-9ddb-99f87a298674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23e09d357c24fc495617bd6f65a357f, user_id=bbd8d01c612149e390abf000c7d6277a, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:32.296016 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8c589-0007-4a63-9ddb-99f87a298674 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:32.312494 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1106/2197] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:52:32 2022] PUT /identity/v3/projects/a23e09d357c24fc495617bd6f65a357f/users/bbd8d01c612149e390abf000c7d6277a/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:52:32.323280 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ec985-6773-47e2-bbb8-c224cf52b6e2 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:32.323827 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ec985-6773-47e2-bbb8-c224cf52b6e2 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:32.323827 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ec985-6773-47e2-bbb8-c224cf52b6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:32.350356 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-471ec985-6773-47e2-bbb8-c224cf52b6e2 None None] MFA Rules not processed for user `bbd8d01c612149e390abf000c7d6277a`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:32.351582 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-471ec985-6773-47e2-bbb8-c224cf52b6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:32.427561 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1092/2198] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:52:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:52:32.437364 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8c589-0007-4a63-9ddb-99f87a298674 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:32.439170 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-85a8c589-0007-4a63-9ddb-99f87a298674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:32.499928 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8c589-0007-4a63-9ddb-99f87a298674 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:32.506628 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b835ae-00a0-4155-98de-cc5ba19d69ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:32.507385 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b835ae-00a0-4155-98de-cc5ba19d69ab service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:32.507746 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b835ae-00a0-4155-98de-cc5ba19d69ab service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:32.508165 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b835ae-00a0-4155-98de-cc5ba19d69ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:32.524651 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b835ae-00a0-4155-98de-cc5ba19d69ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:32.527355 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b835ae-00a0-4155-98de-cc5ba19d69ab service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:32.555236 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1107/2199] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:52:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:52:32.570960 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ec985-6773-47e2-bbb8-c224cf52b6e2 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:32.684798 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ec985-6773-47e2-bbb8-c224cf52b6e2 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:32.695901 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053241ca-03a8-4911-a1b9-369ad9f53d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:32.696811 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053241ca-03a8-4911-a1b9-369ad9f53d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:32.697121 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053241ca-03a8-4911-a1b9-369ad9f53d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:32.697401 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053241ca-03a8-4911-a1b9-369ad9f53d55 admin admin] PATH_INFO: `/v3/users/bbd8d01c612149e390abf000c7d6277a` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:32.699521 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053241ca-03a8-4911-a1b9-369ad9f53d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd8d01c612149e390abf000c7d6277a)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:32.703374 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053241ca-03a8-4911-a1b9-369ad9f53d55 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:32.759800 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-053241ca-03a8-4911-a1b9-369ad9f53d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd8d01c612149e390abf000c7d6277a'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:32.772717 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-053241ca-03a8-4911-a1b9-369ad9f53d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd8d01c612149e390abf000c7d6277a'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:32.781373 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-053241ca-03a8-4911-a1b9-369ad9f53d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd8d01c612149e390abf000c7d6277a'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:32.792518 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-053241ca-03a8-4911-a1b9-369ad9f53d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd8d01c612149e390abf000c7d6277a'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:32.793347 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-053241ca-03a8-4911-a1b9-369ad9f53d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd8d01c612149e390abf000c7d6277a'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:32.805412 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1093/2200] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:52:32 2022] DELETE /identity/v3/users/bbd8d01c612149e390abf000c7d6277a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:52:32.806683 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ccbf2-d4ad-45e8-b082-f41646eda723 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:32.806974 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ccbf2-d4ad-45e8-b082-f41646eda723 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:32.807249 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ccbf2-d4ad-45e8-b082-f41646eda723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:32.827801 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-452ccbf2-d4ad-45e8-b082-f41646eda723 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:32.835054 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-452ccbf2-d4ad-45e8-b082-f41646eda723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:32.901457 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1108/2201] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:52:32.911473 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053241ca-03a8-4911-a1b9-369ad9f53d55 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:32.913373 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-053241ca-03a8-4911-a1b9-369ad9f53d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:32.983106 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053241ca-03a8-4911-a1b9-369ad9f53d55 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:32.986816 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ef81a-f71a-4db9-b40e-5eceaea77235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:32.987468 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ef81a-f71a-4db9-b40e-5eceaea77235 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:32.987751 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ef81a-f71a-4db9-b40e-5eceaea77235 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:32.988028 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ef81a-f71a-4db9-b40e-5eceaea77235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:32.998215 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ef81a-f71a-4db9-b40e-5eceaea77235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:33.000712 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ef81a-f71a-4db9-b40e-5eceaea77235 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:33.011067 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1094/2202] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:52:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:52:33.436000 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ccbf2-d4ad-45e8-b082-f41646eda723 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:33.439125 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-452ccbf2-d4ad-45e8-b082-f41646eda723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:33.460501 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ccbf2-d4ad-45e8-b082-f41646eda723 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:33.467306 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b1245-df17-4a27-9e81-dd7aff651206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:33.468254 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b1245-df17-4a27-9e81-dd7aff651206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:33.469340 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b1245-df17-4a27-9e81-dd7aff651206 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:33.469766 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b1245-df17-4a27-9e81-dd7aff651206 admin admin] PATH_INFO: `/v3/projects/a23e09d357c24fc495617bd6f65a357f` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:33.472366 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b1245-df17-4a27-9e81-dd7aff651206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23e09d357c24fc495617bd6f65a357f)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:33.474978 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b1245-df17-4a27-9e81-dd7aff651206 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:33.545775 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-859b1245-df17-4a27-9e81-dd7aff651206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23e09d357c24fc495617bd6f65a357f', 'request_id': 'req-859b1245-df17-4a27-9e81-dd7aff651206'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:33.584065 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-859b1245-df17-4a27-9e81-dd7aff651206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23e09d357c24fc495617bd6f65a357f', 'request_id': 'req-859b1245-df17-4a27-9e81-dd7aff651206'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:33.601665 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-859b1245-df17-4a27-9e81-dd7aff651206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23e09d357c24fc495617bd6f65a357f', 'request_id': 'req-859b1245-df17-4a27-9e81-dd7aff651206'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:33.631297 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-859b1245-df17-4a27-9e81-dd7aff651206 admin admin] The token cache is being invalidate because project a23e09d357c24fc495617bd6f65a357f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:52:33.631724 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-859b1245-df17-4a27-9e81-dd7aff651206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:33.632486 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-859b1245-df17-4a27-9e81-dd7aff651206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:52:33.641325 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1109/2203] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:52:33 2022] DELETE /identity/v3/projects/a23e09d357c24fc495617bd6f65a357f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:52:33.970754 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547df6e-85ef-40c2-86ab-e123cfd0ca05 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:33.971269 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547df6e-85ef-40c2-86ab-e123cfd0ca05 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:33.971358 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547df6e-85ef-40c2-86ab-e123cfd0ca05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:33.992980 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-5547df6e-85ef-40c2-86ab-e123cfd0ca05 None None] MFA Rules not processed for user `3b3dbe4735a54de1825abc28ecf00b84`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:33.994891 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-5547df6e-85ef-40c2-86ab-e123cfd0ca05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:34.063536 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1095/2204] 10.222.0.31 () {58 vars in 1009 bytes} [Mon Jan 10 17:52:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:52:34.145987 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b1245-df17-4a27-9e81-dd7aff651206 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:34.147630 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-859b1245-df17-4a27-9e81-dd7aff651206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:34.250975 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b1245-df17-4a27-9e81-dd7aff651206 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:34.262820 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77f961-7e53-4654-928a-9b24ac551f16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257a86ce85b4b4386cde32c8ed4b39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:34.264001 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77f961-7e53-4654-928a-9b24ac551f16 service swift] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:34.265180 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77f961-7e53-4654-928a-9b24ac551f16 service swift] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:34.265635 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77f961-7e53-4654-928a-9b24ac551f16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:34.276332 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77f961-7e53-4654-928a-9b24ac551f16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:34.277967 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77f961-7e53-4654-928a-9b24ac551f16 service swift] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:34.289032 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1110/2205] 10.222.0.31 () {60 vars in 1384 bytes} [Mon Jan 10 17:52:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:52:38.451430 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eecc97-2560-495d-af25-530634d4b091 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:38.452190 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eecc97-2560-495d-af25-530634d4b091 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:38.452190 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eecc97-2560-495d-af25-530634d4b091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:38.491954 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-16eecc97-2560-495d-af25-530634d4b091 None None] MFA Rules not processed for user `4636015d590c40fca1f4c9996a871b57`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:38.493827 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-16eecc97-2560-495d-af25-530634d4b091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:38.633930 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1096/2206] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:52:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:52:38.639650 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77f961-7e53-4654-928a-9b24ac551f16 service swift] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:38.641556 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-ea77f961-7e53-4654-928a-9b24ac551f16 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:38.757499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77f961-7e53-4654-928a-9b24ac551f16 service swift] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:38.763001 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f78f34-ac49-436e-82b9-9c99b17290b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:38.763889 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f78f34-ac49-436e-82b9-9c99b17290b7 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:38.764097 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f78f34-ac49-436e-82b9-9c99b17290b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:38.764414 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f78f34-ac49-436e-82b9-9c99b17290b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:38.765217 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f78f34-ac49-436e-82b9-9c99b17290b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:38.767161 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f78f34-ac49-436e-82b9-9c99b17290b7 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:38.809472 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1111/2207] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:52:38 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:52:38.810719 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eecc97-2560-495d-af25-530634d4b091 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:38.823146 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eecc97-2560-495d-af25-530634d4b091 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:38.955007 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e30b8d-9de9-4231-8909-1682251beaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:38.955777 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e30b8d-9de9-4231-8909-1682251beaef admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:38.956035 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e30b8d-9de9-4231-8909-1682251beaef admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:38.956314 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e30b8d-9de9-4231-8909-1682251beaef admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:38.957162 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e30b8d-9de9-4231-8909-1682251beaef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:38.959419 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e30b8d-9de9-4231-8909-1682251beaef admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:38.987783 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f78f34-ac49-436e-82b9-9c99b17290b7 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:38.988268 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1097/2208] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:52:38 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:52:39.017440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f78f34-ac49-436e-82b9-9c99b17290b7 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:39.027266 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a692f-c20f-46ea-892e-5565879cc673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:39.028050 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a692f-c20f-46ea-892e-5565879cc673 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:39.028403 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a692f-c20f-46ea-892e-5565879cc673 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:39.028743 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a692f-c20f-46ea-892e-5565879cc673 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:39.029740 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a692f-c20f-46ea-892e-5565879cc673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:39.031703 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a692f-c20f-46ea-892e-5565879cc673 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:39.054298 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1112/2209] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:52:39.058698 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e30b8d-9de9-4231-8909-1682251beaef admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:39.071531 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e30b8d-9de9-4231-8909-1682251beaef admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:39.076874 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6ec4b-e704-4bfc-a712-47792b6c5deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:39.080766 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6ec4b-e704-4bfc-a712-47792b6c5deb admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:39.080766 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6ec4b-e704-4bfc-a712-47792b6c5deb admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:39.080766 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6ec4b-e704-4bfc-a712-47792b6c5deb admin admin] PATH_INFO: `/v3/projects/0f01566868b6441cb0d828035ccc4613/users/ebf206ebb2a74e46912f1cf3d17e66b9/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:39.109994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6ec4b-e704-4bfc-a712-47792b6c5deb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f01566868b6441cb0d828035ccc4613, user_id=ebf206ebb2a74e46912f1cf3d17e66b9, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:39.113264 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6ec4b-e704-4bfc-a712-47792b6c5deb admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:39.142933 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1098/2210] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:52:39 2022] PUT /identity/v3/projects/0f01566868b6441cb0d828035ccc4613/users/ebf206ebb2a74e46912f1cf3d17e66b9/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:52:39.146641 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a692f-c20f-46ea-892e-5565879cc673 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:39.157484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a692f-c20f-46ea-892e-5565879cc673 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:39.249067 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a5977-3d03-4d80-bdfc-bcf0c92a1f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:39.249850 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a5977-3d03-4d80-bdfc-bcf0c92a1f1c admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:39.250242 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a5977-3d03-4d80-bdfc-bcf0c92a1f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:39.250591 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a5977-3d03-4d80-bdfc-bcf0c92a1f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:39.251480 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a5977-3d03-4d80-bdfc-bcf0c92a1f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:39.260422 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a5977-3d03-4d80-bdfc-bcf0c92a1f1c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:39.268640 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1113/2211] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:52:39.270072 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6ec4b-e704-4bfc-a712-47792b6c5deb admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:39.282945 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6ec4b-e704-4bfc-a712-47792b6c5deb admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:39.294080 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86659378-4220-4aa7-808d-50b1d757565d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:39.295310 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86659378-4220-4aa7-808d-50b1d757565d admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:39.295829 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86659378-4220-4aa7-808d-50b1d757565d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:39.296310 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86659378-4220-4aa7-808d-50b1d757565d admin admin] PATH_INFO: `/v3/projects/0f01566868b6441cb0d828035ccc4613/users/ebf206ebb2a74e46912f1cf3d17e66b9/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:39.298870 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86659378-4220-4aa7-808d-50b1d757565d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f01566868b6441cb0d828035ccc4613, user_id=ebf206ebb2a74e46912f1cf3d17e66b9, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:39.302131 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86659378-4220-4aa7-808d-50b1d757565d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:39.322938 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1099/2212] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:52:39 2022] PUT /identity/v3/projects/0f01566868b6441cb0d828035ccc4613/users/ebf206ebb2a74e46912f1cf3d17e66b9/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:52:47.061628 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c5519-a189-4d07-a2f3-cd3bf2b15dc8 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:47.064050 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c5519-a189-4d07-a2f3-cd3bf2b15dc8 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:47.064552 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c5519-a189-4d07-a2f3-cd3bf2b15dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:47.109797 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-6c8c5519-a189-4d07-a2f3-cd3bf2b15dc8 None None] MFA Rules not processed for user `ebf206ebb2a74e46912f1cf3d17e66b9`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:47.111286 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-6c8c5519-a189-4d07-a2f3-cd3bf2b15dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:47.264697 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1114/2213] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:52:47 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:52:47.275777 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86659378-4220-4aa7-808d-50b1d757565d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:47.277860 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-86659378-4220-4aa7-808d-50b1d757565d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:47.439845 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86659378-4220-4aa7-808d-50b1d757565d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:47.445608 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ba0d1-ad86-4f53-889e-47cb2023f048 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:47.446260 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ba0d1-ad86-4f53-889e-47cb2023f048 service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:47.446544 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ba0d1-ad86-4f53-889e-47cb2023f048 service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:47.446822 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ba0d1-ad86-4f53-889e-47cb2023f048 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:47.503719 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ba0d1-ad86-4f53-889e-47cb2023f048 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:47.505280 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ba0d1-ad86-4f53-889e-47cb2023f048 service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:47.517407 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1100/2214] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:52:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:52:49.362718 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a31e9c-121a-41ac-b8fa-1818a103a324 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:49.363880 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a31e9c-121a-41ac-b8fa-1818a103a324 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:49.364367 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a31e9c-121a-41ac-b8fa-1818a103a324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:49.392135 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-56a31e9c-121a-41ac-b8fa-1818a103a324 None None] MFA Rules not processed for user `4636015d590c40fca1f4c9996a871b57`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:49.394166 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-56a31e9c-121a-41ac-b8fa-1818a103a324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:49.450110 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1115/2215] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:52:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:52:55.999651 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202acb9-439e-4634-822a-6e5a206ccb74 None None] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:56.000536 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202acb9-439e-4634-822a-6e5a206ccb74 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:56.000536 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202acb9-439e-4634-822a-6e5a206ccb74 None None] PATH_INFO: `/` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:56.004211 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1101/2216] 10.222.0.31 () {54 vars in 921 bytes} [Mon Jan 10 17:52:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:52:56.014639 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c112d09-6693-40b0-9552-cf006b5dd4ca None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:56.015180 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c112d09-6693-40b0-9552-cf006b5dd4ca None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:56.015278 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c112d09-6693-40b0-9552-cf006b5dd4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:56.038009 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-6c112d09-6693-40b0-9552-cf006b5dd4ca None None] MFA Rules not processed for user `877acd6448214ef893d119e3b1043402`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:56.039374 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-6c112d09-6693-40b0-9552-cf006b5dd4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:56.050143 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1116/2217] 10.222.0.31 () {58 vars in 1018 bytes} [Mon Jan 10 17:52:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:52:56.064000 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202acb9-439e-4634-822a-6e5a206ccb74 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:56.065883 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-2202acb9-439e-4634-822a-6e5a206ccb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:56.121367 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202acb9-439e-4634-822a-6e5a206ccb74 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:56.125185 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c733c5-a93d-400c-88f6-0cc7b516bfa8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15232a1930bc43e8bb5aa7310a709056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:56.125837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c733c5-a93d-400c-88f6-0cc7b516bfa8 service glance] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:56.126119 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c733c5-a93d-400c-88f6-0cc7b516bfa8 service glance] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:56.126396 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c733c5-a93d-400c-88f6-0cc7b516bfa8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:56.139375 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c733c5-a93d-400c-88f6-0cc7b516bfa8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:56.140906 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c733c5-a93d-400c-88f6-0cc7b516bfa8 service glance] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:56.151652 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1102/2218] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:52:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:52:56.219762 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e12a78-1348-42dd-9f4b-e5c5a9b65ea9 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:56.220073 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e12a78-1348-42dd-9f4b-e5c5a9b65ea9 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:56.220353 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e12a78-1348-42dd-9f4b-e5c5a9b65ea9 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:56.222260 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1117/2219] 10.222.0.31 () {54 vars in 921 bytes} [Mon Jan 10 17:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:52:56.227107 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fc4d6-760f-43a4-891e-bf6298698f99 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:56.227403 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fc4d6-760f-43a4-891e-bf6298698f99 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:56.227685 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fc4d6-760f-43a4-891e-bf6298698f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:56.268338 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-8c0fc4d6-760f-43a4-891e-bf6298698f99 None None] MFA Rules not processed for user `2174a30e22c746589b3faaf4ccc8de3d`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:56.269795 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-8c0fc4d6-760f-43a4-891e-bf6298698f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:56.340044 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1103/2220] 10.222.0.31 () {58 vars in 1018 bytes} [Mon Jan 10 17:52:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:52:56.352046 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e12a78-1348-42dd-9f4b-e5c5a9b65ea9 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:56.353933 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-32e12a78-1348-42dd-9f4b-e5c5a9b65ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:56.366898 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e12a78-1348-42dd-9f4b-e5c5a9b65ea9 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:56.370371 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f1618-cb85-4c7d-a14a-847600966e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:56.371016 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f1618-cb85-4c7d-a14a-847600966e68 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:56.371297 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f1618-cb85-4c7d-a14a-847600966e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:56.371735 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f1618-cb85-4c7d-a14a-847600966e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:56.379307 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f1618-cb85-4c7d-a14a-847600966e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:56.380767 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f1618-cb85-4c7d-a14a-847600966e68 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:56.390365 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1118/2221] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:52:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:52:58.949997 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624df06d-a551-4b50-baec-60f6610776f9 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:58.950478 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624df06d-a551-4b50-baec-60f6610776f9 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:58.950668 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624df06d-a551-4b50-baec-60f6610776f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:58.969118 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-624df06d-a551-4b50-baec-60f6610776f9 None None] MFA Rules not processed for user `3b3dbe4735a54de1825abc28ecf00b84`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:52:58.970336 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-624df06d-a551-4b50-baec-60f6610776f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:52:59.026107 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1104/2222] 10.222.0.31 () {58 vars in 1009 bytes} [Mon Jan 10 17:52:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:52:59.038787 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f1618-cb85-4c7d-a14a-847600966e68 service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:52:59.114481 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f1618-cb85-4c7d-a14a-847600966e68 service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:52:59.119598 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee52867-ae34-43ca-8c64-22b9b3034fe8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257a86ce85b4b4386cde32c8ed4b39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:52:59.120246 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee52867-ae34-43ca-8c64-22b9b3034fe8 service swift] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:52:59.120534 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee52867-ae34-43ca-8c64-22b9b3034fe8 service swift] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:52:59.120807 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee52867-ae34-43ca-8c64-22b9b3034fe8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:52:59.129301 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee52867-ae34-43ca-8c64-22b9b3034fe8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:52:59.130973 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee52867-ae34-43ca-8c64-22b9b3034fe8 service swift] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:52:59.139008 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1119/2223] 10.222.0.31 () {60 vars in 1384 bytes} [Mon Jan 10 17:52:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:53:14.558873 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624df06d-a551-4b50-baec-60f6610776f9 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:14.560326 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-624df06d-a551-4b50-baec-60f6610776f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:14.657989 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624df06d-a551-4b50-baec-60f6610776f9 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:14.662976 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865837c-d007-4d87-8ef2-a03441c86999 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3b8e620cfd42fe993c73dc83a246be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:14.663621 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865837c-d007-4d87-8ef2-a03441c86999 service placement] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:14.663900 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865837c-d007-4d87-8ef2-a03441c86999 service placement] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:14.664180 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865837c-d007-4d87-8ef2-a03441c86999 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:14.665933 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-2865837c-d007-4d87-8ef2-a03441c86999 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:14.676645 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865837c-d007-4d87-8ef2-a03441c86999 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:14.678269 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865837c-d007-4d87-8ef2-a03441c86999 service placement] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:14.687650 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1105/2224] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:53:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:53:16.456788 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee52867-ae34-43ca-8c64-22b9b3034fe8 service swift] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:16.458420 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-6ee52867-ae34-43ca-8c64-22b9b3034fe8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:16.559533 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee52867-ae34-43ca-8c64-22b9b3034fe8 service swift] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:16.564770 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5abd8-340e-456e-a019-34061c5373b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:16.565665 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5abd8-340e-456e-a019-34061c5373b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:16.565948 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5abd8-340e-456e-a019-34061c5373b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:16.566221 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5abd8-340e-456e-a019-34061c5373b5 admin admin] PATH_INFO: `/v3/users/3284aee452cd4b0483a2044d36a3e357` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:16.567520 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5abd8-340e-456e-a019-34061c5373b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3284aee452cd4b0483a2044d36a3e357)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:16.569412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5abd8-340e-456e-a019-34061c5373b5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:16.620043 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ede5abd8-340e-456e-a019-34061c5373b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3284aee452cd4b0483a2044d36a3e357'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:16.620687 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ede5abd8-340e-456e-a019-34061c5373b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3284aee452cd4b0483a2044d36a3e357'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:16.621309 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ede5abd8-340e-456e-a019-34061c5373b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3284aee452cd4b0483a2044d36a3e357'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:16.632531 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ede5abd8-340e-456e-a019-34061c5373b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3284aee452cd4b0483a2044d36a3e357'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:16.639008 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ede5abd8-340e-456e-a019-34061c5373b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3284aee452cd4b0483a2044d36a3e357'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:16.653242 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1120/2225] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:53:16 2022] DELETE /identity/v3/users/3284aee452cd4b0483a2044d36a3e357 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:16.835769 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865837c-d007-4d87-8ef2-a03441c86999 service placement] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:16.847609 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865837c-d007-4d87-8ef2-a03441c86999 service placement] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:16.903818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1948fb3-976f-4f65-9b8f-a6ec4c9dfd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:16.904763 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1948fb3-976f-4f65-9b8f-a6ec4c9dfd30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:16.905073 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1948fb3-976f-4f65-9b8f-a6ec4c9dfd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:16.905344 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1948fb3-976f-4f65-9b8f-a6ec4c9dfd30 admin admin] PATH_INFO: `/v3/projects/42d38f874b484d32b9af29e66fbaf139` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:16.906556 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1948fb3-976f-4f65-9b8f-a6ec4c9dfd30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42d38f874b484d32b9af29e66fbaf139)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:16.908494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1948fb3-976f-4f65-9b8f-a6ec4c9dfd30 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:16.952443 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c1948fb3-976f-4f65-9b8f-a6ec4c9dfd30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d38f874b484d32b9af29e66fbaf139', 'request_id': 'req-c1948fb3-976f-4f65-9b8f-a6ec4c9dfd30'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:16.958789 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c1948fb3-976f-4f65-9b8f-a6ec4c9dfd30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d38f874b484d32b9af29e66fbaf139', 'request_id': 'req-c1948fb3-976f-4f65-9b8f-a6ec4c9dfd30'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:16.967530 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c1948fb3-976f-4f65-9b8f-a6ec4c9dfd30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d38f874b484d32b9af29e66fbaf139', 'request_id': 'req-c1948fb3-976f-4f65-9b8f-a6ec4c9dfd30'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:16.978286 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c1948fb3-976f-4f65-9b8f-a6ec4c9dfd30 admin admin] The token cache is being invalidate because project 42d38f874b484d32b9af29e66fbaf139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:53:16.978981 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c1948fb3-976f-4f65-9b8f-a6ec4c9dfd30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:16.979669 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c1948fb3-976f-4f65-9b8f-a6ec4c9dfd30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:16.981540 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1106/2226] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:53:16 2022] DELETE /identity/v3/projects/42d38f874b484d32b9af29e66fbaf139 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:16.987293 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbb483-64ea-46c7-acfb-bf03c0f7a78a None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:16.987584 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbb483-64ea-46c7-acfb-bf03c0f7a78a None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:16.987890 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbb483-64ea-46c7-acfb-bf03c0f7a78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:17.044841 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-85fbb483-64ea-46c7-acfb-bf03c0f7a78a None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:17.046134 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-85fbb483-64ea-46c7-acfb-bf03c0f7a78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:17.109127 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1121/2227] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:17.117071 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06942761-a1f6-46cb-a0f8-6dc479dbb07d None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:17.117460 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06942761-a1f6-46cb-a0f8-6dc479dbb07d None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:17.117743 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06942761-a1f6-46cb-a0f8-6dc479dbb07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:17.137149 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-06942761-a1f6-46cb-a0f8-6dc479dbb07d None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:17.138430 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-06942761-a1f6-46cb-a0f8-6dc479dbb07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:17.147471 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1107/2228] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:17.151645 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbb483-64ea-46c7-acfb-bf03c0f7a78a None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:17.161461 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbb483-64ea-46c7-acfb-bf03c0f7a78a None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:17.166058 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131792bb-8f6a-47a8-ae26-b4c7bcfebe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:17.166735 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131792bb-8f6a-47a8-ae26-b4c7bcfebe2d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:17.167014 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131792bb-8f6a-47a8-ae26-b4c7bcfebe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:17.167289 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131792bb-8f6a-47a8-ae26-b4c7bcfebe2d admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:17.168055 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131792bb-8f6a-47a8-ae26-b4c7bcfebe2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:53:17.168404 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131792bb-8f6a-47a8-ae26-b4c7bcfebe2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:17.170048 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131792bb-8f6a-47a8-ae26-b4c7bcfebe2d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:17.182460 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1122/2229] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:53:17.186342 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06942761-a1f6-46cb-a0f8-6dc479dbb07d None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:17.196316 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06942761-a1f6-46cb-a0f8-6dc479dbb07d None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:17.201602 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa60e7f-4c9f-4cfa-b511-84aaeed913c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:17.202272 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa60e7f-4c9f-4cfa-b511-84aaeed913c9 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:17.202558 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa60e7f-4c9f-4cfa-b511-84aaeed913c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:17.202839 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa60e7f-4c9f-4cfa-b511-84aaeed913c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:17.203577 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa60e7f-4c9f-4cfa-b511-84aaeed913c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:17.205545 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa60e7f-4c9f-4cfa-b511-84aaeed913c9 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:17.233042 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1108/2230] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:53:17 2022] POST /identity/v3/projects => generated 357 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:53:17.237331 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131792bb-8f6a-47a8-ae26-b4c7bcfebe2d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:17.253013 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131792bb-8f6a-47a8-ae26-b4c7bcfebe2d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:17.307130 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df58459-31e6-4647-9aac-a6ee1aeedb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:17.307801 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df58459-31e6-4647-9aac-a6ee1aeedb98 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:17.308086 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df58459-31e6-4647-9aac-a6ee1aeedb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:17.308360 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df58459-31e6-4647-9aac-a6ee1aeedb98 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:17.309108 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df58459-31e6-4647-9aac-a6ee1aeedb98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:17.311063 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df58459-31e6-4647-9aac-a6ee1aeedb98 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:17.333638 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1123/2231] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:53:17 2022] POST /identity/v3/users => generated 279 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:53:17.334724 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa60e7f-4c9f-4cfa-b511-84aaeed913c9 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:17.344602 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa60e7f-4c9f-4cfa-b511-84aaeed913c9 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:17.349197 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510c970-db14-4ce4-bf58-ed03da8bbfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:17.349821 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510c970-db14-4ce4-bf58-ed03da8bbfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:17.350098 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510c970-db14-4ce4-bf58-ed03da8bbfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:17.350369 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510c970-db14-4ce4-bf58-ed03da8bbfd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:17.351107 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510c970-db14-4ce4-bf58-ed03da8bbfd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:17.352686 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510c970-db14-4ce4-bf58-ed03da8bbfd5 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:17.363167 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1109/2232] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:53:17.367187 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df58459-31e6-4647-9aac-a6ee1aeedb98 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:17.377175 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df58459-31e6-4647-9aac-a6ee1aeedb98 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:17.382170 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860680d-c08a-403e-8975-ef7dd887a951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:17.382825 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860680d-c08a-403e-8975-ef7dd887a951 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:17.383103 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860680d-c08a-403e-8975-ef7dd887a951 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:17.383375 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860680d-c08a-403e-8975-ef7dd887a951 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:17.384108 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860680d-c08a-403e-8975-ef7dd887a951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:17.385704 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860680d-c08a-403e-8975-ef7dd887a951 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:17.395619 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1124/2233] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:53:17.400061 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510c970-db14-4ce4-bf58-ed03da8bbfd5 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:17.409736 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510c970-db14-4ce4-bf58-ed03da8bbfd5 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:17.414436 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf360392-ef13-4000-a998-0f9396704827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:17.415319 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf360392-ef13-4000-a998-0f9396704827 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:17.415604 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf360392-ef13-4000-a998-0f9396704827 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:17.415879 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf360392-ef13-4000-a998-0f9396704827 admin admin] PATH_INFO: `/v3/projects/b3f48605494c4c7a805330e9ef878e2c/users/890e8a6c2d1c423eb99759f3282f9a83/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:17.430689 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf360392-ef13-4000-a998-0f9396704827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f48605494c4c7a805330e9ef878e2c, user_id=890e8a6c2d1c423eb99759f3282f9a83, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:17.433450 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf360392-ef13-4000-a998-0f9396704827 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:17.447260 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1110/2234] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:53:17 2022] PUT /identity/v3/projects/b3f48605494c4c7a805330e9ef878e2c/users/890e8a6c2d1c423eb99759f3282f9a83/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:17.457298 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe24f5-5c8f-46ea-b2da-febefd2f125f None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:17.457912 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe24f5-5c8f-46ea-b2da-febefd2f125f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:17.457912 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe24f5-5c8f-46ea-b2da-febefd2f125f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:17.484941 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-abbe24f5-5c8f-46ea-b2da-febefd2f125f None None] MFA Rules not processed for user `890e8a6c2d1c423eb99759f3282f9a83`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:17.486169 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-abbe24f5-5c8f-46ea-b2da-febefd2f125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:17.550118 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1125/2235] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:17 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:17.554697 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf360392-ef13-4000-a998-0f9396704827 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:17.620304 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf360392-ef13-4000-a998-0f9396704827 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:17.625830 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de53eb-fe67-4fa5-abbe-3cdc4d915509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:17.626487 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de53eb-fe67-4fa5-abbe-3cdc4d915509 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:17.626774 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de53eb-fe67-4fa5-abbe-3cdc4d915509 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:17.627052 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de53eb-fe67-4fa5-abbe-3cdc4d915509 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:17.627761 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de53eb-fe67-4fa5-abbe-3cdc4d915509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:17.629721 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de53eb-fe67-4fa5-abbe-3cdc4d915509 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:17.659446 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1111/2236] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:53:17 2022] POST /identity/v3/projects => generated 355 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:53:17.663727 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe24f5-5c8f-46ea-b2da-febefd2f125f None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:17.675026 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe24f5-5c8f-46ea-b2da-febefd2f125f None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:17.730486 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e7b55-92f1-4c5b-a2fe-9a0eba881f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:17.731160 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e7b55-92f1-4c5b-a2fe-9a0eba881f8f admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:17.731436 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e7b55-92f1-4c5b-a2fe-9a0eba881f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:17.731711 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e7b55-92f1-4c5b-a2fe-9a0eba881f8f admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:17.732442 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e7b55-92f1-4c5b-a2fe-9a0eba881f8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:17.734423 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e7b55-92f1-4c5b-a2fe-9a0eba881f8f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:17.761934 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1126/2237] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:53:17 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:53:17.763259 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de53eb-fe67-4fa5-abbe-3cdc4d915509 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:17.773818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de53eb-fe67-4fa5-abbe-3cdc4d915509 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:17.779149 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bfa15-698c-40fa-b9f1-a7dc2e037f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:17.779955 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bfa15-698c-40fa-b9f1-a7dc2e037f4b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:17.780333 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bfa15-698c-40fa-b9f1-a7dc2e037f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:17.780700 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bfa15-698c-40fa-b9f1-a7dc2e037f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:17.781579 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bfa15-698c-40fa-b9f1-a7dc2e037f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:17.783240 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bfa15-698c-40fa-b9f1-a7dc2e037f4b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:17.794042 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1112/2238] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:53:17.798339 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e7b55-92f1-4c5b-a2fe-9a0eba881f8f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:17.808555 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e7b55-92f1-4c5b-a2fe-9a0eba881f8f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:17.813684 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6c98f-63b0-483e-9387-29cba09e61f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:17.814571 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6c98f-63b0-483e-9387-29cba09e61f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:17.814849 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6c98f-63b0-483e-9387-29cba09e61f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:17.815168 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6c98f-63b0-483e-9387-29cba09e61f1 admin admin] PATH_INFO: `/v3/projects/47098af4ae1e482697bee737ecbbb5bd/users/afce53a980b44d3487d27b657ccca8a6/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:17.830554 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6c98f-63b0-483e-9387-29cba09e61f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47098af4ae1e482697bee737ecbbb5bd, user_id=afce53a980b44d3487d27b657ccca8a6, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:17.833224 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6c98f-63b0-483e-9387-29cba09e61f1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:17.848616 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1127/2239] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:53:17 2022] PUT /identity/v3/projects/47098af4ae1e482697bee737ecbbb5bd/users/afce53a980b44d3487d27b657ccca8a6/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:17.852481 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bfa15-698c-40fa-b9f1-a7dc2e037f4b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:17.863263 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bfa15-698c-40fa-b9f1-a7dc2e037f4b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:17.919006 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a68322-db6b-4196-b6dc-5047d6b7cfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:17.919538 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a68322-db6b-4196-b6dc-5047d6b7cfdc admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:17.919851 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a68322-db6b-4196-b6dc-5047d6b7cfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:17.920359 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a68322-db6b-4196-b6dc-5047d6b7cfdc admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:17.921097 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a68322-db6b-4196-b6dc-5047d6b7cfdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:17.922713 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a68322-db6b-4196-b6dc-5047d6b7cfdc admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:17.932916 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1113/2240] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:53:17.936668 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6c98f-63b0-483e-9387-29cba09e61f1 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:17.947274 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6c98f-63b0-483e-9387-29cba09e61f1 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:17.952960 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46f1cf-c16e-46ad-9bf6-9103a520cc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:17.953845 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46f1cf-c16e-46ad-9bf6-9103a520cc5a admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:17.954124 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46f1cf-c16e-46ad-9bf6-9103a520cc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:17.954395 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46f1cf-c16e-46ad-9bf6-9103a520cc5a admin admin] PATH_INFO: `/v3/projects/47098af4ae1e482697bee737ecbbb5bd/users/afce53a980b44d3487d27b657ccca8a6/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:17.956694 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46f1cf-c16e-46ad-9bf6-9103a520cc5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=47098af4ae1e482697bee737ecbbb5bd, user_id=afce53a980b44d3487d27b657ccca8a6, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:17.959400 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46f1cf-c16e-46ad-9bf6-9103a520cc5a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:17.970847 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1128/2241] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:53:17 2022] PUT /identity/v3/projects/47098af4ae1e482697bee737ecbbb5bd/users/afce53a980b44d3487d27b657ccca8a6/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:17.982000 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45e508-770e-4108-b5c8-82948f72d1fb None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:17.982352 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45e508-770e-4108-b5c8-82948f72d1fb None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:17.982635 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45e508-770e-4108-b5c8-82948f72d1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:18.009314 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-5d45e508-770e-4108-b5c8-82948f72d1fb None None] MFA Rules not processed for user `afce53a980b44d3487d27b657ccca8a6`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:18.010513 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-5d45e508-770e-4108-b5c8-82948f72d1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:18.080407 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1114/2242] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:17 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:18.090038 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46f1cf-c16e-46ad-9bf6-9103a520cc5a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:18.091813 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-9e46f1cf-c16e-46ad-9bf6-9103a520cc5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:18.145543 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46f1cf-c16e-46ad-9bf6-9103a520cc5a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:18.149857 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021c2e7-4d78-4c34-952e-bd95b8ee7258 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:18.150479 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021c2e7-4d78-4c34-952e-bd95b8ee7258 service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:18.150758 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021c2e7-4d78-4c34-952e-bd95b8ee7258 service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:18.151035 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021c2e7-4d78-4c34-952e-bd95b8ee7258 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:18.160079 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021c2e7-4d78-4c34-952e-bd95b8ee7258 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:18.161531 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021c2e7-4d78-4c34-952e-bd95b8ee7258 service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:18.170932 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1129/2243] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:53:18 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:53:18.241323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45e508-770e-4108-b5c8-82948f72d1fb None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:18.251142 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45e508-770e-4108-b5c8-82948f72d1fb None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:18.255456 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d97c9c-e80f-4f45-942f-5bb3c9bfeb55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:18.255903 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d97c9c-e80f-4f45-942f-5bb3c9bfeb55 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:18.256186 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d97c9c-e80f-4f45-942f-5bb3c9bfeb55 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:18.256460 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d97c9c-e80f-4f45-942f-5bb3c9bfeb55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:18.320930 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d97c9c-e80f-4f45-942f-5bb3c9bfeb55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:18.322416 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d97c9c-e80f-4f45-942f-5bb3c9bfeb55 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:18.332204 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1115/2244] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:53:18 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:53:21.843536 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efb3e9-11b3-49b9-9384-751acfa96c82 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:21.844071 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efb3e9-11b3-49b9-9384-751acfa96c82 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:21.844071 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efb3e9-11b3-49b9-9384-751acfa96c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:21.872759 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-07efb3e9-11b3-49b9-9384-751acfa96c82 None None] MFA Rules not processed for user `3b3dbe4735a54de1825abc28ecf00b84`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:21.873990 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-07efb3e9-11b3-49b9-9384-751acfa96c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:21.974911 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1130/2245] 10.222.0.31 () {58 vars in 967 bytes} [Mon Jan 10 17:53:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:21.990155 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d97c9c-e80f-4f45-942f-5bb3c9bfeb55 service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:21.991648 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-08d97c9c-e80f-4f45-942f-5bb3c9bfeb55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:22.066394 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d97c9c-e80f-4f45-942f-5bb3c9bfeb55 service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:22.072754 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414ca0e-69ad-4c3a-a27b-b380eabdaed6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257a86ce85b4b4386cde32c8ed4b39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:22.073455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414ca0e-69ad-4c3a-a27b-b380eabdaed6 service swift] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:22.073738 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414ca0e-69ad-4c3a-a27b-b380eabdaed6 service swift] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:22.074156 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414ca0e-69ad-4c3a-a27b-b380eabdaed6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:22.083220 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414ca0e-69ad-4c3a-a27b-b380eabdaed6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:22.085143 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414ca0e-69ad-4c3a-a27b-b380eabdaed6 service swift] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:22.107952 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1116/2246] 10.222.0.31 () {60 vars in 1384 bytes} [Mon Jan 10 17:53:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:53:24.542362 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efb3e9-11b3-49b9-9384-751acfa96c82 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:24.544396 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-07efb3e9-11b3-49b9-9384-751acfa96c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:24.607731 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efb3e9-11b3-49b9-9384-751acfa96c82 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:24.612037 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14356681-331e-4ced-95f6-00ce47518f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:24.612667 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14356681-331e-4ced-95f6-00ce47518f55 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:24.612943 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14356681-331e-4ced-95f6-00ce47518f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:24.613241 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14356681-331e-4ced-95f6-00ce47518f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:24.615195 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-14356681-331e-4ced-95f6-00ce47518f55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:24.678122 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14356681-331e-4ced-95f6-00ce47518f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:24.679532 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14356681-331e-4ced-95f6-00ce47518f55 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:24.688918 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1131/2247] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:53:24 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:53:33.140244 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414ca0e-69ad-4c3a-a27b-b380eabdaed6 service swift] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:33.205403 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414ca0e-69ad-4c3a-a27b-b380eabdaed6 service swift] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:33.213114 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfca745-3227-41a2-9b1b-57f307e6b689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:33.214386 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfca745-3227-41a2-9b1b-57f307e6b689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:33.214770 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfca745-3227-41a2-9b1b-57f307e6b689 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:33.215068 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfca745-3227-41a2-9b1b-57f307e6b689 admin admin] PATH_INFO: `/v3/users/890e8a6c2d1c423eb99759f3282f9a83` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:33.217165 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfca745-3227-41a2-9b1b-57f307e6b689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=890e8a6c2d1c423eb99759f3282f9a83)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:33.220162 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfca745-3227-41a2-9b1b-57f307e6b689 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:33.271736 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-dbfca745-3227-41a2-9b1b-57f307e6b689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '890e8a6c2d1c423eb99759f3282f9a83'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:33.283039 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-dbfca745-3227-41a2-9b1b-57f307e6b689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '890e8a6c2d1c423eb99759f3282f9a83'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:33.289445 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-dbfca745-3227-41a2-9b1b-57f307e6b689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '890e8a6c2d1c423eb99759f3282f9a83'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:33.297594 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-dbfca745-3227-41a2-9b1b-57f307e6b689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '890e8a6c2d1c423eb99759f3282f9a83'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:33.298193 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-dbfca745-3227-41a2-9b1b-57f307e6b689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '890e8a6c2d1c423eb99759f3282f9a83'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:33.307993 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1117/2248] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:53:33 2022] DELETE /identity/v3/users/890e8a6c2d1c423eb99759f3282f9a83 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:33.312805 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20f114-f4d8-4c93-85b3-fabde35afbb0 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:33.313312 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20f114-f4d8-4c93-85b3-fabde35afbb0 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:33.313405 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20f114-f4d8-4c93-85b3-fabde35afbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:33.331298 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-df20f114-f4d8-4c93-85b3-fabde35afbb0 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:33.332482 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-df20f114-f4d8-4c93-85b3-fabde35afbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:33.392970 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1132/2249] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:53:33.403048 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfca745-3227-41a2-9b1b-57f307e6b689 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:33.404562 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-dbfca745-3227-41a2-9b1b-57f307e6b689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:33.459996 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfca745-3227-41a2-9b1b-57f307e6b689 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:33.464494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad2ee8-4455-45c7-8805-4e965430cfa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:33.465185 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad2ee8-4455-45c7-8805-4e965430cfa1 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:33.465449 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad2ee8-4455-45c7-8805-4e965430cfa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:33.465738 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad2ee8-4455-45c7-8805-4e965430cfa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:33.478870 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad2ee8-4455-45c7-8805-4e965430cfa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:33.480318 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad2ee8-4455-45c7-8805-4e965430cfa1 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:33.490116 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1118/2250] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:53:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:53:33.804057 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20f114-f4d8-4c93-85b3-fabde35afbb0 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:33.805612 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-df20f114-f4d8-4c93-85b3-fabde35afbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:33.817472 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20f114-f4d8-4c93-85b3-fabde35afbb0 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:33.825095 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19809c4c-3372-4552-ae74-db6e5d5286ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:33.826116 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19809c4c-3372-4552-ae74-db6e5d5286ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:33.826347 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19809c4c-3372-4552-ae74-db6e5d5286ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:33.826629 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19809c4c-3372-4552-ae74-db6e5d5286ed admin admin] PATH_INFO: `/v3/projects/b3f48605494c4c7a805330e9ef878e2c` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:33.828700 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19809c4c-3372-4552-ae74-db6e5d5286ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3f48605494c4c7a805330e9ef878e2c)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:33.830955 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19809c4c-3372-4552-ae74-db6e5d5286ed admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:33.885989 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-19809c4c-3372-4552-ae74-db6e5d5286ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3f48605494c4c7a805330e9ef878e2c', 'request_id': 'req-19809c4c-3372-4552-ae74-db6e5d5286ed'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:33.891989 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-19809c4c-3372-4552-ae74-db6e5d5286ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3f48605494c4c7a805330e9ef878e2c', 'request_id': 'req-19809c4c-3372-4552-ae74-db6e5d5286ed'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:33.900953 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-19809c4c-3372-4552-ae74-db6e5d5286ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3f48605494c4c7a805330e9ef878e2c', 'request_id': 'req-19809c4c-3372-4552-ae74-db6e5d5286ed'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:33.912672 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-19809c4c-3372-4552-ae74-db6e5d5286ed admin admin] The token cache is being invalidate because project b3f48605494c4c7a805330e9ef878e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:53:33.912970 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-19809c4c-3372-4552-ae74-db6e5d5286ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:33.913648 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-19809c4c-3372-4552-ae74-db6e5d5286ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:33.915275 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1133/2251] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:53:33 2022] DELETE /identity/v3/projects/b3f48605494c4c7a805330e9ef878e2c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:33.919294 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad2ee8-4455-45c7-8805-4e965430cfa1 service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:33.929355 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad2ee8-4455-45c7-8805-4e965430cfa1 service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:33.984487 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07974d7-dc2c-46a3-bd8b-6d02ecfc3a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:33.985599 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07974d7-dc2c-46a3-bd8b-6d02ecfc3a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:33.985881 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07974d7-dc2c-46a3-bd8b-6d02ecfc3a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:33.986157 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07974d7-dc2c-46a3-bd8b-6d02ecfc3a00 admin admin] PATH_INFO: `/v3/users/afce53a980b44d3487d27b657ccca8a6` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:33.987397 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07974d7-dc2c-46a3-bd8b-6d02ecfc3a00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afce53a980b44d3487d27b657ccca8a6)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:33.989370 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07974d7-dc2c-46a3-bd8b-6d02ecfc3a00 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:34.035651 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f07974d7-dc2c-46a3-bd8b-6d02ecfc3a00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afce53a980b44d3487d27b657ccca8a6'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:34.046768 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f07974d7-dc2c-46a3-bd8b-6d02ecfc3a00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afce53a980b44d3487d27b657ccca8a6'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:34.053913 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f07974d7-dc2c-46a3-bd8b-6d02ecfc3a00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afce53a980b44d3487d27b657ccca8a6'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:34.062258 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f07974d7-dc2c-46a3-bd8b-6d02ecfc3a00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afce53a980b44d3487d27b657ccca8a6'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:34.062980 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f07974d7-dc2c-46a3-bd8b-6d02ecfc3a00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afce53a980b44d3487d27b657ccca8a6'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:34.069000 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1119/2252] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:53:33 2022] DELETE /identity/v3/users/afce53a980b44d3487d27b657ccca8a6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:53:34.379708 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19809c4c-3372-4552-ae74-db6e5d5286ed admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:34.381327 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-19809c4c-3372-4552-ae74-db6e5d5286ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:34.394642 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19809c4c-3372-4552-ae74-db6e5d5286ed admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:34.450412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8140144-a25e-4810-88bc-c577fc4ed994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:34.451185 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8140144-a25e-4810-88bc-c577fc4ed994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:34.451466 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8140144-a25e-4810-88bc-c577fc4ed994 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:34.451738 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8140144-a25e-4810-88bc-c577fc4ed994 admin admin] PATH_INFO: `/v3/projects/47098af4ae1e482697bee737ecbbb5bd` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:34.453004 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8140144-a25e-4810-88bc-c577fc4ed994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47098af4ae1e482697bee737ecbbb5bd)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:34.454922 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8140144-a25e-4810-88bc-c577fc4ed994 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:34.503212 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b8140144-a25e-4810-88bc-c577fc4ed994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47098af4ae1e482697bee737ecbbb5bd', 'request_id': 'req-b8140144-a25e-4810-88bc-c577fc4ed994'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:34.509029 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b8140144-a25e-4810-88bc-c577fc4ed994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47098af4ae1e482697bee737ecbbb5bd', 'request_id': 'req-b8140144-a25e-4810-88bc-c577fc4ed994'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:34.519194 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b8140144-a25e-4810-88bc-c577fc4ed994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47098af4ae1e482697bee737ecbbb5bd', 'request_id': 'req-b8140144-a25e-4810-88bc-c577fc4ed994'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:34.537728 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b8140144-a25e-4810-88bc-c577fc4ed994 admin admin] The token cache is being invalidate because project 47098af4ae1e482697bee737ecbbb5bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:53:34.538253 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b8140144-a25e-4810-88bc-c577fc4ed994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:34.539325 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b8140144-a25e-4810-88bc-c577fc4ed994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:34.541873 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1134/2253] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:53:34 2022] DELETE /identity/v3/projects/47098af4ae1e482697bee737ecbbb5bd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:34.549113 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47118d9-3a2d-4177-9805-cd60ee587400 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:34.549595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47118d9-3a2d-4177-9805-cd60ee587400 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:34.549724 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47118d9-3a2d-4177-9805-cd60ee587400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:34.572806 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-e47118d9-3a2d-4177-9805-cd60ee587400 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:34.574007 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-e47118d9-3a2d-4177-9805-cd60ee587400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:34.632196 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1120/2254] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:34.640341 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e47b90-ff34-440f-b087-e1c008a359b0 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:34.640553 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e47b90-ff34-440f-b087-e1c008a359b0 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:34.640834 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e47b90-ff34-440f-b087-e1c008a359b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:34.665354 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-f9e47b90-ff34-440f-b087-e1c008a359b0 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:34.666555 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f9e47b90-ff34-440f-b087-e1c008a359b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:34.674747 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1135/2255] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:34.679011 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47118d9-3a2d-4177-9805-cd60ee587400 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:34.688488 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47118d9-3a2d-4177-9805-cd60ee587400 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:34.693056 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71779b-a242-4564-9f9c-a41c1fd68586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:34.693727 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71779b-a242-4564-9f9c-a41c1fd68586 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:34.694002 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71779b-a242-4564-9f9c-a41c1fd68586 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:34.694272 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71779b-a242-4564-9f9c-a41c1fd68586 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:34.695003 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71779b-a242-4564-9f9c-a41c1fd68586 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:53:34.695303 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71779b-a242-4564-9f9c-a41c1fd68586 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:34.696913 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71779b-a242-4564-9f9c-a41c1fd68586 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:34.709922 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1121/2256] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:53:34.714168 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e47b90-ff34-440f-b087-e1c008a359b0 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:34.723685 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e47b90-ff34-440f-b087-e1c008a359b0 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:34.728551 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2423e3c-f01c-4c80-9c38-42c8d72561eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:34.729274 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2423e3c-f01c-4c80-9c38-42c8d72561eb admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:34.729532 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2423e3c-f01c-4c80-9c38-42c8d72561eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:34.729974 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2423e3c-f01c-4c80-9c38-42c8d72561eb admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:34.730691 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2423e3c-f01c-4c80-9c38-42c8d72561eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:34.733535 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2423e3c-f01c-4c80-9c38-42c8d72561eb admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:34.759841 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1136/2257] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:53:34 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:53:34.764370 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71779b-a242-4564-9f9c-a41c1fd68586 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:34.775268 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71779b-a242-4564-9f9c-a41c1fd68586 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:34.831704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf9881-f900-4bfb-b3f7-b3344b60c1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:34.832401 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf9881-f900-4bfb-b3f7-b3344b60c1a1 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:34.832677 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf9881-f900-4bfb-b3f7-b3344b60c1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:34.832984 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf9881-f900-4bfb-b3f7-b3344b60c1a1 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:34.833714 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf9881-f900-4bfb-b3f7-b3344b60c1a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:34.835606 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf9881-f900-4bfb-b3f7-b3344b60c1a1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:34.855609 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1122/2258] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:53:34 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:53:34.859718 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2423e3c-f01c-4c80-9c38-42c8d72561eb admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:34.869984 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2423e3c-f01c-4c80-9c38-42c8d72561eb admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:34.874595 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c452c4a-af80-4bce-9776-4fa56a635fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:34.875239 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c452c4a-af80-4bce-9776-4fa56a635fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:34.875520 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c452c4a-af80-4bce-9776-4fa56a635fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:34.875792 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c452c4a-af80-4bce-9776-4fa56a635fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:34.876529 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c452c4a-af80-4bce-9776-4fa56a635fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:34.878152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c452c4a-af80-4bce-9776-4fa56a635fc0 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:34.888254 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1137/2259] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:53:34.892082 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf9881-f900-4bfb-b3f7-b3344b60c1a1 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:34.902307 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf9881-f900-4bfb-b3f7-b3344b60c1a1 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:34.907245 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e5fa0-367f-4f32-9453-21d03df28bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:34.907891 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e5fa0-367f-4f32-9453-21d03df28bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:34.908196 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e5fa0-367f-4f32-9453-21d03df28bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:34.908470 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e5fa0-367f-4f32-9453-21d03df28bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:34.909228 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e5fa0-367f-4f32-9453-21d03df28bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:34.910814 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e5fa0-367f-4f32-9453-21d03df28bd4 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:34.920616 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1123/2260] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:53:34.924482 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c452c4a-af80-4bce-9776-4fa56a635fc0 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:34.934290 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c452c4a-af80-4bce-9776-4fa56a635fc0 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:34.939221 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b915f6b-7b4d-422b-8fe3-d2e763ea0a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:34.940091 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b915f6b-7b4d-422b-8fe3-d2e763ea0a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:34.940374 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b915f6b-7b4d-422b-8fe3-d2e763ea0a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:34.940650 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b915f6b-7b4d-422b-8fe3-d2e763ea0a40 admin admin] PATH_INFO: `/v3/projects/71a6513f583e4a4f9c0180bbd1269090/users/14a5d8f8ab6e46c99f0af84f675c8452/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:34.954860 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b915f6b-7b4d-422b-8fe3-d2e763ea0a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a6513f583e4a4f9c0180bbd1269090, user_id=14a5d8f8ab6e46c99f0af84f675c8452, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:34.957573 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b915f6b-7b4d-422b-8fe3-d2e763ea0a40 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:34.971496 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1138/2261] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:53:34 2022] PUT /identity/v3/projects/71a6513f583e4a4f9c0180bbd1269090/users/14a5d8f8ab6e46c99f0af84f675c8452/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:53:34.982543 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4c9c5-1599-43b3-90a1-dffe8cafc1e5 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:34.982835 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4c9c5-1599-43b3-90a1-dffe8cafc1e5 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:34.983110 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4c9c5-1599-43b3-90a1-dffe8cafc1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:35.010010 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-86a4c9c5-1599-43b3-90a1-dffe8cafc1e5 None None] MFA Rules not processed for user `14a5d8f8ab6e46c99f0af84f675c8452`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:35.011200 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-86a4c9c5-1599-43b3-90a1-dffe8cafc1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:35.088237 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1124/2262] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:35.093283 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b915f6b-7b4d-422b-8fe3-d2e763ea0a40 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:35.159091 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b915f6b-7b4d-422b-8fe3-d2e763ea0a40 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:35.164170 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d39b1-24aa-4266-8a31-aa10658ab371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:35.164816 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d39b1-24aa-4266-8a31-aa10658ab371 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:35.165130 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d39b1-24aa-4266-8a31-aa10658ab371 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:35.165404 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d39b1-24aa-4266-8a31-aa10658ab371 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:35.166101 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d39b1-24aa-4266-8a31-aa10658ab371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:35.167974 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d39b1-24aa-4266-8a31-aa10658ab371 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:35.196068 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1139/2263] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:53:35 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:53:35.200270 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4c9c5-1599-43b3-90a1-dffe8cafc1e5 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:35.210916 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4c9c5-1599-43b3-90a1-dffe8cafc1e5 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:35.267472 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea3d60-3fb9-4701-b97d-81ceb4e04a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:35.268064 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea3d60-3fb9-4701-b97d-81ceb4e04a8b admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:35.268343 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea3d60-3fb9-4701-b97d-81ceb4e04a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:35.268617 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea3d60-3fb9-4701-b97d-81ceb4e04a8b admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:35.269335 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea3d60-3fb9-4701-b97d-81ceb4e04a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:35.271252 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea3d60-3fb9-4701-b97d-81ceb4e04a8b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:35.293233 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1125/2264] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:53:35 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:53:35.297601 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d39b1-24aa-4266-8a31-aa10658ab371 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:35.307832 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d39b1-24aa-4266-8a31-aa10658ab371 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:35.312704 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f9507-635f-492b-b745-a007529fab6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:35.313444 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f9507-635f-492b-b745-a007529fab6d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:35.313730 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f9507-635f-492b-b745-a007529fab6d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:35.314010 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f9507-635f-492b-b745-a007529fab6d admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:35.314789 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f9507-635f-492b-b745-a007529fab6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:35.316454 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f9507-635f-492b-b745-a007529fab6d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:35.327353 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1140/2265] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:53:35.331632 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea3d60-3fb9-4701-b97d-81ceb4e04a8b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:35.346433 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea3d60-3fb9-4701-b97d-81ceb4e04a8b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:35.354582 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ff79a-019d-483a-bcf3-12b30b4dd54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:35.355927 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ff79a-019d-483a-bcf3-12b30b4dd54c admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:35.356261 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ff79a-019d-483a-bcf3-12b30b4dd54c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:35.356525 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ff79a-019d-483a-bcf3-12b30b4dd54c admin admin] PATH_INFO: `/v3/projects/9583ef8cf39f4a5e938e54cad7bf3f65/users/7c9adf07707b44fcb0d60157276dbf48/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:35.372529 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ff79a-019d-483a-bcf3-12b30b4dd54c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9583ef8cf39f4a5e938e54cad7bf3f65, user_id=7c9adf07707b44fcb0d60157276dbf48, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:35.375258 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ff79a-019d-483a-bcf3-12b30b4dd54c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:35.389535 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1126/2266] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:53:35 2022] PUT /identity/v3/projects/9583ef8cf39f4a5e938e54cad7bf3f65/users/7c9adf07707b44fcb0d60157276dbf48/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:35.393722 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f9507-635f-492b-b745-a007529fab6d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:35.404318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f9507-635f-492b-b745-a007529fab6d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:35.463570 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a998f-27b3-465a-a978-aade7848e4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:35.464213 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a998f-27b3-465a-a978-aade7848e4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:35.464496 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a998f-27b3-465a-a978-aade7848e4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:35.464773 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a998f-27b3-465a-a978-aade7848e4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:35.465516 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a998f-27b3-465a-a978-aade7848e4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:35.467150 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a998f-27b3-465a-a978-aade7848e4f3 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:35.476509 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1141/2267] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:53:35.480715 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ff79a-019d-483a-bcf3-12b30b4dd54c admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:35.491060 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ff79a-019d-483a-bcf3-12b30b4dd54c admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:35.496083 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1735407-936c-4a71-9613-e9c81574f383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:35.496997 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1735407-936c-4a71-9613-e9c81574f383 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:35.497270 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1735407-936c-4a71-9613-e9c81574f383 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:35.497535 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1735407-936c-4a71-9613-e9c81574f383 admin admin] PATH_INFO: `/v3/projects/9583ef8cf39f4a5e938e54cad7bf3f65/users/7c9adf07707b44fcb0d60157276dbf48/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:35.499544 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1735407-936c-4a71-9613-e9c81574f383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9583ef8cf39f4a5e938e54cad7bf3f65, user_id=7c9adf07707b44fcb0d60157276dbf48, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:35.502202 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1735407-936c-4a71-9613-e9c81574f383 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:35.512372 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1127/2268] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:53:35 2022] PUT /identity/v3/projects/9583ef8cf39f4a5e938e54cad7bf3f65/users/7c9adf07707b44fcb0d60157276dbf48/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:35.522579 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12cf63-9193-4e53-8088-dd3710a92127 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:35.522795 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12cf63-9193-4e53-8088-dd3710a92127 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:35.523113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12cf63-9193-4e53-8088-dd3710a92127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:35.551832 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-be12cf63-9193-4e53-8088-dd3710a92127 None None] MFA Rules not processed for user `7c9adf07707b44fcb0d60157276dbf48`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:35.553084 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-be12cf63-9193-4e53-8088-dd3710a92127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:35.627552 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1142/2269] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:35.637816 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1735407-936c-4a71-9613-e9c81574f383 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:35.639858 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-a1735407-936c-4a71-9613-e9c81574f383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:35.724129 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1735407-936c-4a71-9613-e9c81574f383 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:35.727921 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ca458-d424-483e-8241-a6661add59e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:35.728678 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ca458-d424-483e-8241-a6661add59e3 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:35.729000 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ca458-d424-483e-8241-a6661add59e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:35.729393 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ca458-d424-483e-8241-a6661add59e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:35.738855 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ca458-d424-483e-8241-a6661add59e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:35.740328 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ca458-d424-483e-8241-a6661add59e3 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:35.749729 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1128/2270] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:53:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:53:35.822017 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12cf63-9193-4e53-8088-dd3710a92127 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:35.889055 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12cf63-9193-4e53-8088-dd3710a92127 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:35.893767 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b608c8-048f-45cc-9d54-cbb8804acff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:35.894631 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b608c8-048f-45cc-9d54-cbb8804acff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:35.894903 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b608c8-048f-45cc-9d54-cbb8804acff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:35.895169 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b608c8-048f-45cc-9d54-cbb8804acff2 admin admin] PATH_INFO: `/v3/users/14a5d8f8ab6e46c99f0af84f675c8452` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:35.896388 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b608c8-048f-45cc-9d54-cbb8804acff2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a5d8f8ab6e46c99f0af84f675c8452)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:35.898783 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b608c8-048f-45cc-9d54-cbb8804acff2 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:35.948234 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-65b608c8-048f-45cc-9d54-cbb8804acff2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a5d8f8ab6e46c99f0af84f675c8452'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:35.948926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-65b608c8-048f-45cc-9d54-cbb8804acff2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a5d8f8ab6e46c99f0af84f675c8452'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:35.949547 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-65b608c8-048f-45cc-9d54-cbb8804acff2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a5d8f8ab6e46c99f0af84f675c8452'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:35.961096 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-65b608c8-048f-45cc-9d54-cbb8804acff2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a5d8f8ab6e46c99f0af84f675c8452'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:35.968420 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-65b608c8-048f-45cc-9d54-cbb8804acff2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a5d8f8ab6e46c99f0af84f675c8452'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:35.981838 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1143/2271] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:53:35 2022] DELETE /identity/v3/users/14a5d8f8ab6e46c99f0af84f675c8452 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:35.986310 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b4054-0c44-4d71-a5fe-dc843cfa42de None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:35.986600 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b4054-0c44-4d71-a5fe-dc843cfa42de None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:35.986876 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b4054-0c44-4d71-a5fe-dc843cfa42de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:36.007709 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-c65b4054-0c44-4d71-a5fe-dc843cfa42de None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:36.009628 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-c65b4054-0c44-4d71-a5fe-dc843cfa42de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:36.075045 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1129/2272] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:36.085006 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b608c8-048f-45cc-9d54-cbb8804acff2 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:36.086637 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-65b608c8-048f-45cc-9d54-cbb8804acff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:36.143262 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b608c8-048f-45cc-9d54-cbb8804acff2 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:36.148192 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7876cb0-d1f6-4213-ba9a-b5ba253acb47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:36.149206 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7876cb0-d1f6-4213-ba9a-b5ba253acb47 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:36.149481 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7876cb0-d1f6-4213-ba9a-b5ba253acb47 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:36.149756 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7876cb0-d1f6-4213-ba9a-b5ba253acb47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:36.159282 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7876cb0-d1f6-4213-ba9a-b5ba253acb47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:36.160728 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7876cb0-d1f6-4213-ba9a-b5ba253acb47 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:36.171325 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1144/2273] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:53:36.439445 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b4054-0c44-4d71-a5fe-dc843cfa42de None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:36.441030 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-c65b4054-0c44-4d71-a5fe-dc843cfa42de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:36.453031 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b4054-0c44-4d71-a5fe-dc843cfa42de None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:36.458943 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae538335-dfaa-4ef2-8092-a38effb654ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:36.459810 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae538335-dfaa-4ef2-8092-a38effb654ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:36.460085 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae538335-dfaa-4ef2-8092-a38effb654ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:36.460372 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae538335-dfaa-4ef2-8092-a38effb654ec admin admin] PATH_INFO: `/v3/projects/71a6513f583e4a4f9c0180bbd1269090` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:36.461738 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae538335-dfaa-4ef2-8092-a38effb654ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=71a6513f583e4a4f9c0180bbd1269090)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:36.463788 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae538335-dfaa-4ef2-8092-a38effb654ec admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:36.510670 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-ae538335-dfaa-4ef2-8092-a38effb654ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71a6513f583e4a4f9c0180bbd1269090', 'request_id': 'req-ae538335-dfaa-4ef2-8092-a38effb654ec'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:36.516465 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-ae538335-dfaa-4ef2-8092-a38effb654ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71a6513f583e4a4f9c0180bbd1269090', 'request_id': 'req-ae538335-dfaa-4ef2-8092-a38effb654ec'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:36.525307 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-ae538335-dfaa-4ef2-8092-a38effb654ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71a6513f583e4a4f9c0180bbd1269090', 'request_id': 'req-ae538335-dfaa-4ef2-8092-a38effb654ec'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:36.535569 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-ae538335-dfaa-4ef2-8092-a38effb654ec admin admin] The token cache is being invalidate because project 71a6513f583e4a4f9c0180bbd1269090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:53:36.535879 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-ae538335-dfaa-4ef2-8092-a38effb654ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:36.536504 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-ae538335-dfaa-4ef2-8092-a38effb654ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:36.538061 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1130/2274] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:53:36 2022] DELETE /identity/v3/projects/71a6513f583e4a4f9c0180bbd1269090 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:36.542101 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7876cb0-d1f6-4213-ba9a-b5ba253acb47 service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:36.551889 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7876cb0-d1f6-4213-ba9a-b5ba253acb47 service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:36.609216 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8182c-0a45-4835-b46f-d8bc2de56657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:36.609983 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8182c-0a45-4835-b46f-d8bc2de56657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:36.610258 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8182c-0a45-4835-b46f-d8bc2de56657 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:36.610532 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8182c-0a45-4835-b46f-d8bc2de56657 admin admin] PATH_INFO: `/v3/users/7c9adf07707b44fcb0d60157276dbf48` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:36.611842 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8182c-0a45-4835-b46f-d8bc2de56657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c9adf07707b44fcb0d60157276dbf48)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:36.613806 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8182c-0a45-4835-b46f-d8bc2de56657 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:36.662147 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-fae8182c-0a45-4835-b46f-d8bc2de56657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c9adf07707b44fcb0d60157276dbf48'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:36.662838 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-fae8182c-0a45-4835-b46f-d8bc2de56657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c9adf07707b44fcb0d60157276dbf48'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:36.663468 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-fae8182c-0a45-4835-b46f-d8bc2de56657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c9adf07707b44fcb0d60157276dbf48'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:36.677051 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-fae8182c-0a45-4835-b46f-d8bc2de56657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c9adf07707b44fcb0d60157276dbf48'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:36.684086 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-fae8182c-0a45-4835-b46f-d8bc2de56657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c9adf07707b44fcb0d60157276dbf48'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:36.698547 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1145/2275] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:53:36 2022] DELETE /identity/v3/users/7c9adf07707b44fcb0d60157276dbf48 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:36.973274 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae538335-dfaa-4ef2-8092-a38effb654ec admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:36.974809 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-ae538335-dfaa-4ef2-8092-a38effb654ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:36.988906 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae538335-dfaa-4ef2-8092-a38effb654ec admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:37.062189 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8b96b-7228-43b8-8759-3358cec2e640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:37.063071 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8b96b-7228-43b8-8759-3358cec2e640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:37.063362 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8b96b-7228-43b8-8759-3358cec2e640 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:37.063639 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8b96b-7228-43b8-8759-3358cec2e640 admin admin] PATH_INFO: `/v3/projects/9583ef8cf39f4a5e938e54cad7bf3f65` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:37.065022 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8b96b-7228-43b8-8759-3358cec2e640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9583ef8cf39f4a5e938e54cad7bf3f65)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:37.066974 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8b96b-7228-43b8-8759-3358cec2e640 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:37.113141 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-93d8b96b-7228-43b8-8759-3358cec2e640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9583ef8cf39f4a5e938e54cad7bf3f65', 'request_id': 'req-93d8b96b-7228-43b8-8759-3358cec2e640'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:37.119053 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-93d8b96b-7228-43b8-8759-3358cec2e640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9583ef8cf39f4a5e938e54cad7bf3f65', 'request_id': 'req-93d8b96b-7228-43b8-8759-3358cec2e640'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:37.127381 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-93d8b96b-7228-43b8-8759-3358cec2e640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9583ef8cf39f4a5e938e54cad7bf3f65', 'request_id': 'req-93d8b96b-7228-43b8-8759-3358cec2e640'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:37.138599 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-93d8b96b-7228-43b8-8759-3358cec2e640 admin admin] The token cache is being invalidate because project 9583ef8cf39f4a5e938e54cad7bf3f65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:53:37.138872 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-93d8b96b-7228-43b8-8759-3358cec2e640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:37.143784 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-93d8b96b-7228-43b8-8759-3358cec2e640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:37.145321 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1131/2276] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:53:36 2022] DELETE /identity/v3/projects/9583ef8cf39f4a5e938e54cad7bf3f65 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:37.151206 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17e6ee-9ef2-4fa2-ad41-d2d600e33e76 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:37.151498 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17e6ee-9ef2-4fa2-ad41-d2d600e33e76 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:37.151778 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17e6ee-9ef2-4fa2-ad41-d2d600e33e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:37.170252 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-5d17e6ee-9ef2-4fa2-ad41-d2d600e33e76 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:37.171481 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-5d17e6ee-9ef2-4fa2-ad41-d2d600e33e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:37.227571 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1146/2277] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:37.235478 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8546fa9-a731-4d8f-868a-4f2faee01212 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:37.235766 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8546fa9-a731-4d8f-868a-4f2faee01212 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:37.236037 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8546fa9-a731-4d8f-868a-4f2faee01212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:37.254907 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-f8546fa9-a731-4d8f-868a-4f2faee01212 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:37.256085 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-f8546fa9-a731-4d8f-868a-4f2faee01212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:37.263892 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1132/2278] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:37.268072 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17e6ee-9ef2-4fa2-ad41-d2d600e33e76 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:37.278520 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17e6ee-9ef2-4fa2-ad41-d2d600e33e76 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:37.284188 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aebe47-ed40-441b-9945-3debb7fb0ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:37.284920 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aebe47-ed40-441b-9945-3debb7fb0ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:37.285211 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aebe47-ed40-441b-9945-3debb7fb0ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:37.285486 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aebe47-ed40-441b-9945-3debb7fb0ef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:37.286232 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aebe47-ed40-441b-9945-3debb7fb0ef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:53:37.286539 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aebe47-ed40-441b-9945-3debb7fb0ef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:37.288141 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aebe47-ed40-441b-9945-3debb7fb0ef6 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:37.300907 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1147/2279] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:53:37.304776 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8546fa9-a731-4d8f-868a-4f2faee01212 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:37.314389 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8546fa9-a731-4d8f-868a-4f2faee01212 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:37.320439 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5ae08-e691-4231-aeb4-58ae0597dc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:37.321106 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5ae08-e691-4231-aeb4-58ae0597dc9e admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:37.321389 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5ae08-e691-4231-aeb4-58ae0597dc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:37.321679 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5ae08-e691-4231-aeb4-58ae0597dc9e admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:37.322389 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5ae08-e691-4231-aeb4-58ae0597dc9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:37.324295 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5ae08-e691-4231-aeb4-58ae0597dc9e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:37.358143 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1133/2280] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:53:37 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:53:37.363913 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aebe47-ed40-441b-9945-3debb7fb0ef6 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:37.375072 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aebe47-ed40-441b-9945-3debb7fb0ef6 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:37.433437 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261e11c-5854-4e44-8fb7-a976b0dc8f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:37.434029 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261e11c-5854-4e44-8fb7-a976b0dc8f2d admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:37.434310 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261e11c-5854-4e44-8fb7-a976b0dc8f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:37.434593 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261e11c-5854-4e44-8fb7-a976b0dc8f2d admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:37.435306 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261e11c-5854-4e44-8fb7-a976b0dc8f2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:37.437364 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261e11c-5854-4e44-8fb7-a976b0dc8f2d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:37.457695 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1148/2281] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:53:37 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:53:37.462004 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5ae08-e691-4231-aeb4-58ae0597dc9e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:37.472390 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5ae08-e691-4231-aeb4-58ae0597dc9e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:37.477314 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c853385-a8f7-487c-b2cd-887f7b58166e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:37.477972 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c853385-a8f7-487c-b2cd-887f7b58166e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:37.478256 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c853385-a8f7-487c-b2cd-887f7b58166e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:37.478535 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c853385-a8f7-487c-b2cd-887f7b58166e admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:37.479302 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c853385-a8f7-487c-b2cd-887f7b58166e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:37.480894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c853385-a8f7-487c-b2cd-887f7b58166e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:37.491298 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1134/2282] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:53:37.495330 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261e11c-5854-4e44-8fb7-a976b0dc8f2d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:37.505248 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261e11c-5854-4e44-8fb7-a976b0dc8f2d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:37.510140 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99342267-9930-42ce-a3f1-dfca46d9ba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:37.510790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99342267-9930-42ce-a3f1-dfca46d9ba4f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:37.511072 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99342267-9930-42ce-a3f1-dfca46d9ba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:37.511349 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99342267-9930-42ce-a3f1-dfca46d9ba4f admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:37.512112 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99342267-9930-42ce-a3f1-dfca46d9ba4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:37.513909 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99342267-9930-42ce-a3f1-dfca46d9ba4f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:37.524030 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1149/2283] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:53:37.528125 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c853385-a8f7-487c-b2cd-887f7b58166e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:37.538239 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c853385-a8f7-487c-b2cd-887f7b58166e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:37.543254 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e6db5-1950-41ed-8db7-c601cdbe6545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:37.544193 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e6db5-1950-41ed-8db7-c601cdbe6545 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:37.544405 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e6db5-1950-41ed-8db7-c601cdbe6545 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:37.544684 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e6db5-1950-41ed-8db7-c601cdbe6545 admin admin] PATH_INFO: `/v3/projects/156eb6b5403b414ea9a4845b65dab33b/users/9fb8e0ced9b8408fa327c59e96a7798a/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:37.562914 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e6db5-1950-41ed-8db7-c601cdbe6545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=156eb6b5403b414ea9a4845b65dab33b, user_id=9fb8e0ced9b8408fa327c59e96a7798a, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:37.566713 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e6db5-1950-41ed-8db7-c601cdbe6545 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:37.583392 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1135/2284] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:53:37 2022] PUT /identity/v3/projects/156eb6b5403b414ea9a4845b65dab33b/users/9fb8e0ced9b8408fa327c59e96a7798a/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:37.594709 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92175757-70cc-469b-a46f-3780f94ec2ae None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:37.595228 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92175757-70cc-469b-a46f-3780f94ec2ae None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:37.595228 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92175757-70cc-469b-a46f-3780f94ec2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:37.624284 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-92175757-70cc-469b-a46f-3780f94ec2ae None None] MFA Rules not processed for user `9fb8e0ced9b8408fa327c59e96a7798a`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:37.625570 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-92175757-70cc-469b-a46f-3780f94ec2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:37.699134 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1150/2285] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:37.710104 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e6db5-1950-41ed-8db7-c601cdbe6545 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:37.712194 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-063e6db5-1950-41ed-8db7-c601cdbe6545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:37.772309 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e6db5-1950-41ed-8db7-c601cdbe6545 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:37.777029 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02095f-9a65-4816-b0bc-c3f912b27863 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:37.777682 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02095f-9a65-4816-b0bc-c3f912b27863 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:37.777974 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02095f-9a65-4816-b0bc-c3f912b27863 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:37.778242 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02095f-9a65-4816-b0bc-c3f912b27863 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:37.787115 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02095f-9a65-4816-b0bc-c3f912b27863 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:37.788556 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02095f-9a65-4816-b0bc-c3f912b27863 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:37.797371 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1136/2286] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:53:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:53:46.380913 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92175757-70cc-469b-a46f-3780f94ec2ae None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:46.441622 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92175757-70cc-469b-a46f-3780f94ec2ae None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:46.446134 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5d305-245d-4bfe-bf49-9a40ee5406d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:46.447009 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5d305-245d-4bfe-bf49-9a40ee5406d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:46.447293 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5d305-245d-4bfe-bf49-9a40ee5406d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:46.447570 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5d305-245d-4bfe-bf49-9a40ee5406d5 admin admin] PATH_INFO: `/v3/users/9fb8e0ced9b8408fa327c59e96a7798a` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:46.448777 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5d305-245d-4bfe-bf49-9a40ee5406d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fb8e0ced9b8408fa327c59e96a7798a)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:46.450724 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5d305-245d-4bfe-bf49-9a40ee5406d5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:46.495916 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-def5d305-245d-4bfe-bf49-9a40ee5406d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fb8e0ced9b8408fa327c59e96a7798a'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:46.496551 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-def5d305-245d-4bfe-bf49-9a40ee5406d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fb8e0ced9b8408fa327c59e96a7798a'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:46.497275 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-def5d305-245d-4bfe-bf49-9a40ee5406d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fb8e0ced9b8408fa327c59e96a7798a'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:46.509142 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-def5d305-245d-4bfe-bf49-9a40ee5406d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fb8e0ced9b8408fa327c59e96a7798a'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:46.516316 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-def5d305-245d-4bfe-bf49-9a40ee5406d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fb8e0ced9b8408fa327c59e96a7798a'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:46.529913 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1151/2287] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:53:46 2022] DELETE /identity/v3/users/9fb8e0ced9b8408fa327c59e96a7798a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:46.534782 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50130b7c-3fc5-460a-8885-ad81e0d6a08d None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:46.535288 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50130b7c-3fc5-460a-8885-ad81e0d6a08d None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:46.535384 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50130b7c-3fc5-460a-8885-ad81e0d6a08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:46.555219 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-50130b7c-3fc5-460a-8885-ad81e0d6a08d None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:46.556441 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-50130b7c-3fc5-460a-8885-ad81e0d6a08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:46.614361 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1137/2288] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:53:46.624094 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5d305-245d-4bfe-bf49-9a40ee5406d5 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:46.625537 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-def5d305-245d-4bfe-bf49-9a40ee5406d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:46.685045 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5d305-245d-4bfe-bf49-9a40ee5406d5 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:46.689250 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3697c-076a-45ab-8d1e-3260e1536581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:46.689910 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3697c-076a-45ab-8d1e-3260e1536581 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:46.690192 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3697c-076a-45ab-8d1e-3260e1536581 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:46.690468 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3697c-076a-45ab-8d1e-3260e1536581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:46.701743 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3697c-076a-45ab-8d1e-3260e1536581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:46.703320 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3697c-076a-45ab-8d1e-3260e1536581 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:46.715300 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1152/2289] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:53:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:53:46.999606 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50130b7c-3fc5-460a-8885-ad81e0d6a08d None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:47.001251 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-50130b7c-3fc5-460a-8885-ad81e0d6a08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:47.014018 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50130b7c-3fc5-460a-8885-ad81e0d6a08d None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:47.019307 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c1bfa-db4d-4e16-b74d-602f12da852d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:47.020311 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c1bfa-db4d-4e16-b74d-602f12da852d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.020668 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c1bfa-db4d-4e16-b74d-602f12da852d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.021179 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c1bfa-db4d-4e16-b74d-602f12da852d admin admin] PATH_INFO: `/v3/projects/156eb6b5403b414ea9a4845b65dab33b` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.022886 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c1bfa-db4d-4e16-b74d-602f12da852d admin admin] RBAC: Authorizing `identity:delete_project(project_id=156eb6b5403b414ea9a4845b65dab33b)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:47.028537 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c1bfa-db4d-4e16-b74d-602f12da852d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:47.062130 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3697c-076a-45ab-8d1e-3260e1536581 service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:47.063721 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-51d3697c-076a-45ab-8d1e-3260e1536581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:47.079449 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3697c-076a-45ab-8d1e-3260e1536581 service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:47.091323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a06c1bfa-db4d-4e16-b74d-602f12da852d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '156eb6b5403b414ea9a4845b65dab33b', 'request_id': 'req-a06c1bfa-db4d-4e16-b74d-602f12da852d'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:47.098102 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a06c1bfa-db4d-4e16-b74d-602f12da852d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '156eb6b5403b414ea9a4845b65dab33b', 'request_id': 'req-a06c1bfa-db4d-4e16-b74d-602f12da852d'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:47.108533 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a06c1bfa-db4d-4e16-b74d-602f12da852d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '156eb6b5403b414ea9a4845b65dab33b', 'request_id': 'req-a06c1bfa-db4d-4e16-b74d-602f12da852d'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:47.119150 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a06c1bfa-db4d-4e16-b74d-602f12da852d admin admin] The token cache is being invalidate because project 156eb6b5403b414ea9a4845b65dab33b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:53:47.119437 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a06c1bfa-db4d-4e16-b74d-602f12da852d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:47.120097 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a06c1bfa-db4d-4e16-b74d-602f12da852d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:47.121685 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1138/2290] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:53:46 2022] DELETE /identity/v3/projects/156eb6b5403b414ea9a4845b65dab33b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:47.127278 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf958d-2860-475e-9990-229216405959 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.127637 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf958d-2860-475e-9990-229216405959 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.128021 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf958d-2860-475e-9990-229216405959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.145564 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff97cd6-d18f-4f96-8d22-a704b6276c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:47.146179 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-d3bf958d-2860-475e-9990-229216405959 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:47.146581 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff97cd6-d18f-4f96-8d22-a704b6276c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.146887 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff97cd6-d18f-4f96-8d22-a704b6276c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.147154 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff97cd6-d18f-4f96-8d22-a704b6276c36 admin admin] PATH_INFO: `/v3/users/794281dc95a049b796164e866d3f2912` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.147492 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-d3bf958d-2860-475e-9990-229216405959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:47.148755 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff97cd6-d18f-4f96-8d22-a704b6276c36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=794281dc95a049b796164e866d3f2912)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:47.150754 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff97cd6-d18f-4f96-8d22-a704b6276c36 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:47.155982 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1139/2291] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:53:47.163772 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05438146-a31f-4022-aa34-a08972153914 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.164092 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05438146-a31f-4022-aa34-a08972153914 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.164371 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05438146-a31f-4022-aa34-a08972153914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.182879 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-05438146-a31f-4022-aa34-a08972153914 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:47.184067 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-05438146-a31f-4022-aa34-a08972153914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:47.192896 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1140/2292] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:53:47.197055 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05438146-a31f-4022-aa34-a08972153914 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:47.201466 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-5ff97cd6-d18f-4f96-8d22-a704b6276c36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '794281dc95a049b796164e866d3f2912'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:47.202302 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-5ff97cd6-d18f-4f96-8d22-a704b6276c36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '794281dc95a049b796164e866d3f2912'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:47.203158 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-5ff97cd6-d18f-4f96-8d22-a704b6276c36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '794281dc95a049b796164e866d3f2912'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:47.206595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05438146-a31f-4022-aa34-a08972153914 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:47.212497 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df6698-ebc2-442c-bad4-0fdfbf06ef48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:47.213129 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df6698-ebc2-442c-bad4-0fdfbf06ef48 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.213410 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df6698-ebc2-442c-bad4-0fdfbf06ef48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.213692 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df6698-ebc2-442c-bad4-0fdfbf06ef48 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.214442 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df6698-ebc2-442c-bad4-0fdfbf06ef48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:53:47.214747 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df6698-ebc2-442c-bad4-0fdfbf06ef48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:47.215355 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-5ff97cd6-d18f-4f96-8d22-a704b6276c36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '794281dc95a049b796164e866d3f2912'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:47.216384 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df6698-ebc2-442c-bad4-0fdfbf06ef48 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:47.222252 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-5ff97cd6-d18f-4f96-8d22-a704b6276c36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '794281dc95a049b796164e866d3f2912'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:47.227713 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1141/2293] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:53:47.232105 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df6698-ebc2-442c-bad4-0fdfbf06ef48 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:47.233952 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-57df6698-ebc2-442c-bad4-0fdfbf06ef48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:47.236422 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1153/2294] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:53:47 2022] DELETE /identity/v3/users/794281dc95a049b796164e866d3f2912 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:53:47.247044 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df6698-ebc2-442c-bad4-0fdfbf06ef48 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:47.309349 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f9f04-35cc-47b4-bf5b-70105e6877b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:47.310311 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f9f04-35cc-47b4-bf5b-70105e6877b1 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.310771 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f9f04-35cc-47b4-bf5b-70105e6877b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.311243 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f9f04-35cc-47b4-bf5b-70105e6877b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.311814 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f9f04-35cc-47b4-bf5b-70105e6877b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:47.313764 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f9f04-35cc-47b4-bf5b-70105e6877b1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:47.343341 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1142/2295] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:53:47 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:53:47.347102 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff97cd6-d18f-4f96-8d22-a704b6276c36 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:47.357823 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff97cd6-d18f-4f96-8d22-a704b6276c36 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:47.417904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a401bc-2cb1-46d8-b14c-a98fc7f8db75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:47.418595 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a401bc-2cb1-46d8-b14c-a98fc7f8db75 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.418869 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a401bc-2cb1-46d8-b14c-a98fc7f8db75 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.419178 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a401bc-2cb1-46d8-b14c-a98fc7f8db75 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.419854 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a401bc-2cb1-46d8-b14c-a98fc7f8db75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:47.420444 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f9f04-35cc-47b4-bf5b-70105e6877b1 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:47.421874 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a401bc-2cb1-46d8-b14c-a98fc7f8db75 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:47.422378 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-785f9f04-35cc-47b4-bf5b-70105e6877b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:47.440343 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f9f04-35cc-47b4-bf5b-70105e6877b1 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:47.445600 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1154/2296] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:53:47 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:53:47.445742 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bda0e-5d1d-4c35-8643-a76749e7a8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:47.446906 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bda0e-5d1d-4c35-8643-a76749e7a8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.447189 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bda0e-5d1d-4c35-8643-a76749e7a8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.447778 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bda0e-5d1d-4c35-8643-a76749e7a8ec admin admin] PATH_INFO: `/v3/projects/5b3ea1177c3241b5b730f359c367f44b` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.449214 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bda0e-5d1d-4c35-8643-a76749e7a8ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3ea1177c3241b5b730f359c367f44b)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:47.450727 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a401bc-2cb1-46d8-b14c-a98fc7f8db75 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:47.451173 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bda0e-5d1d-4c35-8643-a76749e7a8ec admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:47.462754 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a401bc-2cb1-46d8-b14c-a98fc7f8db75 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:47.467677 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4f397-b3a7-408f-a02b-0e4b884d7cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:47.468329 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4f397-b3a7-408f-a02b-0e4b884d7cda admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.468610 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4f397-b3a7-408f-a02b-0e4b884d7cda admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.468912 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4f397-b3a7-408f-a02b-0e4b884d7cda admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.469652 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4f397-b3a7-408f-a02b-0e4b884d7cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:47.471235 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4f397-b3a7-408f-a02b-0e4b884d7cda admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:47.482934 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1155/2297] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:53:47.486946 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4f397-b3a7-408f-a02b-0e4b884d7cda admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:47.496437 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4f397-b3a7-408f-a02b-0e4b884d7cda admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:47.499658 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c72bda0e-5d1d-4c35-8643-a76749e7a8ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3ea1177c3241b5b730f359c367f44b', 'request_id': 'req-c72bda0e-5d1d-4c35-8643-a76749e7a8ec'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:47.505914 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c72bda0e-5d1d-4c35-8643-a76749e7a8ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3ea1177c3241b5b730f359c367f44b', 'request_id': 'req-c72bda0e-5d1d-4c35-8643-a76749e7a8ec'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:47.514240 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c72bda0e-5d1d-4c35-8643-a76749e7a8ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3ea1177c3241b5b730f359c367f44b', 'request_id': 'req-c72bda0e-5d1d-4c35-8643-a76749e7a8ec'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:47.524890 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c72bda0e-5d1d-4c35-8643-a76749e7a8ec admin admin] The token cache is being invalidate because project 5b3ea1177c3241b5b730f359c367f44b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:53:47.525174 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c72bda0e-5d1d-4c35-8643-a76749e7a8ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:47.525824 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-c72bda0e-5d1d-4c35-8643-a76749e7a8ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:47.527833 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1143/2298] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:53:47 2022] DELETE /identity/v3/projects/5b3ea1177c3241b5b730f359c367f44b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:53:47.533383 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559043ab-2127-4ebf-97a0-f3787a93b593 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.533669 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559043ab-2127-4ebf-97a0-f3787a93b593 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.533944 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559043ab-2127-4ebf-97a0-f3787a93b593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.551270 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-559043ab-2127-4ebf-97a0-f3787a93b593 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:47.552445 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-559043ab-2127-4ebf-97a0-f3787a93b593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:47.554820 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b4c97-aced-4bda-a187-192d7a6a56f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:47.555479 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b4c97-aced-4bda-a187-192d7a6a56f5 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.555758 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b4c97-aced-4bda-a187-192d7a6a56f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.556003 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b4c97-aced-4bda-a187-192d7a6a56f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.556794 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b4c97-aced-4bda-a187-192d7a6a56f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:47.558379 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b4c97-aced-4bda-a187-192d7a6a56f5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:47.560293 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1144/2299] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:53:47.567888 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8523dbe-c0dd-4df4-a50e-ebc3c776a7c9 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.568231 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8523dbe-c0dd-4df4-a50e-ebc3c776a7c9 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.568567 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8523dbe-c0dd-4df4-a50e-ebc3c776a7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.574629 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1156/2300] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:53:47.578527 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b4c97-aced-4bda-a187-192d7a6a56f5 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:47.580129 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-d62b4c97-aced-4bda-a187-192d7a6a56f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:47.588630 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-e8523dbe-c0dd-4df4-a50e-ebc3c776a7c9 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:47.589952 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-e8523dbe-c0dd-4df4-a50e-ebc3c776a7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:47.592534 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b4c97-aced-4bda-a187-192d7a6a56f5 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:47.597135 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9202fc-90dd-469d-8920-02b0aee3642d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:47.597925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1145/2301] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:53:47.598282 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9202fc-90dd-469d-8920-02b0aee3642d admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.598566 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9202fc-90dd-469d-8920-02b0aee3642d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.598844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9202fc-90dd-469d-8920-02b0aee3642d admin admin] PATH_INFO: `/v3/projects/be466e869901467683289109990fb4d1/users/224e3fb5b8f54a97ad60d7a7f9b2b20e/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.602436 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8523dbe-c0dd-4df4-a50e-ebc3c776a7c9 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:47.610669 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8523dbe-c0dd-4df4-a50e-ebc3c776a7c9 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:47.613342 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9202fc-90dd-469d-8920-02b0aee3642d admin admin] RBAC: Authorizing `identity:create_grant(project_id=be466e869901467683289109990fb4d1, user_id=224e3fb5b8f54a97ad60d7a7f9b2b20e, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:47.615262 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787e0ec-7940-46d7-b6c9-a642f5ea817c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:47.615904 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787e0ec-7940-46d7-b6c9-a642f5ea817c admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.616018 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9202fc-90dd-469d-8920-02b0aee3642d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:47.616187 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787e0ec-7940-46d7-b6c9-a642f5ea817c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.616463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787e0ec-7940-46d7-b6c9-a642f5ea817c admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.617266 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787e0ec-7940-46d7-b6c9-a642f5ea817c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:53:47.617565 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787e0ec-7940-46d7-b6c9-a642f5ea817c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:47.619139 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787e0ec-7940-46d7-b6c9-a642f5ea817c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:47.629218 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1157/2302] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:53:47 2022] PUT /identity/v3/projects/be466e869901467683289109990fb4d1/users/224e3fb5b8f54a97ad60d7a7f9b2b20e/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:53:47.637096 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1146/2303] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:53:47.638359 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9202fc-90dd-469d-8920-02b0aee3642d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:47.639036 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028ad95-aad4-4bcc-9a94-cc7dab4ccd22 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.639409 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028ad95-aad4-4bcc-9a94-cc7dab4ccd22 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.639684 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028ad95-aad4-4bcc-9a94-cc7dab4ccd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.665623 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-3028ad95-aad4-4bcc-9a94-cc7dab4ccd22 None None] MFA Rules not processed for user `224e3fb5b8f54a97ad60d7a7f9b2b20e`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:47.666804 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-3028ad95-aad4-4bcc-9a94-cc7dab4ccd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:47.696795 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9202fc-90dd-469d-8920-02b0aee3642d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:47.701636 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7f3c0-4bbd-44a5-8aa5-805983745a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:47.702314 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7f3c0-4bbd-44a5-8aa5-805983745a70 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.702600 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7f3c0-4bbd-44a5-8aa5-805983745a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.702875 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7f3c0-4bbd-44a5-8aa5-805983745a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.703576 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7f3c0-4bbd-44a5-8aa5-805983745a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:47.705504 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7f3c0-4bbd-44a5-8aa5-805983745a70 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:47.727578 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1147/2304] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:53:47.733672 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1158/2305] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:53:47 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:53:47.737753 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028ad95-aad4-4bcc-9a94-cc7dab4ccd22 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:47.737930 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7f3c0-4bbd-44a5-8aa5-805983745a70 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:47.739542 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-6fb7f3c0-4bbd-44a5-8aa5-805983745a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:47.748368 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028ad95-aad4-4bcc-9a94-cc7dab4ccd22 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:47.794304 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7f3c0-4bbd-44a5-8aa5-805983745a70 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:47.797953 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804103ca-045e-4d52-91d4-f90c47142282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:47.798597 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804103ca-045e-4d52-91d4-f90c47142282 service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.798884 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804103ca-045e-4d52-91d4-f90c47142282 service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.799157 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804103ca-045e-4d52-91d4-f90c47142282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.800761 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e134e9f-033c-4204-8a15-4fcd7d9754a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:47.801471 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e134e9f-033c-4204-8a15-4fcd7d9754a2 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.801752 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e134e9f-033c-4204-8a15-4fcd7d9754a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.802030 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e134e9f-033c-4204-8a15-4fcd7d9754a2 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.802737 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e134e9f-033c-4204-8a15-4fcd7d9754a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:47.804648 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e134e9f-033c-4204-8a15-4fcd7d9754a2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:47.825608 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1148/2306] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:53:47 2022] POST /identity/v3/users => generated 284 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:53:47.829509 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e134e9f-033c-4204-8a15-4fcd7d9754a2 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:47.838689 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e134e9f-033c-4204-8a15-4fcd7d9754a2 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:47.843361 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5323653-88ef-4897-9dd8-a096f9520d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:47.843990 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5323653-88ef-4897-9dd8-a096f9520d3f admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.844264 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5323653-88ef-4897-9dd8-a096f9520d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.844537 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5323653-88ef-4897-9dd8-a096f9520d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.845471 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5323653-88ef-4897-9dd8-a096f9520d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:47.847040 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5323653-88ef-4897-9dd8-a096f9520d3f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:47.853733 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804103ca-045e-4d52-91d4-f90c47142282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:47.855085 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804103ca-045e-4d52-91d4-f90c47142282 service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:47.856795 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1149/2307] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:53:47.860717 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5323653-88ef-4897-9dd8-a096f9520d3f admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:47.867210 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1159/2308] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:53:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:53:47.870307 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5323653-88ef-4897-9dd8-a096f9520d3f admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:47.875463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7f0f7-8adf-4bcd-9165-625c5ee17225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:47.876093 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7f0f7-8adf-4bcd-9165-625c5ee17225 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.876367 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7f0f7-8adf-4bcd-9165-625c5ee17225 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.876640 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7f0f7-8adf-4bcd-9165-625c5ee17225 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.877398 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7f0f7-8adf-4bcd-9165-625c5ee17225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:47.878954 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7f0f7-8adf-4bcd-9165-625c5ee17225 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:47.890030 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1150/2309] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:53:47.894241 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804103ca-045e-4d52-91d4-f90c47142282 service cinder] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:47.905115 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804103ca-045e-4d52-91d4-f90c47142282 service cinder] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:47.910403 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c185fe2-7390-44ea-bff1-5b5a0f1166fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:47.911312 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c185fe2-7390-44ea-bff1-5b5a0f1166fe admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.911586 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c185fe2-7390-44ea-bff1-5b5a0f1166fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.911856 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c185fe2-7390-44ea-bff1-5b5a0f1166fe admin admin] PATH_INFO: `/v3/projects/3830234aa02046d38db010b20e3c2db8/users/c9d47fc3ce0c4746810f260164c307f3/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.926333 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c185fe2-7390-44ea-bff1-5b5a0f1166fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3830234aa02046d38db010b20e3c2db8, user_id=c9d47fc3ce0c4746810f260164c307f3, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:47.928986 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c185fe2-7390-44ea-bff1-5b5a0f1166fe admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:47.942691 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1160/2310] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:53:47 2022] PUT /identity/v3/projects/3830234aa02046d38db010b20e3c2db8/users/c9d47fc3ce0c4746810f260164c307f3/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:47.953387 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcd4a8-c305-44f5-9feb-703cd0b1a23b None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:47.953796 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcd4a8-c305-44f5-9feb-703cd0b1a23b None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:47.954182 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcd4a8-c305-44f5-9feb-703cd0b1a23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:47.980760 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-82dcd4a8-c305-44f5-9feb-703cd0b1a23b None None] MFA Rules not processed for user `c9d47fc3ce0c4746810f260164c307f3`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:47.982328 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-82dcd4a8-c305-44f5-9feb-703cd0b1a23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:48.048424 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1151/2311] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:48.058675 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c185fe2-7390-44ea-bff1-5b5a0f1166fe admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:48.060633 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-4c185fe2-7390-44ea-bff1-5b5a0f1166fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:48.135646 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c185fe2-7390-44ea-bff1-5b5a0f1166fe admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:48.139694 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09181e-b245-42c8-9eb1-f8877ee7d1c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:48.140438 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09181e-b245-42c8-9eb1-f8877ee7d1c6 service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:48.140948 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09181e-b245-42c8-9eb1-f8877ee7d1c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:48.141319 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09181e-b245-42c8-9eb1-f8877ee7d1c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:48.157727 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09181e-b245-42c8-9eb1-f8877ee7d1c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:48.159208 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09181e-b245-42c8-9eb1-f8877ee7d1c6 service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:48.168277 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1161/2312] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:53:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:53:50.858645 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcd4a8-c305-44f5-9feb-703cd0b1a23b None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:50.921215 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcd4a8-c305-44f5-9feb-703cd0b1a23b None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:50.926894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b8cf8-89ef-4fac-ac43-c3cd631dd4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:50.927769 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b8cf8-89ef-4fac-ac43-c3cd631dd4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:50.928044 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b8cf8-89ef-4fac-ac43-c3cd631dd4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:50.928412 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b8cf8-89ef-4fac-ac43-c3cd631dd4ce admin admin] PATH_INFO: `/v3/users/224e3fb5b8f54a97ad60d7a7f9b2b20e` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:50.931993 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b8cf8-89ef-4fac-ac43-c3cd631dd4ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=224e3fb5b8f54a97ad60d7a7f9b2b20e)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:50.934486 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b8cf8-89ef-4fac-ac43-c3cd631dd4ce admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:50.980318 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-3f5b8cf8-89ef-4fac-ac43-c3cd631dd4ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '224e3fb5b8f54a97ad60d7a7f9b2b20e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:50.991669 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-3f5b8cf8-89ef-4fac-ac43-c3cd631dd4ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '224e3fb5b8f54a97ad60d7a7f9b2b20e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:50.998644 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-3f5b8cf8-89ef-4fac-ac43-c3cd631dd4ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '224e3fb5b8f54a97ad60d7a7f9b2b20e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:51.007093 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-3f5b8cf8-89ef-4fac-ac43-c3cd631dd4ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '224e3fb5b8f54a97ad60d7a7f9b2b20e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:51.007694 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-3f5b8cf8-89ef-4fac-ac43-c3cd631dd4ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '224e3fb5b8f54a97ad60d7a7f9b2b20e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:51.015674 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1152/2313] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:53:50 2022] DELETE /identity/v3/users/224e3fb5b8f54a97ad60d7a7f9b2b20e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:51.020398 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b1f86-bf48-4402-bec2-1c4f6791af04 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:51.020911 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b1f86-bf48-4402-bec2-1c4f6791af04 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:51.021008 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b1f86-bf48-4402-bec2-1c4f6791af04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:51.039879 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-9f2b1f86-bf48-4402-bec2-1c4f6791af04 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:51.041204 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-9f2b1f86-bf48-4402-bec2-1c4f6791af04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:51.100989 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1162/2314] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:53:51.110861 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b8cf8-89ef-4fac-ac43-c3cd631dd4ce admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:51.112390 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-3f5b8cf8-89ef-4fac-ac43-c3cd631dd4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:51.175644 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b8cf8-89ef-4fac-ac43-c3cd631dd4ce admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:51.185125 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121f4a0-69ea-4c1a-a69a-c6fe10a7122c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:51.185782 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121f4a0-69ea-4c1a-a69a-c6fe10a7122c service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:51.186063 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121f4a0-69ea-4c1a-a69a-c6fe10a7122c service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:51.186367 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121f4a0-69ea-4c1a-a69a-c6fe10a7122c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:51.196039 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121f4a0-69ea-4c1a-a69a-c6fe10a7122c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:51.197575 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121f4a0-69ea-4c1a-a69a-c6fe10a7122c service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:51.208200 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1153/2315] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:53:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:53:51.474397 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b1f86-bf48-4402-bec2-1c4f6791af04 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:51.476081 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-9f2b1f86-bf48-4402-bec2-1c4f6791af04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:51.490275 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b1f86-bf48-4402-bec2-1c4f6791af04 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:51.496137 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94581fae-7874-4676-acb6-e57d45688999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:51.497133 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94581fae-7874-4676-acb6-e57d45688999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:51.497506 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94581fae-7874-4676-acb6-e57d45688999 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:51.497707 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94581fae-7874-4676-acb6-e57d45688999 admin admin] PATH_INFO: `/v3/projects/be466e869901467683289109990fb4d1` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:51.498944 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94581fae-7874-4676-acb6-e57d45688999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be466e869901467683289109990fb4d1)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:51.500897 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94581fae-7874-4676-acb6-e57d45688999 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:51.552119 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-94581fae-7874-4676-acb6-e57d45688999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be466e869901467683289109990fb4d1', 'request_id': 'req-94581fae-7874-4676-acb6-e57d45688999'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:51.558927 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-94581fae-7874-4676-acb6-e57d45688999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be466e869901467683289109990fb4d1', 'request_id': 'req-94581fae-7874-4676-acb6-e57d45688999'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:51.567383 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-94581fae-7874-4676-acb6-e57d45688999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be466e869901467683289109990fb4d1', 'request_id': 'req-94581fae-7874-4676-acb6-e57d45688999'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:51.578908 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-94581fae-7874-4676-acb6-e57d45688999 admin admin] The token cache is being invalidate because project be466e869901467683289109990fb4d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:53:51.579199 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-94581fae-7874-4676-acb6-e57d45688999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:51.580005 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-94581fae-7874-4676-acb6-e57d45688999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:51.581792 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1163/2316] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:53:51 2022] DELETE /identity/v3/projects/be466e869901467683289109990fb4d1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:51.588480 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9b607-6bb7-41fb-b9a5-337da4144319 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:51.588775 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9b607-6bb7-41fb-b9a5-337da4144319 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:51.589093 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9b607-6bb7-41fb-b9a5-337da4144319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:51.608001 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-5dd9b607-6bb7-41fb-b9a5-337da4144319 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:51.609210 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-5dd9b607-6bb7-41fb-b9a5-337da4144319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:51.669290 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1154/2317] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:51.677121 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3278db-06a5-4220-aaab-4e3fdfde8229 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:51.677407 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3278db-06a5-4220-aaab-4e3fdfde8229 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:51.677682 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3278db-06a5-4220-aaab-4e3fdfde8229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:51.696859 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-0d3278db-06a5-4220-aaab-4e3fdfde8229 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:51.698064 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-0d3278db-06a5-4220-aaab-4e3fdfde8229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:51.706410 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1164/2318] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:51.710683 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9b607-6bb7-41fb-b9a5-337da4144319 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:51.720510 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9b607-6bb7-41fb-b9a5-337da4144319 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:51.725404 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b08ae-abf9-4bb3-b55f-5231c24b949b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:51.726061 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b08ae-abf9-4bb3-b55f-5231c24b949b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:51.726346 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b08ae-abf9-4bb3-b55f-5231c24b949b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:51.726617 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b08ae-abf9-4bb3-b55f-5231c24b949b admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:51.727360 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b08ae-abf9-4bb3-b55f-5231c24b949b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:53:51.727666 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b08ae-abf9-4bb3-b55f-5231c24b949b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:51.729299 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b08ae-abf9-4bb3-b55f-5231c24b949b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:51.741067 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1155/2319] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:53:51.745583 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3278db-06a5-4220-aaab-4e3fdfde8229 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:51.755556 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3278db-06a5-4220-aaab-4e3fdfde8229 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:51.761477 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92e6b1-ea8c-408e-b751-8173d2251d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:51.762128 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92e6b1-ea8c-408e-b751-8173d2251d37 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:51.762406 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92e6b1-ea8c-408e-b751-8173d2251d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:51.762692 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92e6b1-ea8c-408e-b751-8173d2251d37 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:51.763376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92e6b1-ea8c-408e-b751-8173d2251d37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:51.765392 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92e6b1-ea8c-408e-b751-8173d2251d37 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:51.792589 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1165/2320] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:53:51 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:53:51.796800 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b08ae-abf9-4bb3-b55f-5231c24b949b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:51.807077 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b08ae-abf9-4bb3-b55f-5231c24b949b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:51.876801 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782a10f-0da0-41f7-8470-308e57a05db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:51.877469 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782a10f-0da0-41f7-8470-308e57a05db5 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:51.877757 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782a10f-0da0-41f7-8470-308e57a05db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:51.878028 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782a10f-0da0-41f7-8470-308e57a05db5 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:51.878728 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782a10f-0da0-41f7-8470-308e57a05db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:51.880656 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782a10f-0da0-41f7-8470-308e57a05db5 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:51.902130 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1156/2321] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:53:51 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:53:51.906395 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92e6b1-ea8c-408e-b751-8173d2251d37 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:51.917141 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92e6b1-ea8c-408e-b751-8173d2251d37 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:51.922781 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861a623-e587-42d1-89cb-653c9e273db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:51.923436 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861a623-e587-42d1-89cb-653c9e273db8 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:51.923716 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861a623-e587-42d1-89cb-653c9e273db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:51.923990 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861a623-e587-42d1-89cb-653c9e273db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:51.924722 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861a623-e587-42d1-89cb-653c9e273db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:51.926358 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861a623-e587-42d1-89cb-653c9e273db8 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:51.937037 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1166/2322] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:53:51.941194 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782a10f-0da0-41f7-8470-308e57a05db5 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:51.951990 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782a10f-0da0-41f7-8470-308e57a05db5 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:51.957369 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ad7c4-1e5b-4923-9850-cc9648ca4466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:51.958008 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ad7c4-1e5b-4923-9850-cc9648ca4466 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:51.958324 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ad7c4-1e5b-4923-9850-cc9648ca4466 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:51.958548 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ad7c4-1e5b-4923-9850-cc9648ca4466 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:51.959313 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ad7c4-1e5b-4923-9850-cc9648ca4466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:51.960965 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ad7c4-1e5b-4923-9850-cc9648ca4466 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:51.970780 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1157/2323] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:53:51.975252 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861a623-e587-42d1-89cb-653c9e273db8 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:51.988443 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861a623-e587-42d1-89cb-653c9e273db8 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:51.994246 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a9dd5-082b-4f46-b6c9-85b29b750fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:51.995114 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a9dd5-082b-4f46-b6c9-85b29b750fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:51.995399 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a9dd5-082b-4f46-b6c9-85b29b750fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:51.995668 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a9dd5-082b-4f46-b6c9-85b29b750fd1 admin admin] PATH_INFO: `/v3/projects/537a5cec9a00415e851bc08d92cab8c1/users/fc1a79750b374ca692542af5b2e72bd6/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:52.011129 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a9dd5-082b-4f46-b6c9-85b29b750fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=537a5cec9a00415e851bc08d92cab8c1, user_id=fc1a79750b374ca692542af5b2e72bd6, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:52.013849 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a9dd5-082b-4f46-b6c9-85b29b750fd1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:52.029593 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1167/2324] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:53:51 2022] PUT /identity/v3/projects/537a5cec9a00415e851bc08d92cab8c1/users/fc1a79750b374ca692542af5b2e72bd6/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:52.044798 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2d5dd-4154-4007-85d6-cd3b8805315a None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:52.045182 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2d5dd-4154-4007-85d6-cd3b8805315a None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:52.045561 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2d5dd-4154-4007-85d6-cd3b8805315a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:52.071755 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-bba2d5dd-4154-4007-85d6-cd3b8805315a None None] MFA Rules not processed for user `fc1a79750b374ca692542af5b2e72bd6`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:52.072885 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-bba2d5dd-4154-4007-85d6-cd3b8805315a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:52.136804 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1158/2325] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:52.142105 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a9dd5-082b-4f46-b6c9-85b29b750fd1 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:52.211661 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a9dd5-082b-4f46-b6c9-85b29b750fd1 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:52.217110 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918f2c2-2616-4492-89a0-6e3df6cfea3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:52.217876 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918f2c2-2616-4492-89a0-6e3df6cfea3b admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:52.218156 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918f2c2-2616-4492-89a0-6e3df6cfea3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:52.218419 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918f2c2-2616-4492-89a0-6e3df6cfea3b admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:52.219105 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918f2c2-2616-4492-89a0-6e3df6cfea3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:52.221014 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918f2c2-2616-4492-89a0-6e3df6cfea3b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:52.249403 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1168/2326] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:53:52 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:53:52.253409 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2d5dd-4154-4007-85d6-cd3b8805315a None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:52.264555 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2d5dd-4154-4007-85d6-cd3b8805315a None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:52.319250 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90567a10-2f91-44ea-85d2-21f001a425ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:52.319930 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90567a10-2f91-44ea-85d2-21f001a425ed admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:52.320213 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90567a10-2f91-44ea-85d2-21f001a425ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:52.320490 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90567a10-2f91-44ea-85d2-21f001a425ed admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:52.321276 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90567a10-2f91-44ea-85d2-21f001a425ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:52.323290 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90567a10-2f91-44ea-85d2-21f001a425ed admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:52.343381 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1159/2327] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:53:52 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:53:52.347428 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918f2c2-2616-4492-89a0-6e3df6cfea3b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:52.358285 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918f2c2-2616-4492-89a0-6e3df6cfea3b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:52.362938 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402f2f0-6472-4db2-8cc3-374ea10e7838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:52.363749 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402f2f0-6472-4db2-8cc3-374ea10e7838 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:52.363957 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402f2f0-6472-4db2-8cc3-374ea10e7838 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:52.364173 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402f2f0-6472-4db2-8cc3-374ea10e7838 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:52.364963 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402f2f0-6472-4db2-8cc3-374ea10e7838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:52.366549 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402f2f0-6472-4db2-8cc3-374ea10e7838 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:52.380140 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1169/2328] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:53:52.382023 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90567a10-2f91-44ea-85d2-21f001a425ed admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:52.391845 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90567a10-2f91-44ea-85d2-21f001a425ed admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:52.396296 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d43383-85d5-41c4-aadb-cfd8ad758e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:52.396970 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d43383-85d5-41c4-aadb-cfd8ad758e37 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:52.397258 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d43383-85d5-41c4-aadb-cfd8ad758e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:52.397533 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d43383-85d5-41c4-aadb-cfd8ad758e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:52.398252 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d43383-85d5-41c4-aadb-cfd8ad758e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:52.400177 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d43383-85d5-41c4-aadb-cfd8ad758e37 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:52.410103 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1160/2329] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:53:52.414205 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402f2f0-6472-4db2-8cc3-374ea10e7838 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:52.423850 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402f2f0-6472-4db2-8cc3-374ea10e7838 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:52.428550 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779d798-20bd-4feb-ae0a-a10740167d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:52.429448 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779d798-20bd-4feb-ae0a-a10740167d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:52.429722 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779d798-20bd-4feb-ae0a-a10740167d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:52.429969 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779d798-20bd-4feb-ae0a-a10740167d40 admin admin] PATH_INFO: `/v3/projects/d4d474d26912491ca8e55eb2e518a654/users/8845eb1133df4cc78d3afc313650306a/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:52.444505 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779d798-20bd-4feb-ae0a-a10740167d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d474d26912491ca8e55eb2e518a654, user_id=8845eb1133df4cc78d3afc313650306a, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:52.447196 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779d798-20bd-4feb-ae0a-a10740167d40 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:52.462712 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1170/2330] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:53:52 2022] PUT /identity/v3/projects/d4d474d26912491ca8e55eb2e518a654/users/8845eb1133df4cc78d3afc313650306a/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:52.474264 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4113745-9dfb-4057-838a-dcd7afca2b33 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:52.474546 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4113745-9dfb-4057-838a-dcd7afca2b33 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:52.474847 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4113745-9dfb-4057-838a-dcd7afca2b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:52.504448 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b4113745-9dfb-4057-838a-dcd7afca2b33 None None] MFA Rules not processed for user `8845eb1133df4cc78d3afc313650306a`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:52.505678 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b4113745-9dfb-4057-838a-dcd7afca2b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:52.569223 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1161/2331] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:52.573815 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779d798-20bd-4feb-ae0a-a10740167d40 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:52.634671 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779d798-20bd-4feb-ae0a-a10740167d40 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:52.640683 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c5630-7bbb-42a7-a2e2-31d039cad9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:52.641576 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c5630-7bbb-42a7-a2e2-31d039cad9fd admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:52.641704 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c5630-7bbb-42a7-a2e2-31d039cad9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:52.641978 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c5630-7bbb-42a7-a2e2-31d039cad9fd admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:52.642715 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c5630-7bbb-42a7-a2e2-31d039cad9fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:52.644671 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c5630-7bbb-42a7-a2e2-31d039cad9fd admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:52.676785 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1171/2332] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:53:52 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:53:52.680923 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4113745-9dfb-4057-838a-dcd7afca2b33 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:52.691705 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4113745-9dfb-4057-838a-dcd7afca2b33 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:52.745455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a287ff1-d346-4d15-b69e-a0e3440d410d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:52.746137 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a287ff1-d346-4d15-b69e-a0e3440d410d admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:52.746421 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a287ff1-d346-4d15-b69e-a0e3440d410d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:52.746694 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a287ff1-d346-4d15-b69e-a0e3440d410d admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:52.747414 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a287ff1-d346-4d15-b69e-a0e3440d410d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:52.749395 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a287ff1-d346-4d15-b69e-a0e3440d410d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:52.774333 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1162/2333] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:53:52 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:53:52.775649 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c5630-7bbb-42a7-a2e2-31d039cad9fd admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:52.786088 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c5630-7bbb-42a7-a2e2-31d039cad9fd admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:52.791342 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc8c96-ed56-4f3f-a61f-13317a4f7c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:52.791992 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc8c96-ed56-4f3f-a61f-13317a4f7c48 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:52.792322 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc8c96-ed56-4f3f-a61f-13317a4f7c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:52.792592 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc8c96-ed56-4f3f-a61f-13317a4f7c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:52.793370 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc8c96-ed56-4f3f-a61f-13317a4f7c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:52.794947 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc8c96-ed56-4f3f-a61f-13317a4f7c48 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:52.806052 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1172/2334] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:53:52.810147 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a287ff1-d346-4d15-b69e-a0e3440d410d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:52.820013 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a287ff1-d346-4d15-b69e-a0e3440d410d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:52.824703 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266870f-1471-41de-bac5-f249fe30379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:52.825559 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266870f-1471-41de-bac5-f249fe30379d admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:52.825835 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266870f-1471-41de-bac5-f249fe30379d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:52.826105 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266870f-1471-41de-bac5-f249fe30379d admin admin] PATH_INFO: `/v3/projects/1ecc4ab6ecb249aba2262c1414acfd1e/users/0147f64ad1b34f71bccbfaf5cd306cc2/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:52.841161 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266870f-1471-41de-bac5-f249fe30379d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ecc4ab6ecb249aba2262c1414acfd1e, user_id=0147f64ad1b34f71bccbfaf5cd306cc2, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:52.843963 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266870f-1471-41de-bac5-f249fe30379d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:52.858472 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1163/2335] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:53:52 2022] PUT /identity/v3/projects/1ecc4ab6ecb249aba2262c1414acfd1e/users/0147f64ad1b34f71bccbfaf5cd306cc2/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:52.864439 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc8c96-ed56-4f3f-a61f-13317a4f7c48 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:52.874553 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc8c96-ed56-4f3f-a61f-13317a4f7c48 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:52.937692 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8903851-5e92-420f-950c-0d6b90c0106d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:52.938395 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8903851-5e92-420f-950c-0d6b90c0106d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:52.938674 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8903851-5e92-420f-950c-0d6b90c0106d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:52.939006 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8903851-5e92-420f-950c-0d6b90c0106d admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:52.939757 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8903851-5e92-420f-950c-0d6b90c0106d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:52.941425 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8903851-5e92-420f-950c-0d6b90c0106d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:52.952986 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1173/2336] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:53:52.957433 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266870f-1471-41de-bac5-f249fe30379d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:52.969177 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266870f-1471-41de-bac5-f249fe30379d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:52.974359 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da64e0c-2f3b-4c0c-b2b8-9d0a6e46dd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:52.975295 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da64e0c-2f3b-4c0c-b2b8-9d0a6e46dd20 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:52.975574 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da64e0c-2f3b-4c0c-b2b8-9d0a6e46dd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:52.975843 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da64e0c-2f3b-4c0c-b2b8-9d0a6e46dd20 admin admin] PATH_INFO: `/v3/projects/1ecc4ab6ecb249aba2262c1414acfd1e/users/0147f64ad1b34f71bccbfaf5cd306cc2/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:52.978005 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da64e0c-2f3b-4c0c-b2b8-9d0a6e46dd20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ecc4ab6ecb249aba2262c1414acfd1e, user_id=0147f64ad1b34f71bccbfaf5cd306cc2, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:52.980704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da64e0c-2f3b-4c0c-b2b8-9d0a6e46dd20 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:52.992766 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1164/2337] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:53:52 2022] PUT /identity/v3/projects/1ecc4ab6ecb249aba2262c1414acfd1e/users/0147f64ad1b34f71bccbfaf5cd306cc2/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:53.003278 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee18e3-4c32-41c4-b35e-3b1ab0513ddc None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:53.003564 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee18e3-4c32-41c4-b35e-3b1ab0513ddc None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:53.003834 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee18e3-4c32-41c4-b35e-3b1ab0513ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:53.033513 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-8bee18e3-4c32-41c4-b35e-3b1ab0513ddc None None] MFA Rules not processed for user `0147f64ad1b34f71bccbfaf5cd306cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:53.034675 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-8bee18e3-4c32-41c4-b35e-3b1ab0513ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:53.102735 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1174/2338] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:53.113323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da64e0c-2f3b-4c0c-b2b8-9d0a6e46dd20 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:53.115383 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-0da64e0c-2f3b-4c0c-b2b8-9d0a6e46dd20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:53.169452 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da64e0c-2f3b-4c0c-b2b8-9d0a6e46dd20 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:53.173210 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04baadd-9ce1-4b3f-bc8e-c6dcbdf104f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:53.173851 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04baadd-9ce1-4b3f-bc8e-c6dcbdf104f2 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:53.174168 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04baadd-9ce1-4b3f-bc8e-c6dcbdf104f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:53.174438 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04baadd-9ce1-4b3f-bc8e-c6dcbdf104f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:53.230683 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04baadd-9ce1-4b3f-bc8e-c6dcbdf104f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:53.232235 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04baadd-9ce1-4b3f-bc8e-c6dcbdf104f2 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:53.241802 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1165/2339] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:53:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:53:54.729793 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee18e3-4c32-41c4-b35e-3b1ab0513ddc None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:54.741382 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee18e3-4c32-41c4-b35e-3b1ab0513ddc None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:54.745698 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7ddcc-bbe0-4b75-b876-39a960a815e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:54.746339 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7ddcc-bbe0-4b75-b876-39a960a815e7 service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:54.746613 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7ddcc-bbe0-4b75-b876-39a960a815e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:54.746877 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7ddcc-bbe0-4b75-b876-39a960a815e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:54.806824 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7ddcc-bbe0-4b75-b876-39a960a815e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:54.808190 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7ddcc-bbe0-4b75-b876-39a960a815e7 service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:54.817520 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1175/2340] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:53:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:53:55.332986 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04baadd-9ce1-4b3f-bc8e-c6dcbdf104f2 service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:55.341573 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04baadd-9ce1-4b3f-bc8e-c6dcbdf104f2 service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:55.346190 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2242ab6-0c23-40c1-a058-83950fb0ae31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:55.346825 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2242ab6-0c23-40c1-a058-83950fb0ae31 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:55.347102 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2242ab6-0c23-40c1-a058-83950fb0ae31 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:55.347372 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2242ab6-0c23-40c1-a058-83950fb0ae31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:55.356829 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2242ab6-0c23-40c1-a058-83950fb0ae31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:55.358319 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2242ab6-0c23-40c1-a058-83950fb0ae31 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:55.367861 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1166/2341] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:53:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:53:56.566857 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7ddcc-bbe0-4b75-b876-39a960a815e7 service cinder] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:56.568408 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-39d7ddcc-bbe0-4b75-b876-39a960a815e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:56.634273 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7ddcc-bbe0-4b75-b876-39a960a815e7 service cinder] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:56.638898 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6048e-ce5b-4a7d-9dbb-7cf434db65b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:56.639793 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6048e-ce5b-4a7d-9dbb-7cf434db65b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:56.640069 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6048e-ce5b-4a7d-9dbb-7cf434db65b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:56.640364 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6048e-ce5b-4a7d-9dbb-7cf434db65b7 admin admin] PATH_INFO: `/v3/users/c9d47fc3ce0c4746810f260164c307f3` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:56.641592 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6048e-ce5b-4a7d-9dbb-7cf434db65b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d47fc3ce0c4746810f260164c307f3)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:56.643889 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6048e-ce5b-4a7d-9dbb-7cf434db65b7 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:56.692272 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-add6048e-ce5b-4a7d-9dbb-7cf434db65b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d47fc3ce0c4746810f260164c307f3'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:56.693291 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-add6048e-ce5b-4a7d-9dbb-7cf434db65b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d47fc3ce0c4746810f260164c307f3'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:56.694063 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-add6048e-ce5b-4a7d-9dbb-7cf434db65b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d47fc3ce0c4746810f260164c307f3'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:56.707231 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-add6048e-ce5b-4a7d-9dbb-7cf434db65b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d47fc3ce0c4746810f260164c307f3'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:56.715529 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-add6048e-ce5b-4a7d-9dbb-7cf434db65b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d47fc3ce0c4746810f260164c307f3'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:56.732944 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1176/2342] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:53:56 2022] DELETE /identity/v3/users/c9d47fc3ce0c4746810f260164c307f3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:56.737631 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9757d3-e100-4d96-86e1-43098e13ddc4 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:56.738683 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9757d3-e100-4d96-86e1-43098e13ddc4 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:56.739657 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9757d3-e100-4d96-86e1-43098e13ddc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:56.760448 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-bc9757d3-e100-4d96-86e1-43098e13ddc4 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:56.761678 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-bc9757d3-e100-4d96-86e1-43098e13ddc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:56.818761 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1167/2343] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:56.828625 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6048e-ce5b-4a7d-9dbb-7cf434db65b7 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:56.830138 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-add6048e-ce5b-4a7d-9dbb-7cf434db65b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:56.893967 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6048e-ce5b-4a7d-9dbb-7cf434db65b7 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:56.898905 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec4dbe-3faf-4ab6-bfc7-83f1296c950c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:56.899558 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4dbe-3faf-4ab6-bfc7-83f1296c950c service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:56.899834 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4dbe-3faf-4ab6-bfc7-83f1296c950c service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:56.900113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4dbe-3faf-4ab6-bfc7-83f1296c950c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:56.909519 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec4dbe-3faf-4ab6-bfc7-83f1296c950c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:56.910947 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec4dbe-3faf-4ab6-bfc7-83f1296c950c service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:56.920329 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1177/2344] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:53:57.175711 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9757d3-e100-4d96-86e1-43098e13ddc4 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:57.177321 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-bc9757d3-e100-4d96-86e1-43098e13ddc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:57.190141 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9757d3-e100-4d96-86e1-43098e13ddc4 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:57.195294 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda71c7-33bc-4747-8b1e-b5baa8924f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:57.196204 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda71c7-33bc-4747-8b1e-b5baa8924f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:57.196485 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda71c7-33bc-4747-8b1e-b5baa8924f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:57.196751 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda71c7-33bc-4747-8b1e-b5baa8924f45 admin admin] PATH_INFO: `/v3/projects/3830234aa02046d38db010b20e3c2db8` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:57.198603 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda71c7-33bc-4747-8b1e-b5baa8924f45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3830234aa02046d38db010b20e3c2db8)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:57.200742 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda71c7-33bc-4747-8b1e-b5baa8924f45 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:57.250034 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-ecda71c7-33bc-4747-8b1e-b5baa8924f45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3830234aa02046d38db010b20e3c2db8', 'request_id': 'req-ecda71c7-33bc-4747-8b1e-b5baa8924f45'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:57.256252 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-ecda71c7-33bc-4747-8b1e-b5baa8924f45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3830234aa02046d38db010b20e3c2db8', 'request_id': 'req-ecda71c7-33bc-4747-8b1e-b5baa8924f45'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:57.265148 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-ecda71c7-33bc-4747-8b1e-b5baa8924f45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3830234aa02046d38db010b20e3c2db8', 'request_id': 'req-ecda71c7-33bc-4747-8b1e-b5baa8924f45'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:57.275871 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-ecda71c7-33bc-4747-8b1e-b5baa8924f45 admin admin] The token cache is being invalidate because project 3830234aa02046d38db010b20e3c2db8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:53:57.276176 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-ecda71c7-33bc-4747-8b1e-b5baa8924f45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:57.276830 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-ecda71c7-33bc-4747-8b1e-b5baa8924f45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:57.278469 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1168/2345] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:53:57 2022] DELETE /identity/v3/projects/3830234aa02046d38db010b20e3c2db8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:57.284137 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc05027-d3dc-49d9-9da0-a4e9017be6e2 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:57.284423 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc05027-d3dc-49d9-9da0-a4e9017be6e2 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:57.284698 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc05027-d3dc-49d9-9da0-a4e9017be6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:57.302558 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-0cc05027-d3dc-49d9-9da0-a4e9017be6e2 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:57.303742 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-0cc05027-d3dc-49d9-9da0-a4e9017be6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:57.370888 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1178/2346] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:57.378954 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0477c1-ade1-485b-882d-7f7dbc51cc62 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:57.379248 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0477c1-ade1-485b-882d-7f7dbc51cc62 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:57.379527 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0477c1-ade1-485b-882d-7f7dbc51cc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:57.398942 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-3d0477c1-ade1-485b-882d-7f7dbc51cc62 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:57.400153 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-3d0477c1-ade1-485b-882d-7f7dbc51cc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:57.409424 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1169/2347] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:57.413602 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc05027-d3dc-49d9-9da0-a4e9017be6e2 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:57.423474 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc05027-d3dc-49d9-9da0-a4e9017be6e2 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:57.428996 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e309cff-c32d-42a6-9ece-a01cb5f85c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:57.429638 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e309cff-c32d-42a6-9ece-a01cb5f85c4a admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:57.429917 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e309cff-c32d-42a6-9ece-a01cb5f85c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:57.430192 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e309cff-c32d-42a6-9ece-a01cb5f85c4a admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:57.430922 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e309cff-c32d-42a6-9ece-a01cb5f85c4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:53:57.431225 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e309cff-c32d-42a6-9ece-a01cb5f85c4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:57.432829 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e309cff-c32d-42a6-9ece-a01cb5f85c4a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:57.444497 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1179/2348] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:53:57.448667 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0477c1-ade1-485b-882d-7f7dbc51cc62 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:57.457855 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0477c1-ade1-485b-882d-7f7dbc51cc62 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:57.463633 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3165682-f7d3-475d-833e-03a3edb62c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:57.464287 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3165682-f7d3-475d-833e-03a3edb62c2f admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:57.464566 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3165682-f7d3-475d-833e-03a3edb62c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:57.464840 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3165682-f7d3-475d-833e-03a3edb62c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:57.465590 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3165682-f7d3-475d-833e-03a3edb62c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:57.467609 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3165682-f7d3-475d-833e-03a3edb62c2f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:57.496765 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1170/2349] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:53:57 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:53:57.501003 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e309cff-c32d-42a6-9ece-a01cb5f85c4a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:57.511347 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e309cff-c32d-42a6-9ece-a01cb5f85c4a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:57.568474 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438258c-4118-4e59-8419-5ad8b7cf3467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:57.569207 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438258c-4118-4e59-8419-5ad8b7cf3467 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:57.569436 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438258c-4118-4e59-8419-5ad8b7cf3467 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:57.569705 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438258c-4118-4e59-8419-5ad8b7cf3467 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:57.570402 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438258c-4118-4e59-8419-5ad8b7cf3467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:57.572315 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438258c-4118-4e59-8419-5ad8b7cf3467 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:57.594102 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1180/2350] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:53:57 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:53:57.598449 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3165682-f7d3-475d-833e-03a3edb62c2f admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:57.609131 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3165682-f7d3-475d-833e-03a3edb62c2f admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:57.614681 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ee97e-4ea0-4048-bd4e-1272b651fe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:57.615331 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ee97e-4ea0-4048-bd4e-1272b651fe81 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:57.615616 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ee97e-4ea0-4048-bd4e-1272b651fe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:57.615912 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ee97e-4ea0-4048-bd4e-1272b651fe81 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:57.616645 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ee97e-4ea0-4048-bd4e-1272b651fe81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:57.618292 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ee97e-4ea0-4048-bd4e-1272b651fe81 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:57.628592 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1171/2351] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:53:57.632518 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438258c-4118-4e59-8419-5ad8b7cf3467 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:57.642444 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438258c-4118-4e59-8419-5ad8b7cf3467 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:57.647672 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882e670-edfd-425d-9a1d-c8502bab34b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:57.648343 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882e670-edfd-425d-9a1d-c8502bab34b5 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:57.648968 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882e670-edfd-425d-9a1d-c8502bab34b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:57.649237 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882e670-edfd-425d-9a1d-c8502bab34b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:57.650008 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882e670-edfd-425d-9a1d-c8502bab34b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:57.651590 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882e670-edfd-425d-9a1d-c8502bab34b5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:57.661640 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1181/2352] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:53:57.665637 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ee97e-4ea0-4048-bd4e-1272b651fe81 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:57.675275 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ee97e-4ea0-4048-bd4e-1272b651fe81 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:57.680102 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3ae52-d8ac-45ba-ac37-36ec09cb4cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:57.681003 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3ae52-d8ac-45ba-ac37-36ec09cb4cda admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:57.681279 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3ae52-d8ac-45ba-ac37-36ec09cb4cda admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:57.681548 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3ae52-d8ac-45ba-ac37-36ec09cb4cda admin admin] PATH_INFO: `/v3/projects/1cb1695e508445eea7d4808cf4eec9ed/users/381a573ceab1441fa1560a300e17c868/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:57.695567 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3ae52-d8ac-45ba-ac37-36ec09cb4cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb1695e508445eea7d4808cf4eec9ed, user_id=381a573ceab1441fa1560a300e17c868, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:57.698236 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3ae52-d8ac-45ba-ac37-36ec09cb4cda admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:57.714247 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1172/2353] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:53:57 2022] PUT /identity/v3/projects/1cb1695e508445eea7d4808cf4eec9ed/users/381a573ceab1441fa1560a300e17c868/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:53:57.725662 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c0e05-7bf8-41e9-afe6-dc40b3fa4490 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:57.725948 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c0e05-7bf8-41e9-afe6-dc40b3fa4490 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:57.726225 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c0e05-7bf8-41e9-afe6-dc40b3fa4490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:57.753295 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-557c0e05-7bf8-41e9-afe6-dc40b3fa4490 None None] MFA Rules not processed for user `381a573ceab1441fa1560a300e17c868`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:57.754498 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-557c0e05-7bf8-41e9-afe6-dc40b3fa4490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:57.823309 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1182/2354] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:57.828208 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3ae52-d8ac-45ba-ac37-36ec09cb4cda admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:57.890900 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3ae52-d8ac-45ba-ac37-36ec09cb4cda admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:57.895655 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435c40c-af0d-43cd-938d-688d7a35fcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:57.896313 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435c40c-af0d-43cd-938d-688d7a35fcf8 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:57.896593 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435c40c-af0d-43cd-938d-688d7a35fcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:57.896878 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435c40c-af0d-43cd-938d-688d7a35fcf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:57.897603 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435c40c-af0d-43cd-938d-688d7a35fcf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:57.899849 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435c40c-af0d-43cd-938d-688d7a35fcf8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:57.928884 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1173/2355] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:53:57 2022] POST /identity/v3/projects => generated 403 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:53:57.930714 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c0e05-7bf8-41e9-afe6-dc40b3fa4490 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:57.941349 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c0e05-7bf8-41e9-afe6-dc40b3fa4490 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:58.001073 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98acf9-1b7b-4446-a328-f6b957a1c525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:58.001778 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98acf9-1b7b-4446-a328-f6b957a1c525 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:58.002058 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98acf9-1b7b-4446-a328-f6b957a1c525 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:58.002362 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98acf9-1b7b-4446-a328-f6b957a1c525 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:58.003058 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98acf9-1b7b-4446-a328-f6b957a1c525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:58.004974 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98acf9-1b7b-4446-a328-f6b957a1c525 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:58.028466 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1183/2356] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:53:57 2022] POST /identity/v3/users => generated 308 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:53:58.029686 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435c40c-af0d-43cd-938d-688d7a35fcf8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:58.040343 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435c40c-af0d-43cd-938d-688d7a35fcf8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:58.045962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5431f-e0f2-4fcb-bde4-201150444ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:58.046639 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5431f-e0f2-4fcb-bde4-201150444ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:58.046993 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5431f-e0f2-4fcb-bde4-201150444ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:58.047379 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5431f-e0f2-4fcb-bde4-201150444ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:58.048193 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5431f-e0f2-4fcb-bde4-201150444ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:58.049890 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5431f-e0f2-4fcb-bde4-201150444ef3 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:58.069489 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1174/2357] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:53:58.070663 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98acf9-1b7b-4446-a328-f6b957a1c525 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:58.081756 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98acf9-1b7b-4446-a328-f6b957a1c525 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:58.086481 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660cbb7-d7b1-41d2-b76c-23a913ef85f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:58.087368 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660cbb7-d7b1-41d2-b76c-23a913ef85f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:58.087650 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660cbb7-d7b1-41d2-b76c-23a913ef85f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:58.087927 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660cbb7-d7b1-41d2-b76c-23a913ef85f3 admin admin] PATH_INFO: `/v3/projects/566df6c52dcc4b6da653bf224923ea64/users/4e90695683214324a12d1d139add31d3/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:58.104964 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660cbb7-d7b1-41d2-b76c-23a913ef85f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=566df6c52dcc4b6da653bf224923ea64, user_id=4e90695683214324a12d1d139add31d3, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:58.108052 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660cbb7-d7b1-41d2-b76c-23a913ef85f3 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:58.126839 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1184/2358] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:53:58 2022] PUT /identity/v3/projects/566df6c52dcc4b6da653bf224923ea64/users/4e90695683214324a12d1d139add31d3/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:58.130907 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5431f-e0f2-4fcb-bde4-201150444ef3 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:58.140893 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5431f-e0f2-4fcb-bde4-201150444ef3 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:58.196574 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07612a60-2a30-4f59-b59b-330b1d4a4444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:58.197305 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07612a60-2a30-4f59-b59b-330b1d4a4444 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:58.197587 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07612a60-2a30-4f59-b59b-330b1d4a4444 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:58.197917 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07612a60-2a30-4f59-b59b-330b1d4a4444 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:58.198646 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07612a60-2a30-4f59-b59b-330b1d4a4444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:58.200286 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07612a60-2a30-4f59-b59b-330b1d4a4444 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:58.214776 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1175/2359] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:53:58.219296 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660cbb7-d7b1-41d2-b76c-23a913ef85f3 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:58.230190 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660cbb7-d7b1-41d2-b76c-23a913ef85f3 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:58.237416 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c942d3-8daf-4260-80a5-0560951cc968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:58.238313 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c942d3-8daf-4260-80a5-0560951cc968 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:58.238598 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c942d3-8daf-4260-80a5-0560951cc968 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:58.238889 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c942d3-8daf-4260-80a5-0560951cc968 admin admin] PATH_INFO: `/v3/projects/566df6c52dcc4b6da653bf224923ea64/users/4e90695683214324a12d1d139add31d3/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:58.241198 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c942d3-8daf-4260-80a5-0560951cc968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=566df6c52dcc4b6da653bf224923ea64, user_id=4e90695683214324a12d1d139add31d3, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:58.243860 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c942d3-8daf-4260-80a5-0560951cc968 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:58.256656 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1185/2360] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:53:58 2022] PUT /identity/v3/projects/566df6c52dcc4b6da653bf224923ea64/users/4e90695683214324a12d1d139add31d3/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:58.267137 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d66b5-aef7-47e8-81fa-e0754425e0c1 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:58.267358 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d66b5-aef7-47e8-81fa-e0754425e0c1 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:58.267636 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d66b5-aef7-47e8-81fa-e0754425e0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:58.296692 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-d14d66b5-aef7-47e8-81fa-e0754425e0c1 None None] MFA Rules not processed for user `4e90695683214324a12d1d139add31d3`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:58.297949 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-d14d66b5-aef7-47e8-81fa-e0754425e0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:58.367658 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1176/2361] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:58.377481 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c942d3-8daf-4260-80a5-0560951cc968 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:58.379420 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a8c942d3-8daf-4260-80a5-0560951cc968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:58.440895 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c942d3-8daf-4260-80a5-0560951cc968 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:58.445383 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f7c4b-9391-4e2a-b7cc-4b99326912ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:58.446020 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f7c4b-9391-4e2a-b7cc-4b99326912ef service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:58.446302 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f7c4b-9391-4e2a-b7cc-4b99326912ef service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:58.446578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f7c4b-9391-4e2a-b7cc-4b99326912ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:58.456222 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f7c4b-9391-4e2a-b7cc-4b99326912ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:58.457693 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f7c4b-9391-4e2a-b7cc-4b99326912ef service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:58.467156 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1186/2362] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:53:58 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:53:58.594112 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d66b5-aef7-47e8-81fa-e0754425e0c1 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:58.669505 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d66b5-aef7-47e8-81fa-e0754425e0c1 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:58.675125 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29649bbb-9628-453a-a9b5-4cb784c6108f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:58.676079 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29649bbb-9628-453a-a9b5-4cb784c6108f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:58.676360 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29649bbb-9628-453a-a9b5-4cb784c6108f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:58.676630 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29649bbb-9628-453a-a9b5-4cb784c6108f admin admin] PATH_INFO: `/v3/users/381a573ceab1441fa1560a300e17c868` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:58.677992 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29649bbb-9628-453a-a9b5-4cb784c6108f admin admin] RBAC: Authorizing `identity:delete_user(user_id=381a573ceab1441fa1560a300e17c868)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:58.680033 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29649bbb-9628-453a-a9b5-4cb784c6108f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:58.729941 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-29649bbb-9628-453a-a9b5-4cb784c6108f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '381a573ceab1441fa1560a300e17c868'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:58.743039 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-29649bbb-9628-453a-a9b5-4cb784c6108f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '381a573ceab1441fa1560a300e17c868'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:58.750130 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-29649bbb-9628-453a-a9b5-4cb784c6108f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '381a573ceab1441fa1560a300e17c868'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:58.759015 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-29649bbb-9628-453a-a9b5-4cb784c6108f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '381a573ceab1441fa1560a300e17c868'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:58.759667 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-29649bbb-9628-453a-a9b5-4cb784c6108f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '381a573ceab1441fa1560a300e17c868'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:58.765931 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1177/2363] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:53:58 2022] DELETE /identity/v3/users/381a573ceab1441fa1560a300e17c868 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:58.770606 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14833e4-78f0-495e-a495-645e68e167a3 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:58.771073 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14833e4-78f0-495e-a495-645e68e167a3 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:58.771073 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14833e4-78f0-495e-a495-645e68e167a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:58.788432 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-e14833e4-78f0-495e-a495-645e68e167a3 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:58.789660 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-e14833e4-78f0-495e-a495-645e68e167a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:58.851493 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1187/2364] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:53:58.861447 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29649bbb-9628-453a-a9b5-4cb784c6108f admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:58.863372 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-29649bbb-9628-453a-a9b5-4cb784c6108f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:58.922459 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29649bbb-9628-453a-a9b5-4cb784c6108f admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:58.926761 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c4b7d-709a-4dec-8c71-0ca1c43685a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:58.927426 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c4b7d-709a-4dec-8c71-0ca1c43685a6 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:58.927704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c4b7d-709a-4dec-8c71-0ca1c43685a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:58.927988 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c4b7d-709a-4dec-8c71-0ca1c43685a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:58.937321 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c4b7d-709a-4dec-8c71-0ca1c43685a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:58.938732 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c4b7d-709a-4dec-8c71-0ca1c43685a6 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:58.948832 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1178/2365] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:53:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:53:59.193071 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14833e4-78f0-495e-a495-645e68e167a3 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:59.194557 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-e14833e4-78f0-495e-a495-645e68e167a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:59.206420 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14833e4-78f0-495e-a495-645e68e167a3 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:59.211768 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f3ecf-d1cd-40c9-a765-c062b9a56717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:59.212638 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f3ecf-d1cd-40c9-a765-c062b9a56717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:59.212955 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f3ecf-d1cd-40c9-a765-c062b9a56717 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:59.213231 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f3ecf-d1cd-40c9-a765-c062b9a56717 admin admin] PATH_INFO: `/v3/users/fc1a79750b374ca692542af5b2e72bd6` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:59.214438 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f3ecf-d1cd-40c9-a765-c062b9a56717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc1a79750b374ca692542af5b2e72bd6)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:59.216394 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f3ecf-d1cd-40c9-a765-c062b9a56717 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:59.232744 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c4b7d-709a-4dec-8c71-0ca1c43685a6 service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:59.234643 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-c52c4b7d-709a-4dec-8c71-0ca1c43685a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:59.251635 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c4b7d-709a-4dec-8c71-0ca1c43685a6 service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:59.259534 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d99d82-0ec4-4557-87b5-87ae569d1891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:59.260435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d99d82-0ec4-4557-87b5-87ae569d1891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:59.260721 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d99d82-0ec4-4557-87b5-87ae569d1891 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:59.261037 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d99d82-0ec4-4557-87b5-87ae569d1891 admin admin] PATH_INFO: `/v3/projects/1cb1695e508445eea7d4808cf4eec9ed` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:59.262793 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d99d82-0ec4-4557-87b5-87ae569d1891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb1695e508445eea7d4808cf4eec9ed)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:59.265047 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d99d82-0ec4-4557-87b5-87ae569d1891 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:59.271842 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-205f3ecf-d1cd-40c9-a765-c062b9a56717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc1a79750b374ca692542af5b2e72bd6'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:59.272494 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-205f3ecf-d1cd-40c9-a765-c062b9a56717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc1a79750b374ca692542af5b2e72bd6'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:59.273162 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-205f3ecf-d1cd-40c9-a765-c062b9a56717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc1a79750b374ca692542af5b2e72bd6'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:59.284972 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-205f3ecf-d1cd-40c9-a765-c062b9a56717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc1a79750b374ca692542af5b2e72bd6'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:59.291629 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-205f3ecf-d1cd-40c9-a765-c062b9a56717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc1a79750b374ca692542af5b2e72bd6'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:59.303638 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1188/2366] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:53:59 2022] DELETE /identity/v3/users/fc1a79750b374ca692542af5b2e72bd6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:59.308230 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112e723-621c-4a53-9bab-2f1b29cb0c41 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:59.308584 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112e723-621c-4a53-9bab-2f1b29cb0c41 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:59.308872 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112e723-621c-4a53-9bab-2f1b29cb0c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:59.311786 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-49d99d82-0ec4-4557-87b5-87ae569d1891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb1695e508445eea7d4808cf4eec9ed', 'request_id': 'req-49d99d82-0ec4-4557-87b5-87ae569d1891'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:59.317885 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-49d99d82-0ec4-4557-87b5-87ae569d1891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb1695e508445eea7d4808cf4eec9ed', 'request_id': 'req-49d99d82-0ec4-4557-87b5-87ae569d1891'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:59.326278 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-e112e723-621c-4a53-9bab-2f1b29cb0c41 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:53:59.327524 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-e112e723-621c-4a53-9bab-2f1b29cb0c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:59.327711 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-49d99d82-0ec4-4557-87b5-87ae569d1891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb1695e508445eea7d4808cf4eec9ed', 'request_id': 'req-49d99d82-0ec4-4557-87b5-87ae569d1891'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:59.337726 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-49d99d82-0ec4-4557-87b5-87ae569d1891 admin admin] The token cache is being invalidate because project 1cb1695e508445eea7d4808cf4eec9ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:53:59.338013 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-49d99d82-0ec4-4557-87b5-87ae569d1891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:59.338633 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-49d99d82-0ec4-4557-87b5-87ae569d1891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:59.340162 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1179/2367] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:53:59 2022] DELETE /identity/v3/projects/1cb1695e508445eea7d4808cf4eec9ed => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:53:59.344032 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d99d82-0ec4-4557-87b5-87ae569d1891 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:59.345367 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-49d99d82-0ec4-4557-87b5-87ae569d1891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:59.383634 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1189/2368] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:53:59.393406 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112e723-621c-4a53-9bab-2f1b29cb0c41 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:59.394721 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-e112e723-621c-4a53-9bab-2f1b29cb0c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:59.406134 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d99d82-0ec4-4557-87b5-87ae569d1891 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:59.410962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f136b1-71cf-4497-93bf-65262e5e59ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:59.411801 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f136b1-71cf-4497-93bf-65262e5e59ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:59.412107 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f136b1-71cf-4497-93bf-65262e5e59ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:59.412368 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f136b1-71cf-4497-93bf-65262e5e59ed admin admin] PATH_INFO: `/v3/users/4e90695683214324a12d1d139add31d3` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:59.413564 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f136b1-71cf-4497-93bf-65262e5e59ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e90695683214324a12d1d139add31d3)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:59.415487 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f136b1-71cf-4497-93bf-65262e5e59ed admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:59.449690 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112e723-621c-4a53-9bab-2f1b29cb0c41 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:59.453460 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8a92b-d71a-42f3-bb75-f52a97610ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:59.454100 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8a92b-d71a-42f3-bb75-f52a97610ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:59.454397 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8a92b-d71a-42f3-bb75-f52a97610ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:59.454660 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8a92b-d71a-42f3-bb75-f52a97610ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:59.463818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-50f136b1-71cf-4497-93bf-65262e5e59ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e90695683214324a12d1d139add31d3'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:59.464362 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8a92b-d71a-42f3-bb75-f52a97610ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:59.465836 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8a92b-d71a-42f3-bb75-f52a97610ba1 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:59.475540 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1190/2369] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:53:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:53:59.475727 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-50f136b1-71cf-4497-93bf-65262e5e59ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e90695683214324a12d1d139add31d3'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:59.483133 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-50f136b1-71cf-4497-93bf-65262e5e59ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e90695683214324a12d1d139add31d3'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:59.491805 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-50f136b1-71cf-4497-93bf-65262e5e59ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e90695683214324a12d1d139add31d3'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:59.492414 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-50f136b1-71cf-4497-93bf-65262e5e59ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e90695683214324a12d1d139add31d3'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:59.498598 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1180/2370] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:53:59 2022] DELETE /identity/v3/users/4e90695683214324a12d1d139add31d3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:53:59.830971 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8a92b-d71a-42f3-bb75-f52a97610ba1 service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:59.832639 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-11d8a92b-d71a-42f3-bb75-f52a97610ba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:59.847789 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8a92b-d71a-42f3-bb75-f52a97610ba1 service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:59.870697 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f136b1-71cf-4497-93bf-65262e5e59ed admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:59.872133 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-50f136b1-71cf-4497-93bf-65262e5e59ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:53:59.908986 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d235309-a04f-4130-af60-e1abedff41e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:53:59.910078 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d235309-a04f-4130-af60-e1abedff41e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:53:59.910269 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d235309-a04f-4130-af60-e1abedff41e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:53:59.910551 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d235309-a04f-4130-af60-e1abedff41e6 admin admin] PATH_INFO: `/v3/projects/537a5cec9a00415e851bc08d92cab8c1` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:53:59.911754 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d235309-a04f-4130-af60-e1abedff41e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=537a5cec9a00415e851bc08d92cab8c1)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:53:59.913732 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d235309-a04f-4130-af60-e1abedff41e6 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:53:59.948926 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f136b1-71cf-4497-93bf-65262e5e59ed admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:53:59.959844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2d235309-a04f-4130-af60-e1abedff41e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '537a5cec9a00415e851bc08d92cab8c1', 'request_id': 'req-2d235309-a04f-4130-af60-e1abedff41e6'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:59.965550 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2d235309-a04f-4130-af60-e1abedff41e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '537a5cec9a00415e851bc08d92cab8c1', 'request_id': 'req-2d235309-a04f-4130-af60-e1abedff41e6'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:59.973993 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2d235309-a04f-4130-af60-e1abedff41e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '537a5cec9a00415e851bc08d92cab8c1', 'request_id': 'req-2d235309-a04f-4130-af60-e1abedff41e6'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:59.984939 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2d235309-a04f-4130-af60-e1abedff41e6 admin admin] The token cache is being invalidate because project 537a5cec9a00415e851bc08d92cab8c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:53:59.985228 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2d235309-a04f-4130-af60-e1abedff41e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:59.985850 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2d235309-a04f-4130-af60-e1abedff41e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:53:59.987587 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1191/2371] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:53:59 2022] DELETE /identity/v3/projects/537a5cec9a00415e851bc08d92cab8c1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:53:59.991110 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d235309-a04f-4130-af60-e1abedff41e6 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:53:59.992372 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-2d235309-a04f-4130-af60-e1abedff41e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:00.003261 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2b4da-e926-4fe7-b7c0-b0befd77fa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:00.004125 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2b4da-e926-4fe7-b7c0-b0befd77fa87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:00.004405 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2b4da-e926-4fe7-b7c0-b0befd77fa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:00.004787 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2b4da-e926-4fe7-b7c0-b0befd77fa87 admin admin] PATH_INFO: `/v3/projects/566df6c52dcc4b6da653bf224923ea64` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:00.005997 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2b4da-e926-4fe7-b7c0-b0befd77fa87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=566df6c52dcc4b6da653bf224923ea64)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:00.007927 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2b4da-e926-4fe7-b7c0-b0befd77fa87 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:00.054747 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d235309-a04f-4130-af60-e1abedff41e6 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:00.055031 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-b1f2b4da-e926-4fe7-b7c0-b0befd77fa87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '566df6c52dcc4b6da653bf224923ea64', 'request_id': 'req-b1f2b4da-e926-4fe7-b7c0-b0befd77fa87'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:00.060921 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-b1f2b4da-e926-4fe7-b7c0-b0befd77fa87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '566df6c52dcc4b6da653bf224923ea64', 'request_id': 'req-b1f2b4da-e926-4fe7-b7c0-b0befd77fa87'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:00.068943 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-b1f2b4da-e926-4fe7-b7c0-b0befd77fa87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '566df6c52dcc4b6da653bf224923ea64', 'request_id': 'req-b1f2b4da-e926-4fe7-b7c0-b0befd77fa87'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:00.079645 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-b1f2b4da-e926-4fe7-b7c0-b0befd77fa87 admin admin] The token cache is being invalidate because project 566df6c52dcc4b6da653bf224923ea64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:54:00.079960 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-b1f2b4da-e926-4fe7-b7c0-b0befd77fa87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:00.080649 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-b1f2b4da-e926-4fe7-b7c0-b0befd77fa87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:00.082584 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1181/2372] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:53:59 2022] DELETE /identity/v3/projects/566df6c52dcc4b6da653bf224923ea64 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:54:00.088503 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b49292-40ae-434a-89c6-7b11953fca55 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:00.088957 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b49292-40ae-434a-89c6-7b11953fca55 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:00.089356 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b49292-40ae-434a-89c6-7b11953fca55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:00.108625 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-10b49292-40ae-434a-89c6-7b11953fca55 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:00.109794 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1fcf4-9309-4593-aaf2-2772ab950e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:00.109928 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-10b49292-40ae-434a-89c6-7b11953fca55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:00.110699 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1fcf4-9309-4593-aaf2-2772ab950e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:00.110964 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1fcf4-9309-4593-aaf2-2772ab950e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:00.111244 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1fcf4-9309-4593-aaf2-2772ab950e5b admin admin] PATH_INFO: `/v3/users/8845eb1133df4cc78d3afc313650306a` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:00.112557 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1fcf4-9309-4593-aaf2-2772ab950e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8845eb1133df4cc78d3afc313650306a)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:00.114553 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1fcf4-9309-4593-aaf2-2772ab950e5b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:00.119100 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1182/2373] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:00.126975 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701180d-9350-43f2-84f5-dedaf3437052 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:00.127265 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701180d-9350-43f2-84f5-dedaf3437052 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:00.127537 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701180d-9350-43f2-84f5-dedaf3437052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:00.153207 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-9701180d-9350-43f2-84f5-dedaf3437052 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:00.154397 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-9701180d-9350-43f2-84f5-dedaf3437052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:00.162451 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1183/2374] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:54:00.166425 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701180d-9350-43f2-84f5-dedaf3437052 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:00.169135 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2ae1fcf4-9309-4593-aaf2-2772ab950e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8845eb1133df4cc78d3afc313650306a'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:00.169813 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2ae1fcf4-9309-4593-aaf2-2772ab950e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8845eb1133df4cc78d3afc313650306a'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:00.170710 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2ae1fcf4-9309-4593-aaf2-2772ab950e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8845eb1133df4cc78d3afc313650306a'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:00.175828 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701180d-9350-43f2-84f5-dedaf3437052 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:00.180454 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24acfcc-133d-4014-bff5-37a3cbbe720f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:00.182274 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24acfcc-133d-4014-bff5-37a3cbbe720f admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:00.182274 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24acfcc-133d-4014-bff5-37a3cbbe720f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:00.182274 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24acfcc-133d-4014-bff5-37a3cbbe720f admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:00.182562 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2ae1fcf4-9309-4593-aaf2-2772ab950e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8845eb1133df4cc78d3afc313650306a'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:00.183009 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24acfcc-133d-4014-bff5-37a3cbbe720f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:54:00.183316 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24acfcc-133d-4014-bff5-37a3cbbe720f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:00.184929 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24acfcc-133d-4014-bff5-37a3cbbe720f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:00.189179 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2ae1fcf4-9309-4593-aaf2-2772ab950e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8845eb1133df4cc78d3afc313650306a'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:00.200036 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1184/2375] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:54:00.201104 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24acfcc-133d-4014-bff5-37a3cbbe720f admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:00.202946 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-c24acfcc-133d-4014-bff5-37a3cbbe720f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:00.207020 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1192/2376] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:53:59 2022] DELETE /identity/v3/users/8845eb1133df4cc78d3afc313650306a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:54:00.215825 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24acfcc-133d-4014-bff5-37a3cbbe720f admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:00.300562 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9ac2b-4538-4214-a30d-addd91be42aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:00.301295 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9ac2b-4538-4214-a30d-addd91be42aa admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:00.301572 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9ac2b-4538-4214-a30d-addd91be42aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:00.301885 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9ac2b-4538-4214-a30d-addd91be42aa admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:00.302555 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9ac2b-4538-4214-a30d-addd91be42aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:00.304475 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9ac2b-4538-4214-a30d-addd91be42aa admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:00.329824 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1185/2377] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:54:00 2022] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:54:00.333993 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1fcf4-9309-4593-aaf2-2772ab950e5b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:00.344496 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1fcf4-9309-4593-aaf2-2772ab950e5b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:00.401853 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dcfea-c5f4-4624-a198-4fe41f24102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:00.402558 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dcfea-c5f4-4624-a198-4fe41f24102e admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:00.402867 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dcfea-c5f4-4624-a198-4fe41f24102e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:00.403143 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dcfea-c5f4-4624-a198-4fe41f24102e admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:00.403846 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dcfea-c5f4-4624-a198-4fe41f24102e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:00.405870 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dcfea-c5f4-4624-a198-4fe41f24102e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:00.431260 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1193/2378] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:54:00 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:54:00.432287 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9ac2b-4538-4214-a30d-addd91be42aa admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:00.443108 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9ac2b-4538-4214-a30d-addd91be42aa admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:00.448315 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506ead9-3ee8-419d-ac62-3ea02b62ce1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:00.449032 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506ead9-3ee8-419d-ac62-3ea02b62ce1b admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:00.449310 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506ead9-3ee8-419d-ac62-3ea02b62ce1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:00.449577 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506ead9-3ee8-419d-ac62-3ea02b62ce1b admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:00.450313 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506ead9-3ee8-419d-ac62-3ea02b62ce1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:00.451894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506ead9-3ee8-419d-ac62-3ea02b62ce1b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:00.461973 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1186/2379] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:54:00.466401 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dcfea-c5f4-4624-a198-4fe41f24102e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:00.477559 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dcfea-c5f4-4624-a198-4fe41f24102e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:00.482324 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae893be1-1d94-4845-8881-f79e9b89ffbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:00.483025 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae893be1-1d94-4845-8881-f79e9b89ffbf admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:00.483307 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae893be1-1d94-4845-8881-f79e9b89ffbf admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:00.483589 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae893be1-1d94-4845-8881-f79e9b89ffbf admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:00.484330 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae893be1-1d94-4845-8881-f79e9b89ffbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:00.485963 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae893be1-1d94-4845-8881-f79e9b89ffbf admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:00.496145 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1194/2380] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:54:00.500497 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506ead9-3ee8-419d-ac62-3ea02b62ce1b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:00.510353 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506ead9-3ee8-419d-ac62-3ea02b62ce1b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:00.515255 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff04407-37c4-427d-9bbb-a4e6fe22b2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:00.516133 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff04407-37c4-427d-9bbb-a4e6fe22b2e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:00.516412 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff04407-37c4-427d-9bbb-a4e6fe22b2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:00.516684 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff04407-37c4-427d-9bbb-a4e6fe22b2e0 admin admin] PATH_INFO: `/v3/projects/20050785f328484ba53aca2eb6897c12/users/922296c7f0724db888ef628a81c73796/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:00.532092 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff04407-37c4-427d-9bbb-a4e6fe22b2e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20050785f328484ba53aca2eb6897c12, user_id=922296c7f0724db888ef628a81c73796, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:00.534904 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff04407-37c4-427d-9bbb-a4e6fe22b2e0 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:00.551101 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1187/2381] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:54:00 2022] PUT /identity/v3/projects/20050785f328484ba53aca2eb6897c12/users/922296c7f0724db888ef628a81c73796/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:00.562391 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2d4d4-4cb9-45c9-b319-e1a59c670a61 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:00.562762 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2d4d4-4cb9-45c9-b319-e1a59c670a61 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:00.563045 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2d4d4-4cb9-45c9-b319-e1a59c670a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:00.591028 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff04407-37c4-427d-9bbb-a4e6fe22b2e0 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:00.593103 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-eff04407-37c4-427d-9bbb-a4e6fe22b2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:00.594264 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-04e2d4d4-4cb9-45c9-b319-e1a59c670a61 None None] MFA Rules not processed for user `922296c7f0724db888ef628a81c73796`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:00.595492 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-04e2d4d4-4cb9-45c9-b319-e1a59c670a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:00.657332 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff04407-37c4-427d-9bbb-a4e6fe22b2e0 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:00.661215 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1195/2382] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:00.663955 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37e771-9d39-4b09-a1e7-5d0b2e14269c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:00.664832 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37e771-9d39-4b09-a1e7-5d0b2e14269c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:00.665160 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37e771-9d39-4b09-a1e7-5d0b2e14269c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:00.665620 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2d4d4-4cb9-45c9-b319-e1a59c670a61 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:00.665751 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37e771-9d39-4b09-a1e7-5d0b2e14269c admin admin] PATH_INFO: `/v3/projects/d4d474d26912491ca8e55eb2e518a654` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:00.666991 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37e771-9d39-4b09-a1e7-5d0b2e14269c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4d474d26912491ca8e55eb2e518a654)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:00.668935 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37e771-9d39-4b09-a1e7-5d0b2e14269c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:00.675290 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2d4d4-4cb9-45c9-b319-e1a59c670a61 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:00.680136 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe364a6-0fba-491f-a34c-089928afb7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:00.680750 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe364a6-0fba-491f-a34c-089928afb7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:00.681059 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe364a6-0fba-491f-a34c-089928afb7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:00.681328 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe364a6-0fba-491f-a34c-089928afb7f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:00.682018 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe364a6-0fba-491f-a34c-089928afb7f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:00.683888 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe364a6-0fba-491f-a34c-089928afb7f1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:00.709497 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1196/2383] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:54:00 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:54:00.713418 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe364a6-0fba-491f-a34c-089928afb7f1 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:00.717019 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1d37e771-9d39-4b09-a1e7-5d0b2e14269c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4d474d26912491ca8e55eb2e518a654', 'request_id': 'req-1d37e771-9d39-4b09-a1e7-5d0b2e14269c'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:00.723599 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1d37e771-9d39-4b09-a1e7-5d0b2e14269c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4d474d26912491ca8e55eb2e518a654', 'request_id': 'req-1d37e771-9d39-4b09-a1e7-5d0b2e14269c'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:00.733926 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1d37e771-9d39-4b09-a1e7-5d0b2e14269c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4d474d26912491ca8e55eb2e518a654', 'request_id': 'req-1d37e771-9d39-4b09-a1e7-5d0b2e14269c'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:00.744824 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1d37e771-9d39-4b09-a1e7-5d0b2e14269c admin admin] The token cache is being invalidate because project d4d474d26912491ca8e55eb2e518a654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:54:00.745140 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1d37e771-9d39-4b09-a1e7-5d0b2e14269c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:00.745811 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1d37e771-9d39-4b09-a1e7-5d0b2e14269c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:00.747465 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1188/2384] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:54:00 2022] DELETE /identity/v3/projects/d4d474d26912491ca8e55eb2e518a654 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:00.751286 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37e771-9d39-4b09-a1e7-5d0b2e14269c admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:00.752609 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-1d37e771-9d39-4b09-a1e7-5d0b2e14269c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:00.777025 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe364a6-0fba-491f-a34c-089928afb7f1 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:00.782658 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca9c04-f20d-4a8f-b139-d18eac3dfd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:00.783285 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca9c04-f20d-4a8f-b139-d18eac3dfd22 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:00.783570 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca9c04-f20d-4a8f-b139-d18eac3dfd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:00.783851 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca9c04-f20d-4a8f-b139-d18eac3dfd22 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:00.784563 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca9c04-f20d-4a8f-b139-d18eac3dfd22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:00.786538 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca9c04-f20d-4a8f-b139-d18eac3dfd22 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:00.806811 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1197/2385] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:54:00 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:54:00.810657 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca9c04-f20d-4a8f-b139-d18eac3dfd22 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:00.812369 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-16ca9c04-f20d-4a8f-b139-d18eac3dfd22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:00.817302 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37e771-9d39-4b09-a1e7-5d0b2e14269c admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:00.821987 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde0041-48cc-4722-985d-6a6a2ea82634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:00.822903 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde0041-48cc-4722-985d-6a6a2ea82634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:00.823186 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde0041-48cc-4722-985d-6a6a2ea82634 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:00.823463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde0041-48cc-4722-985d-6a6a2ea82634 admin admin] PATH_INFO: `/v3/users/0147f64ad1b34f71bccbfaf5cd306cc2` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:00.823957 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca9c04-f20d-4a8f-b139-d18eac3dfd22 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:00.824706 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde0041-48cc-4722-985d-6a6a2ea82634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0147f64ad1b34f71bccbfaf5cd306cc2)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:00.826717 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde0041-48cc-4722-985d-6a6a2ea82634 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:00.828771 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe793755-cb6b-49d1-a9d5-63e3ff8e19a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:00.829446 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe793755-cb6b-49d1-a9d5-63e3ff8e19a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:00.829733 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe793755-cb6b-49d1-a9d5-63e3ff8e19a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:00.830016 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe793755-cb6b-49d1-a9d5-63e3ff8e19a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:00.830752 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe793755-cb6b-49d1-a9d5-63e3ff8e19a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:00.832330 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe793755-cb6b-49d1-a9d5-63e3ff8e19a8 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:00.842123 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1198/2386] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:54:00.846266 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe793755-cb6b-49d1-a9d5-63e3ff8e19a8 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:00.856094 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe793755-cb6b-49d1-a9d5-63e3ff8e19a8 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:00.861242 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e2582-c449-42f5-a38d-c04cf5218c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:00.862135 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e2582-c449-42f5-a38d-c04cf5218c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:00.862411 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e2582-c449-42f5-a38d-c04cf5218c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:00.862681 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e2582-c449-42f5-a38d-c04cf5218c3b admin admin] PATH_INFO: `/v3/projects/885fe45502a6486b837a42a7d8641a6d/users/542120eb134b4897885d78a5e4871f6f/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:00.872532 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1cde0041-48cc-4722-985d-6a6a2ea82634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0147f64ad1b34f71bccbfaf5cd306cc2'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:00.877749 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e2582-c449-42f5-a38d-c04cf5218c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=885fe45502a6486b837a42a7d8641a6d, user_id=542120eb134b4897885d78a5e4871f6f, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:00.880621 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e2582-c449-42f5-a38d-c04cf5218c3b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:00.883992 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1cde0041-48cc-4722-985d-6a6a2ea82634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0147f64ad1b34f71bccbfaf5cd306cc2'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:00.891596 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1cde0041-48cc-4722-985d-6a6a2ea82634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0147f64ad1b34f71bccbfaf5cd306cc2'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:00.896431 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1199/2387] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:54:00 2022] PUT /identity/v3/projects/885fe45502a6486b837a42a7d8641a6d/users/542120eb134b4897885d78a5e4871f6f/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:54:00.900471 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1cde0041-48cc-4722-985d-6a6a2ea82634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0147f64ad1b34f71bccbfaf5cd306cc2'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:00.900607 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e2582-c449-42f5-a38d-c04cf5218c3b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:00.901157 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1cde0041-48cc-4722-985d-6a6a2ea82634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0147f64ad1b34f71bccbfaf5cd306cc2'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:00.907539 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1189/2388] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:54:00 2022] DELETE /identity/v3/users/0147f64ad1b34f71bccbfaf5cd306cc2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:00.961520 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e2582-c449-42f5-a38d-c04cf5218c3b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:01.018207 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc54697-e7fd-483f-96b1-bbcd40227955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:01.018885 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc54697-e7fd-483f-96b1-bbcd40227955 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:01.019171 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc54697-e7fd-483f-96b1-bbcd40227955 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:01.019449 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc54697-e7fd-483f-96b1-bbcd40227955 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:01.020188 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc54697-e7fd-483f-96b1-bbcd40227955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:01.021863 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc54697-e7fd-483f-96b1-bbcd40227955 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:01.032074 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1200/2389] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:54:01.036258 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde0041-48cc-4722-985d-6a6a2ea82634 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:01.037891 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-1cde0041-48cc-4722-985d-6a6a2ea82634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:01.051892 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde0041-48cc-4722-985d-6a6a2ea82634 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:01.057225 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0260cf-1655-4c02-a530-c9dcee76aebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:01.058143 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0260cf-1655-4c02-a530-c9dcee76aebf admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:01.058422 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0260cf-1655-4c02-a530-c9dcee76aebf admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:01.058690 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0260cf-1655-4c02-a530-c9dcee76aebf admin admin] PATH_INFO: `/v3/projects/885fe45502a6486b837a42a7d8641a6d/users/542120eb134b4897885d78a5e4871f6f/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:01.060692 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0260cf-1655-4c02-a530-c9dcee76aebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=885fe45502a6486b837a42a7d8641a6d, user_id=542120eb134b4897885d78a5e4871f6f, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:01.063438 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0260cf-1655-4c02-a530-c9dcee76aebf admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:01.073981 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1190/2390] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:54:01 2022] PUT /identity/v3/projects/885fe45502a6486b837a42a7d8641a6d/users/542120eb134b4897885d78a5e4871f6f/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:01.084174 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1597c-4295-4a60-98a8-30ccd32e8d47 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:01.084461 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1597c-4295-4a60-98a8-30ccd32e8d47 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:01.084740 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1597c-4295-4a60-98a8-30ccd32e8d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:01.111542 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-91e1597c-4295-4a60-98a8-30ccd32e8d47 None None] MFA Rules not processed for user `542120eb134b4897885d78a5e4871f6f`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:01.112726 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-91e1597c-4295-4a60-98a8-30ccd32e8d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:01.170200 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0260cf-1655-4c02-a530-c9dcee76aebf admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:01.172172 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-bb0260cf-1655-4c02-a530-c9dcee76aebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:01.182140 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1201/2391] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:01 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:01.192541 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1597c-4295-4a60-98a8-30ccd32e8d47 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:01.194049 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-91e1597c-4295-4a60-98a8-30ccd32e8d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:01.243444 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0260cf-1655-4c02-a530-c9dcee76aebf admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:01.249376 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c923f5c-cbf1-4692-a327-2c8ebcd864f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:01.249898 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1597c-4295-4a60-98a8-30ccd32e8d47 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:01.250273 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c923f5c-cbf1-4692-a327-2c8ebcd864f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:01.250561 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c923f5c-cbf1-4692-a327-2c8ebcd864f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:01.250841 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c923f5c-cbf1-4692-a327-2c8ebcd864f7 admin admin] PATH_INFO: `/v3/projects/1ecc4ab6ecb249aba2262c1414acfd1e` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:01.252206 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c923f5c-cbf1-4692-a327-2c8ebcd864f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ecc4ab6ecb249aba2262c1414acfd1e)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:01.254222 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c923f5c-cbf1-4692-a327-2c8ebcd864f7 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:01.255365 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f974cab-0bf0-4c48-a17e-ca5f82002617 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:01.256057 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f974cab-0bf0-4c48-a17e-ca5f82002617 service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:01.256345 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f974cab-0bf0-4c48-a17e-ca5f82002617 service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:01.256646 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f974cab-0bf0-4c48-a17e-ca5f82002617 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:01.266908 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f974cab-0bf0-4c48-a17e-ca5f82002617 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:01.268463 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f974cab-0bf0-4c48-a17e-ca5f82002617 service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:01.278108 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1202/2392] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:54:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:54:01.301059 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4c923f5c-cbf1-4692-a327-2c8ebcd864f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ecc4ab6ecb249aba2262c1414acfd1e', 'request_id': 'req-4c923f5c-cbf1-4692-a327-2c8ebcd864f7'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:01.310673 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4c923f5c-cbf1-4692-a327-2c8ebcd864f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ecc4ab6ecb249aba2262c1414acfd1e', 'request_id': 'req-4c923f5c-cbf1-4692-a327-2c8ebcd864f7'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:01.319008 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4c923f5c-cbf1-4692-a327-2c8ebcd864f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ecc4ab6ecb249aba2262c1414acfd1e', 'request_id': 'req-4c923f5c-cbf1-4692-a327-2c8ebcd864f7'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:01.329102 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4c923f5c-cbf1-4692-a327-2c8ebcd864f7 admin admin] The token cache is being invalidate because project 1ecc4ab6ecb249aba2262c1414acfd1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:54:01.329385 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4c923f5c-cbf1-4692-a327-2c8ebcd864f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:01.330039 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4c923f5c-cbf1-4692-a327-2c8ebcd864f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:01.331578 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1191/2393] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:54:01 2022] DELETE /identity/v3/projects/1ecc4ab6ecb249aba2262c1414acfd1e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:01.337277 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247256a0-9787-47a6-95e8-171493ed3c4b None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:01.337566 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247256a0-9787-47a6-95e8-171493ed3c4b None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:01.337893 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247256a0-9787-47a6-95e8-171493ed3c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:01.356232 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-247256a0-9787-47a6-95e8-171493ed3c4b None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:01.357567 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-247256a0-9787-47a6-95e8-171493ed3c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:01.419540 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1203/2394] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:01.425143 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f767b4b-a1e0-42fb-8745-000cdc73f246 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:01.425439 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f767b4b-a1e0-42fb-8745-000cdc73f246 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:01.425720 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f767b4b-a1e0-42fb-8745-000cdc73f246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:01.441239 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247256a0-9787-47a6-95e8-171493ed3c4b None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:01.442650 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-247256a0-9787-47a6-95e8-171493ed3c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:01.445382 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-7f767b4b-a1e0-42fb-8745-000cdc73f246 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:01.446566 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-7f767b4b-a1e0-42fb-8745-000cdc73f246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:01.454503 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247256a0-9787-47a6-95e8-171493ed3c4b None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:01.454880 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1192/2395] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:01.459100 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f767b4b-a1e0-42fb-8745-000cdc73f246 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:01.459216 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf69ab8-be6c-4810-afb7-a83b0e37238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:01.460002 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf69ab8-be6c-4810-afb7-a83b0e37238c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:01.460300 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf69ab8-be6c-4810-afb7-a83b0e37238c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:01.460574 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf69ab8-be6c-4810-afb7-a83b0e37238c admin admin] PATH_INFO: `/v3/users/922296c7f0724db888ef628a81c73796` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:01.461807 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf69ab8-be6c-4810-afb7-a83b0e37238c admin admin] RBAC: Authorizing `identity:delete_user(user_id=922296c7f0724db888ef628a81c73796)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:01.463762 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf69ab8-be6c-4810-afb7-a83b0e37238c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:01.468064 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f767b4b-a1e0-42fb-8745-000cdc73f246 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:01.472677 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933524f-0332-4fee-b06c-f52cc44d26ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:01.473355 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933524f-0332-4fee-b06c-f52cc44d26ff admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:01.473637 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933524f-0332-4fee-b06c-f52cc44d26ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:01.473911 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933524f-0332-4fee-b06c-f52cc44d26ff admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:01.474640 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933524f-0332-4fee-b06c-f52cc44d26ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:54:01.474943 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933524f-0332-4fee-b06c-f52cc44d26ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:01.476541 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933524f-0332-4fee-b06c-f52cc44d26ff admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:01.492065 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1193/2396] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:54:01.493279 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933524f-0332-4fee-b06c-f52cc44d26ff admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:01.503959 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933524f-0332-4fee-b06c-f52cc44d26ff admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:01.508692 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488915d0-1562-4557-8c6e-ec52da9bd3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:01.509377 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488915d0-1562-4557-8c6e-ec52da9bd3be admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:01.509660 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488915d0-1562-4557-8c6e-ec52da9bd3be admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:01.509936 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488915d0-1562-4557-8c6e-ec52da9bd3be admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:01.510642 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488915d0-1562-4557-8c6e-ec52da9bd3be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:01.512525 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488915d0-1562-4557-8c6e-ec52da9bd3be admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:01.514864 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ccf69ab8-be6c-4810-afb7-a83b0e37238c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '922296c7f0724db888ef628a81c73796'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:01.515925 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ccf69ab8-be6c-4810-afb7-a83b0e37238c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '922296c7f0724db888ef628a81c73796'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:01.516248 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ccf69ab8-be6c-4810-afb7-a83b0e37238c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '922296c7f0724db888ef628a81c73796'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:01.528522 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ccf69ab8-be6c-4810-afb7-a83b0e37238c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '922296c7f0724db888ef628a81c73796'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:01.535277 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ccf69ab8-be6c-4810-afb7-a83b0e37238c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '922296c7f0724db888ef628a81c73796'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:01.538911 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1194/2397] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:54:01 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:54:01.543500 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488915d0-1562-4557-8c6e-ec52da9bd3be admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:01.545070 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-488915d0-1562-4557-8c6e-ec52da9bd3be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:01.552911 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1204/2398] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:54:01 2022] DELETE /identity/v3/users/922296c7f0724db888ef628a81c73796 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:54:01.557271 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c2886-19c1-4b1a-8ac0-590f4fb72b5e None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:01.557559 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c2886-19c1-4b1a-8ac0-590f4fb72b5e None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:01.557844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c2886-19c1-4b1a-8ac0-590f4fb72b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:01.575503 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-dd3c2886-19c1-4b1a-8ac0-590f4fb72b5e None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:01.576759 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-dd3c2886-19c1-4b1a-8ac0-590f4fb72b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:01.611632 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488915d0-1562-4557-8c6e-ec52da9bd3be admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:01.639771 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1205/2399] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:01.650287 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c2886-19c1-4b1a-8ac0-590f4fb72b5e None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:01.651877 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-dd3c2886-19c1-4b1a-8ac0-590f4fb72b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:01.673624 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b953d-3b9b-4ee7-b6b9-e06521ed9f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:01.674224 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b953d-3b9b-4ee7-b6b9-e06521ed9f64 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:01.674511 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b953d-3b9b-4ee7-b6b9-e06521ed9f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:01.674787 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b953d-3b9b-4ee7-b6b9-e06521ed9f64 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:01.675494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b953d-3b9b-4ee7-b6b9-e06521ed9f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:01.677465 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b953d-3b9b-4ee7-b6b9-e06521ed9f64 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:01.702603 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1195/2400] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:54:01 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:54:01.703596 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b953d-3b9b-4ee7-b6b9-e06521ed9f64 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:01.706417 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c2886-19c1-4b1a-8ac0-590f4fb72b5e None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:01.710045 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0afc06-5f6f-427c-8407-237dc7698c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:01.710680 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0afc06-5f6f-427c-8407-237dc7698c22 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:01.710958 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0afc06-5f6f-427c-8407-237dc7698c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:01.711233 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0afc06-5f6f-427c-8407-237dc7698c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:01.713661 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b953d-3b9b-4ee7-b6b9-e06521ed9f64 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:01.718432 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769b00f-7caf-4109-b055-0d7c345c0424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:01.719209 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769b00f-7caf-4109-b055-0d7c345c0424 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:01.719506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769b00f-7caf-4109-b055-0d7c345c0424 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:01.719784 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769b00f-7caf-4109-b055-0d7c345c0424 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:01.720308 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0afc06-5f6f-427c-8407-237dc7698c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:01.720561 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769b00f-7caf-4109-b055-0d7c345c0424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:01.721766 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0afc06-5f6f-427c-8407-237dc7698c22 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:01.722187 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769b00f-7caf-4109-b055-0d7c345c0424 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:01.732895 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1206/2401] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:54:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:54:01.736350 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1196/2402] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:54:01.737516 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0afc06-5f6f-427c-8407-237dc7698c22 service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:01.747241 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0afc06-5f6f-427c-8407-237dc7698c22 service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:01.752663 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053430f-eae1-4d60-b6f4-62cd36b413ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:01.753368 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053430f-eae1-4d60-b6f4-62cd36b413ae admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:01.753652 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053430f-eae1-4d60-b6f4-62cd36b413ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:01.753954 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053430f-eae1-4d60-b6f4-62cd36b413ae admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:01.754689 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053430f-eae1-4d60-b6f4-62cd36b413ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:01.756276 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053430f-eae1-4d60-b6f4-62cd36b413ae admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:01.766536 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1207/2403] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:54:01.771040 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769b00f-7caf-4109-b055-0d7c345c0424 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:01.781553 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769b00f-7caf-4109-b055-0d7c345c0424 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:01.786610 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a99555-4029-4bef-8427-0d142bfa994b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:01.787495 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a99555-4029-4bef-8427-0d142bfa994b admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:01.787783 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a99555-4029-4bef-8427-0d142bfa994b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:01.788062 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a99555-4029-4bef-8427-0d142bfa994b admin admin] PATH_INFO: `/v3/projects/dc1f36430c0e404b83f29da9c4d07551/users/b2d11897809b4e388b063bb512e0be33/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:01.803329 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a99555-4029-4bef-8427-0d142bfa994b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1f36430c0e404b83f29da9c4d07551, user_id=b2d11897809b4e388b063bb512e0be33, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:01.806092 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a99555-4029-4bef-8427-0d142bfa994b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:01.819928 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1197/2404] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:54:01 2022] PUT /identity/v3/projects/dc1f36430c0e404b83f29da9c4d07551/users/b2d11897809b4e388b063bb512e0be33/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:01.825215 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee957ce6-4128-49f1-a8c9-a4cb6fa61b65 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:01.825952 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee957ce6-4128-49f1-a8c9-a4cb6fa61b65 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:01.826235 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee957ce6-4128-49f1-a8c9-a4cb6fa61b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:01.843915 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-ee957ce6-4128-49f1-a8c9-a4cb6fa61b65 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:01.845145 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-ee957ce6-4128-49f1-a8c9-a4cb6fa61b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:01.907336 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1208/2405] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:01.916928 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a99555-4029-4bef-8427-0d142bfa994b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:01.972517 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a99555-4029-4bef-8427-0d142bfa994b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:01.976403 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d9f97-ff69-4d46-8ce6-8579f7f9f0fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:01.977059 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d9f97-ff69-4d46-8ce6-8579f7f9f0fd service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:01.977352 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d9f97-ff69-4d46-8ce6-8579f7f9f0fd service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:01.977620 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d9f97-ff69-4d46-8ce6-8579f7f9f0fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:01.986713 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d9f97-ff69-4d46-8ce6-8579f7f9f0fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:01.988165 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d9f97-ff69-4d46-8ce6-8579f7f9f0fd service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:01.997476 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1198/2406] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:54:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:54:02.016503 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee957ce6-4128-49f1-a8c9-a4cb6fa61b65 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:02.018021 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-ee957ce6-4128-49f1-a8c9-a4cb6fa61b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:02.031187 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee957ce6-4128-49f1-a8c9-a4cb6fa61b65 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:02.036341 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554fd03-db39-46b8-b5d8-bc28f0972ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:02.037242 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554fd03-db39-46b8-b5d8-bc28f0972ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:02.037526 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554fd03-db39-46b8-b5d8-bc28f0972ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:02.037935 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554fd03-db39-46b8-b5d8-bc28f0972ae3 admin admin] PATH_INFO: `/v3/projects/20050785f328484ba53aca2eb6897c12` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:02.039319 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554fd03-db39-46b8-b5d8-bc28f0972ae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20050785f328484ba53aca2eb6897c12)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:02.041286 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554fd03-db39-46b8-b5d8-bc28f0972ae3 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:02.093376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a554fd03-db39-46b8-b5d8-bc28f0972ae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20050785f328484ba53aca2eb6897c12', 'request_id': 'req-a554fd03-db39-46b8-b5d8-bc28f0972ae3'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:02.099113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a554fd03-db39-46b8-b5d8-bc28f0972ae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20050785f328484ba53aca2eb6897c12', 'request_id': 'req-a554fd03-db39-46b8-b5d8-bc28f0972ae3'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:02.107833 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a554fd03-db39-46b8-b5d8-bc28f0972ae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20050785f328484ba53aca2eb6897c12', 'request_id': 'req-a554fd03-db39-46b8-b5d8-bc28f0972ae3'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:02.119480 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a554fd03-db39-46b8-b5d8-bc28f0972ae3 admin admin] The token cache is being invalidate because project 20050785f328484ba53aca2eb6897c12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:54:02.119813 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a554fd03-db39-46b8-b5d8-bc28f0972ae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:02.120470 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a554fd03-db39-46b8-b5d8-bc28f0972ae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:02.122202 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1209/2407] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:54:02 2022] DELETE /identity/v3/projects/20050785f328484ba53aca2eb6897c12 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:02.126796 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d9f97-ff69-4d46-8ce6-8579f7f9f0fd service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:02.136507 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d9f97-ff69-4d46-8ce6-8579f7f9f0fd service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:02.195728 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8dc70-96f5-47e1-be28-2afcdac14e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:02.196538 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8dc70-96f5-47e1-be28-2afcdac14e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:02.196817 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8dc70-96f5-47e1-be28-2afcdac14e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:02.197129 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8dc70-96f5-47e1-be28-2afcdac14e74 admin admin] PATH_INFO: `/v3/users/542120eb134b4897885d78a5e4871f6f` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:02.198331 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8dc70-96f5-47e1-be28-2afcdac14e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=542120eb134b4897885d78a5e4871f6f)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:02.200261 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8dc70-96f5-47e1-be28-2afcdac14e74 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:02.244910 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-40b8dc70-96f5-47e1-be28-2afcdac14e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542120eb134b4897885d78a5e4871f6f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:02.257222 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-40b8dc70-96f5-47e1-be28-2afcdac14e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542120eb134b4897885d78a5e4871f6f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:02.263729 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-40b8dc70-96f5-47e1-be28-2afcdac14e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542120eb134b4897885d78a5e4871f6f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:02.271992 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-40b8dc70-96f5-47e1-be28-2afcdac14e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542120eb134b4897885d78a5e4871f6f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:02.272689 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-40b8dc70-96f5-47e1-be28-2afcdac14e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542120eb134b4897885d78a5e4871f6f'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:02.279016 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1199/2408] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:54:02 2022] DELETE /identity/v3/users/542120eb134b4897885d78a5e4871f6f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:02.666981 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554fd03-db39-46b8-b5d8-bc28f0972ae3 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:02.669465 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a554fd03-db39-46b8-b5d8-bc28f0972ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:02.705295 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554fd03-db39-46b8-b5d8-bc28f0972ae3 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:02.707988 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bec893-69f2-4cd8-ac07-2768d0fe04d0 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:02.708203 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bec893-69f2-4cd8-ac07-2768d0fe04d0 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:02.708477 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bec893-69f2-4cd8-ac07-2768d0fe04d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:02.740400 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-55bec893-69f2-4cd8-ac07-2768d0fe04d0 None None] MFA Rules not processed for user `b2d11897809b4e388b063bb512e0be33`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:02.742434 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-55bec893-69f2-4cd8-ac07-2768d0fe04d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:02.799110 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e3f14-56d7-4aea-b1cb-a0ace9942b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:02.800111 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e3f14-56d7-4aea-b1cb-a0ace9942b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:02.800463 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e3f14-56d7-4aea-b1cb-a0ace9942b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:02.800803 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e3f14-56d7-4aea-b1cb-a0ace9942b44 admin admin] PATH_INFO: `/v3/projects/885fe45502a6486b837a42a7d8641a6d` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:02.805335 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e3f14-56d7-4aea-b1cb-a0ace9942b44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=885fe45502a6486b837a42a7d8641a6d)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:02.807338 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e3f14-56d7-4aea-b1cb-a0ace9942b44 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:02.819737 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1200/2409] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:02.826186 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bec893-69f2-4cd8-ac07-2768d0fe04d0 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:02.828210 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-55bec893-69f2-4cd8-ac07-2768d0fe04d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:02.876749 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b19e3f14-56d7-4aea-b1cb-a0ace9942b44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '885fe45502a6486b837a42a7d8641a6d', 'request_id': 'req-b19e3f14-56d7-4aea-b1cb-a0ace9942b44'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:02.883851 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b19e3f14-56d7-4aea-b1cb-a0ace9942b44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '885fe45502a6486b837a42a7d8641a6d', 'request_id': 'req-b19e3f14-56d7-4aea-b1cb-a0ace9942b44'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:02.892885 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b19e3f14-56d7-4aea-b1cb-a0ace9942b44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '885fe45502a6486b837a42a7d8641a6d', 'request_id': 'req-b19e3f14-56d7-4aea-b1cb-a0ace9942b44'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:02.893741 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bec893-69f2-4cd8-ac07-2768d0fe04d0 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:02.905043 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b19e3f14-56d7-4aea-b1cb-a0ace9942b44 admin admin] The token cache is being invalidate because project 885fe45502a6486b837a42a7d8641a6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:54:02.905541 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b19e3f14-56d7-4aea-b1cb-a0ace9942b44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:02.906301 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b19e3f14-56d7-4aea-b1cb-a0ace9942b44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:02.910699 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1210/2410] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:54:02 2022] DELETE /identity/v3/projects/885fe45502a6486b837a42a7d8641a6d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:54:02.916151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f690e1-0809-4be8-a62f-426138afd32e None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:02.916444 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f690e1-0809-4be8-a62f-426138afd32e None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:02.916713 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f690e1-0809-4be8-a62f-426138afd32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:02.935364 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-15f690e1-0809-4be8-a62f-426138afd32e None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:02.936595 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-15f690e1-0809-4be8-a62f-426138afd32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:02.942753 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b893fa-ed21-499e-9205-4a8f7b19b29f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:02.943436 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b893fa-ed21-499e-9205-4a8f7b19b29f service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:02.943720 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b893fa-ed21-499e-9205-4a8f7b19b29f service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:02.943993 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b893fa-ed21-499e-9205-4a8f7b19b29f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:02.945760 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-45b893fa-ed21-499e-9205-4a8f7b19b29f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:02.992337 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1211/2411] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:54:03.000063 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af4004-e907-44a6-9dbe-6c1912495ca9 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:03.000348 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af4004-e907-44a6-9dbe-6c1912495ca9 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:03.000620 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af4004-e907-44a6-9dbe-6c1912495ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:03.002106 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b893fa-ed21-499e-9205-4a8f7b19b29f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:03.003600 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b893fa-ed21-499e-9205-4a8f7b19b29f service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:03.012454 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1201/2412] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:54:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:54:03.020572 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-a1af4004-e907-44a6-9dbe-6c1912495ca9 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:03.021798 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a1af4004-e907-44a6-9dbe-6c1912495ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:03.030130 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1212/2413] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:54:03.034435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b893fa-ed21-499e-9205-4a8f7b19b29f service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:03.044592 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b893fa-ed21-499e-9205-4a8f7b19b29f service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:03.049794 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94882321-289b-4347-96c1-1e41db08c652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:03.050469 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94882321-289b-4347-96c1-1e41db08c652 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:03.050746 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94882321-289b-4347-96c1-1e41db08c652 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:03.051044 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94882321-289b-4347-96c1-1e41db08c652 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:03.051812 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94882321-289b-4347-96c1-1e41db08c652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:54:03.052113 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94882321-289b-4347-96c1-1e41db08c652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:03.053730 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94882321-289b-4347-96c1-1e41db08c652 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:03.065201 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1202/2414] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:54:03.069200 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af4004-e907-44a6-9dbe-6c1912495ca9 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:03.078176 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af4004-e907-44a6-9dbe-6c1912495ca9 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:03.082862 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f09b33-9957-4fc8-a140-99f7f9626604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:03.083504 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f09b33-9957-4fc8-a140-99f7f9626604 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:03.083804 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f09b33-9957-4fc8-a140-99f7f9626604 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:03.084072 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f09b33-9957-4fc8-a140-99f7f9626604 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:03.084772 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f09b33-9957-4fc8-a140-99f7f9626604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:03.086662 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f09b33-9957-4fc8-a140-99f7f9626604 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:03.118852 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1213/2415] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:54:03 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:54:03.123001 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94882321-289b-4347-96c1-1e41db08c652 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:03.133446 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94882321-289b-4347-96c1-1e41db08c652 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:03.190445 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddd828-95a4-4350-885d-160223d2ebb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:03.191122 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddd828-95a4-4350-885d-160223d2ebb1 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:03.191405 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddd828-95a4-4350-885d-160223d2ebb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:03.191793 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddd828-95a4-4350-885d-160223d2ebb1 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:03.192517 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddd828-95a4-4350-885d-160223d2ebb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:03.194579 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddd828-95a4-4350-885d-160223d2ebb1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:03.215088 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1203/2416] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:54:03 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:54:03.218827 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f09b33-9957-4fc8-a140-99f7f9626604 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:03.228764 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f09b33-9957-4fc8-a140-99f7f9626604 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:03.233367 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe7923-3688-4782-ab5c-7e04a8f06ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:03.234023 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe7923-3688-4782-ab5c-7e04a8f06ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:03.234301 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe7923-3688-4782-ab5c-7e04a8f06ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:03.234575 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe7923-3688-4782-ab5c-7e04a8f06ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:03.235312 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe7923-3688-4782-ab5c-7e04a8f06ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:03.236941 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe7923-3688-4782-ab5c-7e04a8f06ea8 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:03.248329 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1214/2417] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:54:03.252420 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddd828-95a4-4350-885d-160223d2ebb1 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:03.262891 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddd828-95a4-4350-885d-160223d2ebb1 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:03.267855 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6c324-d85a-4de7-934b-29bd3c2dc6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:03.269992 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6c324-d85a-4de7-934b-29bd3c2dc6dc admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:03.270244 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6c324-d85a-4de7-934b-29bd3c2dc6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:03.270709 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6c324-d85a-4de7-934b-29bd3c2dc6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:03.271865 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6c324-d85a-4de7-934b-29bd3c2dc6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:03.274139 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6c324-d85a-4de7-934b-29bd3c2dc6dc admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:03.284889 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1204/2418] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:54:03.289097 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe7923-3688-4782-ab5c-7e04a8f06ea8 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:03.300680 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe7923-3688-4782-ab5c-7e04a8f06ea8 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:03.305585 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51946454-dcb4-4ce7-a701-f960cea66709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:03.306537 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51946454-dcb4-4ce7-a701-f960cea66709 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:03.306915 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51946454-dcb4-4ce7-a701-f960cea66709 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:03.307252 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51946454-dcb4-4ce7-a701-f960cea66709 admin admin] PATH_INFO: `/v3/projects/4fb64f1baac340aa89b06a99e8d4d5e7/users/de1ca1ce87874a5c81581dc3d778dae9/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:03.323762 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51946454-dcb4-4ce7-a701-f960cea66709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fb64f1baac340aa89b06a99e8d4d5e7, user_id=de1ca1ce87874a5c81581dc3d778dae9, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:03.327047 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51946454-dcb4-4ce7-a701-f960cea66709 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:03.341076 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1215/2419] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:54:03 2022] PUT /identity/v3/projects/4fb64f1baac340aa89b06a99e8d4d5e7/users/de1ca1ce87874a5c81581dc3d778dae9/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:54:03.352623 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051724a5-dd35-45e0-8b35-a1a307ea09b4 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:03.352952 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051724a5-dd35-45e0-8b35-a1a307ea09b4 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:03.353229 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051724a5-dd35-45e0-8b35-a1a307ea09b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:03.381802 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-051724a5-dd35-45e0-8b35-a1a307ea09b4 None None] MFA Rules not processed for user `de1ca1ce87874a5c81581dc3d778dae9`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:03.383111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-051724a5-dd35-45e0-8b35-a1a307ea09b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:03.449023 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1205/2420] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:03.456048 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51946454-dcb4-4ce7-a701-f960cea66709 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:03.527027 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51946454-dcb4-4ce7-a701-f960cea66709 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:03.531750 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5d15f-e25c-498b-b45b-5523b61ba3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:03.532405 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5d15f-e25c-498b-b45b-5523b61ba3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:03.532690 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5d15f-e25c-498b-b45b-5523b61ba3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:03.532997 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5d15f-e25c-498b-b45b-5523b61ba3f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:03.533817 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5d15f-e25c-498b-b45b-5523b61ba3f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:03.535710 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5d15f-e25c-498b-b45b-5523b61ba3f2 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:03.562526 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1216/2421] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:54:03 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:54:03.566579 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051724a5-dd35-45e0-8b35-a1a307ea09b4 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:03.577703 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051724a5-dd35-45e0-8b35-a1a307ea09b4 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:03.634683 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc13e3-b386-4752-aa83-43ed87c2eb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:03.635330 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc13e3-b386-4752-aa83-43ed87c2eb51 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:03.635614 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc13e3-b386-4752-aa83-43ed87c2eb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:03.635880 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc13e3-b386-4752-aa83-43ed87c2eb51 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:03.636575 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc13e3-b386-4752-aa83-43ed87c2eb51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:03.638526 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc13e3-b386-4752-aa83-43ed87c2eb51 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:03.661793 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1206/2422] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:54:03 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:54:03.665825 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5d15f-e25c-498b-b45b-5523b61ba3f2 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:03.676002 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5d15f-e25c-498b-b45b-5523b61ba3f2 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:03.681058 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c925e-364d-40c6-b8e6-6f2f52e7c04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:03.681710 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c925e-364d-40c6-b8e6-6f2f52e7c04a admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:03.681991 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c925e-364d-40c6-b8e6-6f2f52e7c04a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:03.682265 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c925e-364d-40c6-b8e6-6f2f52e7c04a admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:03.683001 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c925e-364d-40c6-b8e6-6f2f52e7c04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:03.684600 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c925e-364d-40c6-b8e6-6f2f52e7c04a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:03.694980 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1217/2423] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:54:03.700760 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc13e3-b386-4752-aa83-43ed87c2eb51 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:03.711517 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc13e3-b386-4752-aa83-43ed87c2eb51 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:03.717368 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9840ef4-7ed4-4b89-840b-ddde5423312d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:03.718083 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9840ef4-7ed4-4b89-840b-ddde5423312d admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:03.718358 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9840ef4-7ed4-4b89-840b-ddde5423312d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:03.718628 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9840ef4-7ed4-4b89-840b-ddde5423312d admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:03.719356 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9840ef4-7ed4-4b89-840b-ddde5423312d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:03.721038 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9840ef4-7ed4-4b89-840b-ddde5423312d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:03.731702 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1207/2424] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:54:03.736170 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c925e-364d-40c6-b8e6-6f2f52e7c04a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:03.746412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c925e-364d-40c6-b8e6-6f2f52e7c04a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:03.751595 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73972e16-9488-41f4-9098-5ed0ed8289cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:03.752483 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73972e16-9488-41f4-9098-5ed0ed8289cc admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:03.752764 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73972e16-9488-41f4-9098-5ed0ed8289cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:03.753063 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73972e16-9488-41f4-9098-5ed0ed8289cc admin admin] PATH_INFO: `/v3/projects/c2eb14a5b4fc40e38b05e8eb7a7d22d4/users/2e3f4afda81d4838aa863880ddf9a1d5/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:03.768113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73972e16-9488-41f4-9098-5ed0ed8289cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2eb14a5b4fc40e38b05e8eb7a7d22d4, user_id=2e3f4afda81d4838aa863880ddf9a1d5, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:03.770779 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73972e16-9488-41f4-9098-5ed0ed8289cc admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:03.787442 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1218/2425] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:54:03 2022] PUT /identity/v3/projects/c2eb14a5b4fc40e38b05e8eb7a7d22d4/users/2e3f4afda81d4838aa863880ddf9a1d5/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:03.800335 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ce729-3f9e-4c73-82b5-1e0c98cb1bf5 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:03.800621 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ce729-3f9e-4c73-82b5-1e0c98cb1bf5 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:03.800880 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ce729-3f9e-4c73-82b5-1e0c98cb1bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:03.827562 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-0b7ce729-3f9e-4c73-82b5-1e0c98cb1bf5 None None] MFA Rules not processed for user `2e3f4afda81d4838aa863880ddf9a1d5`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:03.828775 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-0b7ce729-3f9e-4c73-82b5-1e0c98cb1bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:03.899290 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1208/2426] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:03.904060 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73972e16-9488-41f4-9098-5ed0ed8289cc admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:03.963990 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73972e16-9488-41f4-9098-5ed0ed8289cc admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:03.970109 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e985b3-883a-4722-8db1-076a974e818c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:03.970809 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e985b3-883a-4722-8db1-076a974e818c admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:03.971088 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e985b3-883a-4722-8db1-076a974e818c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:03.971354 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e985b3-883a-4722-8db1-076a974e818c admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:03.972082 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e985b3-883a-4722-8db1-076a974e818c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:03.973995 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e985b3-883a-4722-8db1-076a974e818c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:04.003438 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1219/2427] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:54:03 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:54:04.005185 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ce729-3f9e-4c73-82b5-1e0c98cb1bf5 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:04.016160 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ce729-3f9e-4c73-82b5-1e0c98cb1bf5 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:04.070257 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dcd72-482c-49b0-89cb-d78af7bf007b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:04.070808 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dcd72-482c-49b0-89cb-d78af7bf007b admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:04.071087 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dcd72-482c-49b0-89cb-d78af7bf007b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:04.071357 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dcd72-482c-49b0-89cb-d78af7bf007b admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:04.072062 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22dcd72-482c-49b0-89cb-d78af7bf007b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:04.074005 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22dcd72-482c-49b0-89cb-d78af7bf007b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:04.095180 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1209/2428] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:54:04 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:54:04.101778 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e985b3-883a-4722-8db1-076a974e818c admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:04.114887 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e985b3-883a-4722-8db1-076a974e818c admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:04.120377 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483b429-118a-425d-ab81-47e94a4237c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:04.121074 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483b429-118a-425d-ab81-47e94a4237c9 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:04.121352 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483b429-118a-425d-ab81-47e94a4237c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:04.121614 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483b429-118a-425d-ab81-47e94a4237c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:04.122340 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483b429-118a-425d-ab81-47e94a4237c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:04.123981 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483b429-118a-425d-ab81-47e94a4237c9 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:04.134624 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1220/2429] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:54:04.138977 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dcd72-482c-49b0-89cb-d78af7bf007b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:04.149031 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dcd72-482c-49b0-89cb-d78af7bf007b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:04.154221 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983da31e-9289-428f-97a0-c8aacd48d039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:04.155209 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983da31e-9289-428f-97a0-c8aacd48d039 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:04.155498 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983da31e-9289-428f-97a0-c8aacd48d039 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:04.155760 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983da31e-9289-428f-97a0-c8aacd48d039 admin admin] PATH_INFO: `/v3/projects/9a4b5daa13d24edf9cc04982fdc996cf/users/41903997c91744069e982c731f20854c/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:04.170222 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983da31e-9289-428f-97a0-c8aacd48d039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4b5daa13d24edf9cc04982fdc996cf, user_id=41903997c91744069e982c731f20854c, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:04.172885 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983da31e-9289-428f-97a0-c8aacd48d039 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:04.187397 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1210/2430] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:54:04 2022] PUT /identity/v3/projects/9a4b5daa13d24edf9cc04982fdc996cf/users/41903997c91744069e982c731f20854c/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:54:04.191295 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483b429-118a-425d-ab81-47e94a4237c9 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:04.201177 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483b429-118a-425d-ab81-47e94a4237c9 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:04.256735 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fc28b-1248-404e-978c-41a493916676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:04.257448 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fc28b-1248-404e-978c-41a493916676 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:04.257732 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fc28b-1248-404e-978c-41a493916676 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:04.258005 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fc28b-1248-404e-978c-41a493916676 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:04.258742 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fc28b-1248-404e-978c-41a493916676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:04.260333 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fc28b-1248-404e-978c-41a493916676 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:04.269932 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1221/2431] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:54:04.274554 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983da31e-9289-428f-97a0-c8aacd48d039 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:04.284924 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983da31e-9289-428f-97a0-c8aacd48d039 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:04.289795 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fc150-77ee-42bd-98fa-f3eb75a7d29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:04.290682 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fc150-77ee-42bd-98fa-f3eb75a7d29c admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:04.290962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fc150-77ee-42bd-98fa-f3eb75a7d29c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:04.291233 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fc150-77ee-42bd-98fa-f3eb75a7d29c admin admin] PATH_INFO: `/v3/projects/9a4b5daa13d24edf9cc04982fdc996cf/users/41903997c91744069e982c731f20854c/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:04.293256 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fc150-77ee-42bd-98fa-f3eb75a7d29c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4b5daa13d24edf9cc04982fdc996cf, user_id=41903997c91744069e982c731f20854c, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:04.295887 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fc150-77ee-42bd-98fa-f3eb75a7d29c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:04.305976 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1211/2432] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:54:04 2022] PUT /identity/v3/projects/9a4b5daa13d24edf9cc04982fdc996cf/users/41903997c91744069e982c731f20854c/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:54:04.316996 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb927f4-4f6f-45c4-80b6-3392bbd277e4 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:04.317283 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb927f4-4f6f-45c4-80b6-3392bbd277e4 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:04.317564 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb927f4-4f6f-45c4-80b6-3392bbd277e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:04.343623 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-6fb927f4-4f6f-45c4-80b6-3392bbd277e4 None None] MFA Rules not processed for user `41903997c91744069e982c731f20854c`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:04.344818 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-6fb927f4-4f6f-45c4-80b6-3392bbd277e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:04.357526 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732e540-4c10-4fac-9633-b017d0fda816 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:04.357816 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732e540-4c10-4fac-9633-b017d0fda816 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:04.358093 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732e540-4c10-4fac-9633-b017d0fda816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:04.375461 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-0732e540-4c10-4fac-9633-b017d0fda816 None None] MFA Rules not processed for user `b2d11897809b4e388b063bb512e0be33`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:04.376645 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-0732e540-4c10-4fac-9633-b017d0fda816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:04.412224 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1222/2433] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:04.421864 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb927f4-4f6f-45c4-80b6-3392bbd277e4 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:04.423173 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-6fb927f4-4f6f-45c4-80b6-3392bbd277e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:04.430188 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1212/2434] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:04.482260 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb927f4-4f6f-45c4-80b6-3392bbd277e4 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:04.486024 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a88ab5-5cd4-461f-8b2b-517a6f20fb50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:04.486665 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a88ab5-5cd4-461f-8b2b-517a6f20fb50 service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:04.486969 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a88ab5-5cd4-461f-8b2b-517a6f20fb50 service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:04.487238 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a88ab5-5cd4-461f-8b2b-517a6f20fb50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:04.496483 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a88ab5-5cd4-461f-8b2b-517a6f20fb50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:04.497973 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a88ab5-5cd4-461f-8b2b-517a6f20fb50 service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:04.507337 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1223/2435] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:54:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:54:04.971576 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732e540-4c10-4fac-9633-b017d0fda816 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:04.972974 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-0732e540-4c10-4fac-9633-b017d0fda816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:04.985937 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732e540-4c10-4fac-9633-b017d0fda816 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:04.993044 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006addd-46a5-489a-947d-cefc48288b22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:04.993825 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006addd-46a5-489a-947d-cefc48288b22 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:04.994170 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006addd-46a5-489a-947d-cefc48288b22 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:04.994508 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006addd-46a5-489a-947d-cefc48288b22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:05.053462 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006addd-46a5-489a-947d-cefc48288b22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:05.055068 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006addd-46a5-489a-947d-cefc48288b22 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:05.066350 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1213/2436] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:54:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:54:09.056478 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a88ab5-5cd4-461f-8b2b-517a6f20fb50 service cinder] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:09.065079 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a88ab5-5cd4-461f-8b2b-517a6f20fb50 service cinder] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:09.068977 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a9cc2-4abe-4997-b466-53444f58c7b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:09.069605 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a9cc2-4abe-4997-b466-53444f58c7b2 service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:09.069885 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a9cc2-4abe-4997-b466-53444f58c7b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:09.070148 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a9cc2-4abe-4997-b466-53444f58c7b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:09.140117 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a9cc2-4abe-4997-b466-53444f58c7b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:09.141729 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a9cc2-4abe-4997-b466-53444f58c7b2 service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:09.151121 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1224/2437] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:54:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:54:11.527315 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006addd-46a5-489a-947d-cefc48288b22 service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:11.669259 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006addd-46a5-489a-947d-cefc48288b22 service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:11.675997 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2697d-fa86-451a-945f-5058a2f81c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:11.677505 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2697d-fa86-451a-945f-5058a2f81c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:11.677929 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2697d-fa86-451a-945f-5058a2f81c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:11.678080 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2697d-fa86-451a-945f-5058a2f81c13 admin admin] PATH_INFO: `/v3/users/de1ca1ce87874a5c81581dc3d778dae9` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:11.679314 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2697d-fa86-451a-945f-5058a2f81c13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de1ca1ce87874a5c81581dc3d778dae9)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:11.681461 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2697d-fa86-451a-945f-5058a2f81c13 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:11.758810 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-52b2697d-fa86-451a-945f-5058a2f81c13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de1ca1ce87874a5c81581dc3d778dae9'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:11.782749 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-52b2697d-fa86-451a-945f-5058a2f81c13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de1ca1ce87874a5c81581dc3d778dae9'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:11.792109 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-52b2697d-fa86-451a-945f-5058a2f81c13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de1ca1ce87874a5c81581dc3d778dae9'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:11.804163 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-52b2697d-fa86-451a-945f-5058a2f81c13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de1ca1ce87874a5c81581dc3d778dae9'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:11.805014 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-52b2697d-fa86-451a-945f-5058a2f81c13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de1ca1ce87874a5c81581dc3d778dae9'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:11.819858 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1214/2438] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:54:11 2022] DELETE /identity/v3/users/de1ca1ce87874a5c81581dc3d778dae9 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:11.821729 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9961a8-9703-4fe4-b165-b1c70b472297 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:11.822615 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9961a8-9703-4fe4-b165-b1c70b472297 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:11.823148 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9961a8-9703-4fe4-b165-b1c70b472297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:11.867663 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-7f9961a8-9703-4fe4-b165-b1c70b472297 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:11.872292 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-7f9961a8-9703-4fe4-b165-b1c70b472297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:12.004983 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1225/2439] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:12.017875 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2697d-fa86-451a-945f-5058a2f81c13 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:12.020055 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-52b2697d-fa86-451a-945f-5058a2f81c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:12.124156 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2697d-fa86-451a-945f-5058a2f81c13 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:12.128835 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603ad70-1006-4e6e-bcc4-e12d08d5d8ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:12.129530 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603ad70-1006-4e6e-bcc4-e12d08d5d8ad service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:12.129808 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603ad70-1006-4e6e-bcc4-e12d08d5d8ad service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:12.130084 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603ad70-1006-4e6e-bcc4-e12d08d5d8ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:12.141886 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603ad70-1006-4e6e-bcc4-e12d08d5d8ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:12.143355 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603ad70-1006-4e6e-bcc4-e12d08d5d8ad service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:12.156698 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1215/2440] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:54:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:54:12.638725 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9961a8-9703-4fe4-b165-b1c70b472297 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:12.640254 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-7f9961a8-9703-4fe4-b165-b1c70b472297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:12.655466 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9961a8-9703-4fe4-b165-b1c70b472297 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:12.678367 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02669d0-ca0e-4e09-80d1-c30910eea2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:12.679953 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02669d0-ca0e-4e09-80d1-c30910eea2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:12.681343 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02669d0-ca0e-4e09-80d1-c30910eea2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:12.681807 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02669d0-ca0e-4e09-80d1-c30910eea2e5 admin admin] PATH_INFO: `/v3/projects/4fb64f1baac340aa89b06a99e8d4d5e7` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:12.683235 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02669d0-ca0e-4e09-80d1-c30910eea2e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fb64f1baac340aa89b06a99e8d4d5e7)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:12.687535 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02669d0-ca0e-4e09-80d1-c30910eea2e5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:12.754521 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f02669d0-ca0e-4e09-80d1-c30910eea2e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fb64f1baac340aa89b06a99e8d4d5e7', 'request_id': 'req-f02669d0-ca0e-4e09-80d1-c30910eea2e5'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:12.769218 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f02669d0-ca0e-4e09-80d1-c30910eea2e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fb64f1baac340aa89b06a99e8d4d5e7', 'request_id': 'req-f02669d0-ca0e-4e09-80d1-c30910eea2e5'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:12.796690 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f02669d0-ca0e-4e09-80d1-c30910eea2e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fb64f1baac340aa89b06a99e8d4d5e7', 'request_id': 'req-f02669d0-ca0e-4e09-80d1-c30910eea2e5'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:12.812692 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f02669d0-ca0e-4e09-80d1-c30910eea2e5 admin admin] The token cache is being invalidate because project 4fb64f1baac340aa89b06a99e8d4d5e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:54:12.813134 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f02669d0-ca0e-4e09-80d1-c30910eea2e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:12.813798 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f02669d0-ca0e-4e09-80d1-c30910eea2e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:12.816893 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1226/2441] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:54:12 2022] DELETE /identity/v3/projects/4fb64f1baac340aa89b06a99e8d4d5e7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:12.821029 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603ad70-1006-4e6e-bcc4-e12d08d5d8ad service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:12.832754 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603ad70-1006-4e6e-bcc4-e12d08d5d8ad service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:12.921187 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8aeb34-92bd-4055-9408-8a848b391c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:12.923035 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8aeb34-92bd-4055-9408-8a848b391c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:12.923712 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8aeb34-92bd-4055-9408-8a848b391c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:12.924194 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8aeb34-92bd-4055-9408-8a848b391c3b admin admin] PATH_INFO: `/v3/users/2e3f4afda81d4838aa863880ddf9a1d5` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:12.926217 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8aeb34-92bd-4055-9408-8a848b391c3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e3f4afda81d4838aa863880ddf9a1d5)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:12.932254 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8aeb34-92bd-4055-9408-8a848b391c3b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:13.009463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-9b8aeb34-92bd-4055-9408-8a848b391c3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e3f4afda81d4838aa863880ddf9a1d5'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:13.024116 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-9b8aeb34-92bd-4055-9408-8a848b391c3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e3f4afda81d4838aa863880ddf9a1d5'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:13.031659 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-9b8aeb34-92bd-4055-9408-8a848b391c3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e3f4afda81d4838aa863880ddf9a1d5'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:13.046975 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-9b8aeb34-92bd-4055-9408-8a848b391c3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e3f4afda81d4838aa863880ddf9a1d5'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:13.048090 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-9b8aeb34-92bd-4055-9408-8a848b391c3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e3f4afda81d4838aa863880ddf9a1d5'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:13.056641 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1216/2442] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:54:12 2022] DELETE /identity/v3/users/2e3f4afda81d4838aa863880ddf9a1d5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:13.510221 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02669d0-ca0e-4e09-80d1-c30910eea2e5 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:13.511747 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f02669d0-ca0e-4e09-80d1-c30910eea2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:13.528268 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02669d0-ca0e-4e09-80d1-c30910eea2e5 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:13.606840 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e840c8c-b939-454f-95ab-345734e94811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:13.607912 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e840c8c-b939-454f-95ab-345734e94811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:13.608306 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e840c8c-b939-454f-95ab-345734e94811 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:13.608646 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e840c8c-b939-454f-95ab-345734e94811 admin admin] PATH_INFO: `/v3/projects/c2eb14a5b4fc40e38b05e8eb7a7d22d4` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:13.610026 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e840c8c-b939-454f-95ab-345734e94811 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2eb14a5b4fc40e38b05e8eb7a7d22d4)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:13.612119 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e840c8c-b939-454f-95ab-345734e94811 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:13.683376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2e840c8c-b939-454f-95ab-345734e94811 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2eb14a5b4fc40e38b05e8eb7a7d22d4', 'request_id': 'req-2e840c8c-b939-454f-95ab-345734e94811'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:13.690705 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2e840c8c-b939-454f-95ab-345734e94811 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2eb14a5b4fc40e38b05e8eb7a7d22d4', 'request_id': 'req-2e840c8c-b939-454f-95ab-345734e94811'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:13.707731 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2e840c8c-b939-454f-95ab-345734e94811 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2eb14a5b4fc40e38b05e8eb7a7d22d4', 'request_id': 'req-2e840c8c-b939-454f-95ab-345734e94811'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:13.724781 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2e840c8c-b939-454f-95ab-345734e94811 admin admin] The token cache is being invalidate because project c2eb14a5b4fc40e38b05e8eb7a7d22d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:54:13.725206 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2e840c8c-b939-454f-95ab-345734e94811 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:13.726117 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2e840c8c-b939-454f-95ab-345734e94811 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:13.728053 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1227/2443] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:54:13 2022] DELETE /identity/v3/projects/c2eb14a5b4fc40e38b05e8eb7a7d22d4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:13.736457 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8aeb34-92bd-4055-9408-8a848b391c3b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:13.738455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-9b8aeb34-92bd-4055-9408-8a848b391c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:13.753666 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8aeb34-92bd-4055-9408-8a848b391c3b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:13.820026 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2235b0e-11f6-4af6-96cc-3459fc85818a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:13.820985 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2235b0e-11f6-4af6-96cc-3459fc85818a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:13.821278 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2235b0e-11f6-4af6-96cc-3459fc85818a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:13.821860 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2235b0e-11f6-4af6-96cc-3459fc85818a admin admin] PATH_INFO: `/v3/users/41903997c91744069e982c731f20854c` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:13.822994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2235b0e-11f6-4af6-96cc-3459fc85818a admin admin] RBAC: Authorizing `identity:delete_user(user_id=41903997c91744069e982c731f20854c)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:13.834136 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2235b0e-11f6-4af6-96cc-3459fc85818a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:13.889566 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d2235b0e-11f6-4af6-96cc-3459fc85818a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41903997c91744069e982c731f20854c'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:13.907727 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d2235b0e-11f6-4af6-96cc-3459fc85818a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41903997c91744069e982c731f20854c'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:13.914406 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d2235b0e-11f6-4af6-96cc-3459fc85818a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41903997c91744069e982c731f20854c'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:13.923094 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d2235b0e-11f6-4af6-96cc-3459fc85818a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41903997c91744069e982c731f20854c'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:13.923726 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d2235b0e-11f6-4af6-96cc-3459fc85818a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41903997c91744069e982c731f20854c'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:13.930306 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1217/2444] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:54:13 2022] DELETE /identity/v3/users/41903997c91744069e982c731f20854c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:14.204788 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e840c8c-b939-454f-95ab-345734e94811 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:14.206664 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-2e840c8c-b939-454f-95ab-345734e94811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:14.228109 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e840c8c-b939-454f-95ab-345734e94811 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:14.286804 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68be6ff-ea68-49cb-bea8-3843a8be5ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:14.287673 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68be6ff-ea68-49cb-bea8-3843a8be5ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:14.287955 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68be6ff-ea68-49cb-bea8-3843a8be5ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:14.288604 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68be6ff-ea68-49cb-bea8-3843a8be5ae7 admin admin] PATH_INFO: `/v3/projects/9a4b5daa13d24edf9cc04982fdc996cf` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:14.289521 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68be6ff-ea68-49cb-bea8-3843a8be5ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a4b5daa13d24edf9cc04982fdc996cf)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:14.291438 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68be6ff-ea68-49cb-bea8-3843a8be5ae7 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:14.339633 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a68be6ff-ea68-49cb-bea8-3843a8be5ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a4b5daa13d24edf9cc04982fdc996cf', 'request_id': 'req-a68be6ff-ea68-49cb-bea8-3843a8be5ae7'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:14.346450 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a68be6ff-ea68-49cb-bea8-3843a8be5ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a4b5daa13d24edf9cc04982fdc996cf', 'request_id': 'req-a68be6ff-ea68-49cb-bea8-3843a8be5ae7'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:14.355929 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a68be6ff-ea68-49cb-bea8-3843a8be5ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a4b5daa13d24edf9cc04982fdc996cf', 'request_id': 'req-a68be6ff-ea68-49cb-bea8-3843a8be5ae7'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:14.369779 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a68be6ff-ea68-49cb-bea8-3843a8be5ae7 admin admin] The token cache is being invalidate because project 9a4b5daa13d24edf9cc04982fdc996cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:54:14.370075 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a68be6ff-ea68-49cb-bea8-3843a8be5ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:14.370926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a68be6ff-ea68-49cb-bea8-3843a8be5ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:14.372564 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1228/2445] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:54:14 2022] DELETE /identity/v3/projects/9a4b5daa13d24edf9cc04982fdc996cf => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:14.380202 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bee6d-3a2d-4359-ae56-ddb0ded42b86 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:14.380202 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bee6d-3a2d-4359-ae56-ddb0ded42b86 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:14.380381 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bee6d-3a2d-4359-ae56-ddb0ded42b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:14.403044 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-e13bee6d-3a2d-4359-ae56-ddb0ded42b86 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:14.404399 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-e13bee6d-3a2d-4359-ae56-ddb0ded42b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:14.460795 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4ebc4-392a-4a69-9589-60b70b11e0c6 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:14.461174 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4ebc4-392a-4a69-9589-60b70b11e0c6 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:14.461544 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4ebc4-392a-4a69-9589-60b70b11e0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:14.462829 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1218/2446] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:14.471247 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc853f81-65f9-4603-8fd9-d49e2d6b4d41 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:14.471553 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc853f81-65f9-4603-8fd9-d49e2d6b4d41 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:14.471852 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc853f81-65f9-4603-8fd9-d49e2d6b4d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:14.480026 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-ade4ebc4-392a-4a69-9589-60b70b11e0c6 None None] MFA Rules not processed for user `d0e34ddaca124f638fdf8e43fbb08437`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:14.481442 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-ade4ebc4-392a-4a69-9589-60b70b11e0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:14.491044 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-cc853f81-65f9-4603-8fd9-d49e2d6b4d41 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:14.492200 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-cc853f81-65f9-4603-8fd9-d49e2d6b4d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:14.500923 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1219/2447] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:54:14.504978 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc853f81-65f9-4603-8fd9-d49e2d6b4d41 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:14.514047 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc853f81-65f9-4603-8fd9-d49e2d6b4d41 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:14.518996 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff1bd1-55a5-4f6d-a05e-02c674d5acef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:14.519630 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff1bd1-55a5-4f6d-a05e-02c674d5acef admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:14.519910 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff1bd1-55a5-4f6d-a05e-02c674d5acef admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:14.520172 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff1bd1-55a5-4f6d-a05e-02c674d5acef admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:14.520942 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff1bd1-55a5-4f6d-a05e-02c674d5acef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:54:14.521244 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff1bd1-55a5-4f6d-a05e-02c674d5acef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:14.522834 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff1bd1-55a5-4f6d-a05e-02c674d5acef admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:14.536996 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1220/2448] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:54:14.541267 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff1bd1-55a5-4f6d-a05e-02c674d5acef admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:14.550084 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1229/2449] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:14.551605 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff1bd1-55a5-4f6d-a05e-02c674d5acef admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:14.556781 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f69ce-b666-4a40-bd7a-b357400579d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:14.557538 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f69ce-b666-4a40-bd7a-b357400579d5 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:14.557886 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f69ce-b666-4a40-bd7a-b357400579d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:14.558226 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f69ce-b666-4a40-bd7a-b357400579d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:14.559005 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f69ce-b666-4a40-bd7a-b357400579d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:14.561137 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f69ce-b666-4a40-bd7a-b357400579d5 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:14.588895 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1221/2450] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:54:14 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:54:14.592113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4ebc4-392a-4a69-9589-60b70b11e0c6 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:14.602703 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4ebc4-392a-4a69-9589-60b70b11e0c6 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:14.671740 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5fa47-925c-4641-a899-31ff201f1e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:14.672769 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5fa47-925c-4641-a899-31ff201f1e33 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:14.672981 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5fa47-925c-4641-a899-31ff201f1e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:14.673519 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5fa47-925c-4641-a899-31ff201f1e33 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:14.674327 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5fa47-925c-4641-a899-31ff201f1e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:14.676484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5fa47-925c-4641-a899-31ff201f1e33 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:14.701408 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1230/2451] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:54:14 2022] POST /identity/v3/users => generated 301 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:54:14.705636 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f69ce-b666-4a40-bd7a-b357400579d5 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:14.720023 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f69ce-b666-4a40-bd7a-b357400579d5 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:14.722653 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f874b3-5075-4fa5-babf-7977fc5172b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:14.723345 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f874b3-5075-4fa5-babf-7977fc5172b5 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:14.723765 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f874b3-5075-4fa5-babf-7977fc5172b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:14.725037 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f874b3-5075-4fa5-babf-7977fc5172b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:14.725877 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f874b3-5075-4fa5-babf-7977fc5172b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:14.727553 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f874b3-5075-4fa5-babf-7977fc5172b5 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:14.739101 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1222/2452] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:54:14.743147 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5fa47-925c-4641-a899-31ff201f1e33 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:14.753416 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5fa47-925c-4641-a899-31ff201f1e33 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:14.758556 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1933e9d-5f7f-41c5-a761-0e9bdb2c541d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:14.759326 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1933e9d-5f7f-41c5-a761-0e9bdb2c541d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:14.759707 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1933e9d-5f7f-41c5-a761-0e9bdb2c541d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:14.760081 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1933e9d-5f7f-41c5-a761-0e9bdb2c541d admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:14.760957 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1933e9d-5f7f-41c5-a761-0e9bdb2c541d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:14.762637 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1933e9d-5f7f-41c5-a761-0e9bdb2c541d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:14.785115 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1231/2453] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:54:14.786286 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f874b3-5075-4fa5-babf-7977fc5172b5 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:14.796590 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f874b3-5075-4fa5-babf-7977fc5172b5 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:14.802625 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb67aa-37db-4deb-bd7f-ddbf4c282753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:14.803750 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb67aa-37db-4deb-bd7f-ddbf4c282753 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:14.804031 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb67aa-37db-4deb-bd7f-ddbf4c282753 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:14.804306 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb67aa-37db-4deb-bd7f-ddbf4c282753 admin admin] PATH_INFO: `/v3/projects/3affa3f548e1442d93a40e374377eae3/users/e964f46d98924419a63f6c183d56bd59/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:14.819608 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb67aa-37db-4deb-bd7f-ddbf4c282753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3affa3f548e1442d93a40e374377eae3, user_id=e964f46d98924419a63f6c183d56bd59, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:14.822835 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb67aa-37db-4deb-bd7f-ddbf4c282753 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:14.837528 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1223/2454] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:54:14 2022] PUT /identity/v3/projects/3affa3f548e1442d93a40e374377eae3/users/e964f46d98924419a63f6c183d56bd59/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:54:14.849018 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b9230-a954-4678-97ec-1ff64ab202e3 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:14.849575 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b9230-a954-4678-97ec-1ff64ab202e3 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:14.849926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b9230-a954-4678-97ec-1ff64ab202e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:14.884138 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-1e2b9230-a954-4678-97ec-1ff64ab202e3 None None] MFA Rules not processed for user `e964f46d98924419a63f6c183d56bd59`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:14.884138 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-1e2b9230-a954-4678-97ec-1ff64ab202e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:14.999148 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1232/2455] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:54:15.003203 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb67aa-37db-4deb-bd7f-ddbf4c282753 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:15.079414 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb67aa-37db-4deb-bd7f-ddbf4c282753 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:15.084130 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21723a8-fc2b-41db-9e95-aa063d33f1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:15.084799 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21723a8-fc2b-41db-9e95-aa063d33f1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:15.085116 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21723a8-fc2b-41db-9e95-aa063d33f1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:15.085395 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21723a8-fc2b-41db-9e95-aa063d33f1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:15.086113 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21723a8-fc2b-41db-9e95-aa063d33f1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:15.088090 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21723a8-fc2b-41db-9e95-aa063d33f1a8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:15.119857 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1224/2456] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:54:15 2022] POST /identity/v3/projects => generated 399 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:54:15.121668 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b9230-a954-4678-97ec-1ff64ab202e3 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:15.132906 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b9230-a954-4678-97ec-1ff64ab202e3 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:15.196885 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc960b-3c10-4029-ad86-6385b68f6565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:15.198053 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc960b-3c10-4029-ad86-6385b68f6565 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:15.198477 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc960b-3c10-4029-ad86-6385b68f6565 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:15.198854 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc960b-3c10-4029-ad86-6385b68f6565 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:15.199685 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc960b-3c10-4029-ad86-6385b68f6565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:15.202225 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc960b-3c10-4029-ad86-6385b68f6565 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:15.227532 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1233/2457] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:54:15 2022] POST /identity/v3/users => generated 306 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:54:15.231669 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21723a8-fc2b-41db-9e95-aa063d33f1a8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:15.242223 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21723a8-fc2b-41db-9e95-aa063d33f1a8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:15.255954 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc1828-075d-47a7-a050-3fc66651c18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:15.258343 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc1828-075d-47a7-a050-3fc66651c18e admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:15.259061 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc1828-075d-47a7-a050-3fc66651c18e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:15.259709 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc1828-075d-47a7-a050-3fc66651c18e admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:15.261486 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc1828-075d-47a7-a050-3fc66651c18e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:15.265692 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc1828-075d-47a7-a050-3fc66651c18e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:15.302761 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1225/2458] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:54:15.307161 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc960b-3c10-4029-ad86-6385b68f6565 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:15.320648 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc960b-3c10-4029-ad86-6385b68f6565 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:15.330971 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63403c1e-622e-43cb-90e6-597033bfa1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:15.331883 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63403c1e-622e-43cb-90e6-597033bfa1b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:15.332360 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63403c1e-622e-43cb-90e6-597033bfa1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:15.332683 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63403c1e-622e-43cb-90e6-597033bfa1b4 admin admin] PATH_INFO: `/v3/projects/c59df77423704c60b298119f401bbd34/users/a6b51cb7285f42f5bd9d5c62f606346d/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:15.366283 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63403c1e-622e-43cb-90e6-597033bfa1b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c59df77423704c60b298119f401bbd34, user_id=a6b51cb7285f42f5bd9d5c62f606346d, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:15.368926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63403c1e-622e-43cb-90e6-597033bfa1b4 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:15.383454 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1234/2459] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:54:15 2022] PUT /identity/v3/projects/c59df77423704c60b298119f401bbd34/users/a6b51cb7285f42f5bd9d5c62f606346d/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:15.387317 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc1828-075d-47a7-a050-3fc66651c18e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:15.397636 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc1828-075d-47a7-a050-3fc66651c18e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:15.456444 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520f1e7-4e59-45ab-af22-b3e40f6d2891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:15.457199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520f1e7-4e59-45ab-af22-b3e40f6d2891 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:15.457600 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520f1e7-4e59-45ab-af22-b3e40f6d2891 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:15.457879 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520f1e7-4e59-45ab-af22-b3e40f6d2891 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:15.458638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520f1e7-4e59-45ab-af22-b3e40f6d2891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:15.460407 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520f1e7-4e59-45ab-af22-b3e40f6d2891 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:15.471368 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1226/2460] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:54:15.475015 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63403c1e-622e-43cb-90e6-597033bfa1b4 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:15.485447 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63403c1e-622e-43cb-90e6-597033bfa1b4 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:15.490279 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd165c86-3977-4057-9ff2-c58853e162e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:15.491186 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd165c86-3977-4057-9ff2-c58853e162e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:15.491530 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd165c86-3977-4057-9ff2-c58853e162e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:15.491723 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd165c86-3977-4057-9ff2-c58853e162e3 admin admin] PATH_INFO: `/v3/projects/c59df77423704c60b298119f401bbd34/users/a6b51cb7285f42f5bd9d5c62f606346d/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:15.493910 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd165c86-3977-4057-9ff2-c58853e162e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c59df77423704c60b298119f401bbd34, user_id=a6b51cb7285f42f5bd9d5c62f606346d, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:15.496829 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd165c86-3977-4057-9ff2-c58853e162e3 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:15.508152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1235/2461] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:54:15 2022] PUT /identity/v3/projects/c59df77423704c60b298119f401bbd34/users/a6b51cb7285f42f5bd9d5c62f606346d/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:54:15.520726 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6986866-cde8-4ae3-9f6b-45b843bb77da None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:15.520834 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6986866-cde8-4ae3-9f6b-45b843bb77da None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:15.521118 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6986866-cde8-4ae3-9f6b-45b843bb77da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:15.548885 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-e6986866-cde8-4ae3-9f6b-45b843bb77da None None] MFA Rules not processed for user `a6b51cb7285f42f5bd9d5c62f606346d`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:15.550138 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-e6986866-cde8-4ae3-9f6b-45b843bb77da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:15.642674 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1227/2462] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:15 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:15.653734 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd165c86-3977-4057-9ff2-c58853e162e3 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:15.655705 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-cd165c86-3977-4057-9ff2-c58853e162e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:15.729705 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd165c86-3977-4057-9ff2-c58853e162e3 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:15.734936 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fb106-1858-44e0-a53a-5d4415a9593b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:15.735955 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fb106-1858-44e0-a53a-5d4415a9593b service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:15.736845 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fb106-1858-44e0-a53a-5d4415a9593b service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:15.736845 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fb106-1858-44e0-a53a-5d4415a9593b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:15.755293 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fb106-1858-44e0-a53a-5d4415a9593b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:15.756693 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fb106-1858-44e0-a53a-5d4415a9593b service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:15.767074 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1236/2463] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:54:15 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:54:15.849795 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6986866-cde8-4ae3-9f6b-45b843bb77da None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:15.860021 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6986866-cde8-4ae3-9f6b-45b843bb77da None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:15.863654 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d6666-45ba-40d6-8a66-c1a4bebddb99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:15.864296 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d6666-45ba-40d6-8a66-c1a4bebddb99 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:15.864578 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d6666-45ba-40d6-8a66-c1a4bebddb99 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:15.864977 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d6666-45ba-40d6-8a66-c1a4bebddb99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:15.931724 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d6666-45ba-40d6-8a66-c1a4bebddb99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:15.933268 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d6666-45ba-40d6-8a66-c1a4bebddb99 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:15.942190 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1228/2464] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:54:15 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:54:20.063287 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fb106-1858-44e0-a53a-5d4415a9593b service cinder] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:20.124243 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fb106-1858-44e0-a53a-5d4415a9593b service cinder] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:20.128960 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41c19e-4ef0-43b7-aea2-bbe6f8e2ff12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:20.129834 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41c19e-4ef0-43b7-aea2-bbe6f8e2ff12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:20.130116 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41c19e-4ef0-43b7-aea2-bbe6f8e2ff12 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:20.130392 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41c19e-4ef0-43b7-aea2-bbe6f8e2ff12 admin admin] PATH_INFO: `/v3/users/e964f46d98924419a63f6c183d56bd59` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:20.131667 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41c19e-4ef0-43b7-aea2-bbe6f8e2ff12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e964f46d98924419a63f6c183d56bd59)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:20.133775 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41c19e-4ef0-43b7-aea2-bbe6f8e2ff12 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:20.183590 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ce41c19e-4ef0-43b7-aea2-bbe6f8e2ff12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e964f46d98924419a63f6c183d56bd59'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:20.184237 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ce41c19e-4ef0-43b7-aea2-bbe6f8e2ff12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e964f46d98924419a63f6c183d56bd59'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:20.184830 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ce41c19e-4ef0-43b7-aea2-bbe6f8e2ff12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e964f46d98924419a63f6c183d56bd59'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:20.196970 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ce41c19e-4ef0-43b7-aea2-bbe6f8e2ff12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e964f46d98924419a63f6c183d56bd59'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:20.205930 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-ce41c19e-4ef0-43b7-aea2-bbe6f8e2ff12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e964f46d98924419a63f6c183d56bd59'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:20.223007 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1237/2465] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:54:20 2022] DELETE /identity/v3/users/e964f46d98924419a63f6c183d56bd59 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:20.228299 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f24e9-d6c6-4b83-bbbd-7e8d33504705 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:20.228832 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f24e9-d6c6-4b83-bbbd-7e8d33504705 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:20.229061 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f24e9-d6c6-4b83-bbbd-7e8d33504705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:20.247274 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-9c0f24e9-d6c6-4b83-bbbd-7e8d33504705 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:20.248553 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-9c0f24e9-d6c6-4b83-bbbd-7e8d33504705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:20.307113 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1229/2466] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:20.318705 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41c19e-4ef0-43b7-aea2-bbe6f8e2ff12 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:20.320381 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-ce41c19e-4ef0-43b7-aea2-bbe6f8e2ff12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:20.377659 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41c19e-4ef0-43b7-aea2-bbe6f8e2ff12 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:20.381467 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4978ee-cd41-4bbe-8d4e-77b47b1a339f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:20.382150 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4978ee-cd41-4bbe-8d4e-77b47b1a339f service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:20.382433 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4978ee-cd41-4bbe-8d4e-77b47b1a339f service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:20.382713 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4978ee-cd41-4bbe-8d4e-77b47b1a339f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:20.391548 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4978ee-cd41-4bbe-8d4e-77b47b1a339f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:20.393002 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4978ee-cd41-4bbe-8d4e-77b47b1a339f service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:20.402406 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1238/2467] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:54:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:54:20.678538 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f24e9-d6c6-4b83-bbbd-7e8d33504705 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:20.680075 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-9c0f24e9-d6c6-4b83-bbbd-7e8d33504705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:20.696490 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f24e9-d6c6-4b83-bbbd-7e8d33504705 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:20.703240 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccf2db-724c-4299-a985-d73c0f6a5b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:20.704412 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccf2db-724c-4299-a985-d73c0f6a5b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:20.704802 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccf2db-724c-4299-a985-d73c0f6a5b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:20.705293 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccf2db-724c-4299-a985-d73c0f6a5b24 admin admin] PATH_INFO: `/v3/projects/3affa3f548e1442d93a40e374377eae3` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:20.706587 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bccf2db-724c-4299-a985-d73c0f6a5b24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3affa3f548e1442d93a40e374377eae3)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:20.708552 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bccf2db-724c-4299-a985-d73c0f6a5b24 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:20.756033 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1bccf2db-724c-4299-a985-d73c0f6a5b24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3affa3f548e1442d93a40e374377eae3', 'request_id': 'req-1bccf2db-724c-4299-a985-d73c0f6a5b24'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:20.762075 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1bccf2db-724c-4299-a985-d73c0f6a5b24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3affa3f548e1442d93a40e374377eae3', 'request_id': 'req-1bccf2db-724c-4299-a985-d73c0f6a5b24'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:20.771275 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1bccf2db-724c-4299-a985-d73c0f6a5b24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3affa3f548e1442d93a40e374377eae3', 'request_id': 'req-1bccf2db-724c-4299-a985-d73c0f6a5b24'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:20.782390 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1bccf2db-724c-4299-a985-d73c0f6a5b24 admin admin] The token cache is being invalidate because project 3affa3f548e1442d93a40e374377eae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:54:20.782677 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1bccf2db-724c-4299-a985-d73c0f6a5b24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:20.783317 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1bccf2db-724c-4299-a985-d73c0f6a5b24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:20.784880 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1230/2468] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:54:20 2022] DELETE /identity/v3/projects/3affa3f548e1442d93a40e374377eae3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:20.790795 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4978ee-cd41-4bbe-8d4e-77b47b1a339f service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:20.804826 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4978ee-cd41-4bbe-8d4e-77b47b1a339f service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:20.866363 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d9a1a-9173-433e-a90f-ba49d045088f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:20.867223 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d9a1a-9173-433e-a90f-ba49d045088f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:20.867502 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d9a1a-9173-433e-a90f-ba49d045088f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:20.867777 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d9a1a-9173-433e-a90f-ba49d045088f admin admin] PATH_INFO: `/v3/users/a6b51cb7285f42f5bd9d5c62f606346d` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:20.869047 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d9a1a-9173-433e-a90f-ba49d045088f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b51cb7285f42f5bd9d5c62f606346d)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:20.870975 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d9a1a-9173-433e-a90f-ba49d045088f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:20.926971 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-387d9a1a-9173-433e-a90f-ba49d045088f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b51cb7285f42f5bd9d5c62f606346d'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:20.927746 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-387d9a1a-9173-433e-a90f-ba49d045088f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b51cb7285f42f5bd9d5c62f606346d'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:20.928693 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-387d9a1a-9173-433e-a90f-ba49d045088f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b51cb7285f42f5bd9d5c62f606346d'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:20.942884 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-387d9a1a-9173-433e-a90f-ba49d045088f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b51cb7285f42f5bd9d5c62f606346d'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:20.949998 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-387d9a1a-9173-433e-a90f-ba49d045088f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b51cb7285f42f5bd9d5c62f606346d'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:20.965571 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1239/2469] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:54:20 2022] DELETE /identity/v3/users/a6b51cb7285f42f5bd9d5c62f606346d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:21.239223 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccf2db-724c-4299-a985-d73c0f6a5b24 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:21.241066 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-1bccf2db-724c-4299-a985-d73c0f6a5b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:21.255618 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccf2db-724c-4299-a985-d73c0f6a5b24 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:21.319209 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19430888-c237-4b89-9dd7-c394935be6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:21.320068 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19430888-c237-4b89-9dd7-c394935be6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:21.320347 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19430888-c237-4b89-9dd7-c394935be6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:21.320615 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19430888-c237-4b89-9dd7-c394935be6c6 admin admin] PATH_INFO: `/v3/projects/c59df77423704c60b298119f401bbd34` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:21.321861 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19430888-c237-4b89-9dd7-c394935be6c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c59df77423704c60b298119f401bbd34)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:21.323754 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19430888-c237-4b89-9dd7-c394935be6c6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:21.369533 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-19430888-c237-4b89-9dd7-c394935be6c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c59df77423704c60b298119f401bbd34', 'request_id': 'req-19430888-c237-4b89-9dd7-c394935be6c6'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:21.379365 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-19430888-c237-4b89-9dd7-c394935be6c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c59df77423704c60b298119f401bbd34', 'request_id': 'req-19430888-c237-4b89-9dd7-c394935be6c6'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:21.387270 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-19430888-c237-4b89-9dd7-c394935be6c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c59df77423704c60b298119f401bbd34', 'request_id': 'req-19430888-c237-4b89-9dd7-c394935be6c6'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:21.399105 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-19430888-c237-4b89-9dd7-c394935be6c6 admin admin] The token cache is being invalidate because project c59df77423704c60b298119f401bbd34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:54:21.399390 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-19430888-c237-4b89-9dd7-c394935be6c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:21.400023 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-19430888-c237-4b89-9dd7-c394935be6c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:21.401626 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1231/2470] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:54:21 2022] DELETE /identity/v3/projects/c59df77423704c60b298119f401bbd34 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:21.407564 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a406c98-87cb-426a-b055-669796e7d8e4 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:21.408027 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a406c98-87cb-426a-b055-669796e7d8e4 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:21.408118 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a406c98-87cb-426a-b055-669796e7d8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:21.425650 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-9a406c98-87cb-426a-b055-669796e7d8e4 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:21.426830 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-9a406c98-87cb-426a-b055-669796e7d8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:21.493523 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1240/2471] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:21.501769 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5263046-f31a-4d12-800e-5fc57345e5e7 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:21.502060 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5263046-f31a-4d12-800e-5fc57345e5e7 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:21.502339 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5263046-f31a-4d12-800e-5fc57345e5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:21.521809 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b5263046-f31a-4d12-800e-5fc57345e5e7 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:21.522987 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b5263046-f31a-4d12-800e-5fc57345e5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:21.532578 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1232/2472] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:21.537379 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a406c98-87cb-426a-b055-669796e7d8e4 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:21.550810 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a406c98-87cb-426a-b055-669796e7d8e4 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:21.557061 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b31b8d-e341-47f0-9dbe-1e2a3c84634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:21.557726 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b31b8d-e341-47f0-9dbe-1e2a3c84634b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:21.558005 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b31b8d-e341-47f0-9dbe-1e2a3c84634b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:21.558280 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b31b8d-e341-47f0-9dbe-1e2a3c84634b admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:21.559026 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b31b8d-e341-47f0-9dbe-1e2a3c84634b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:54:21.559334 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b31b8d-e341-47f0-9dbe-1e2a3c84634b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:21.560977 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b31b8d-e341-47f0-9dbe-1e2a3c84634b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:21.572929 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1241/2473] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:54:21.577154 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5263046-f31a-4d12-800e-5fc57345e5e7 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:21.586551 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5263046-f31a-4d12-800e-5fc57345e5e7 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:21.592804 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9c48e-669b-4bf3-87eb-1c39c2c12c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:21.593666 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9c48e-669b-4bf3-87eb-1c39c2c12c1d admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:21.594061 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9c48e-669b-4bf3-87eb-1c39c2c12c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:21.594327 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9c48e-669b-4bf3-87eb-1c39c2c12c1d admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:21.595238 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9c48e-669b-4bf3-87eb-1c39c2c12c1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:21.597602 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9c48e-669b-4bf3-87eb-1c39c2c12c1d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:21.630137 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1233/2474] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:54:21 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:54:21.631309 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b31b8d-e341-47f0-9dbe-1e2a3c84634b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:21.641407 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b31b8d-e341-47f0-9dbe-1e2a3c84634b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:21.699970 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55fa57-eaf0-4689-892b-26fe90b268f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:21.700742 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55fa57-eaf0-4689-892b-26fe90b268f6 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:21.701144 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55fa57-eaf0-4689-892b-26fe90b268f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:21.701345 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55fa57-eaf0-4689-892b-26fe90b268f6 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:21.702096 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55fa57-eaf0-4689-892b-26fe90b268f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:21.704149 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55fa57-eaf0-4689-892b-26fe90b268f6 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:21.726249 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1242/2475] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:54:21 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:54:21.730775 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9c48e-669b-4bf3-87eb-1c39c2c12c1d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:21.741247 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9c48e-669b-4bf3-87eb-1c39c2c12c1d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:21.746066 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f56d60-4749-4210-aa77-faf3c542f671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:21.746676 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f56d60-4749-4210-aa77-faf3c542f671 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:21.746953 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f56d60-4749-4210-aa77-faf3c542f671 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:21.747226 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f56d60-4749-4210-aa77-faf3c542f671 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:21.747968 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f56d60-4749-4210-aa77-faf3c542f671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:21.749623 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f56d60-4749-4210-aa77-faf3c542f671 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:21.759911 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1234/2476] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:54:21.763946 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55fa57-eaf0-4689-892b-26fe90b268f6 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:21.774461 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55fa57-eaf0-4689-892b-26fe90b268f6 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:21.779326 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0d52d-35d6-4be6-844d-14b3d14ca216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:21.779990 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0d52d-35d6-4be6-844d-14b3d14ca216 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:21.780307 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0d52d-35d6-4be6-844d-14b3d14ca216 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:21.780579 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0d52d-35d6-4be6-844d-14b3d14ca216 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:21.781353 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0d52d-35d6-4be6-844d-14b3d14ca216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:21.782995 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0d52d-35d6-4be6-844d-14b3d14ca216 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:21.792948 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1243/2477] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:54:21.797157 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f56d60-4749-4210-aa77-faf3c542f671 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:21.809347 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f56d60-4749-4210-aa77-faf3c542f671 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:21.815385 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b443c-42dc-4469-b55a-8e5e9deab84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:21.816321 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b443c-42dc-4469-b55a-8e5e9deab84f admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:21.816607 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b443c-42dc-4469-b55a-8e5e9deab84f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:21.816913 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b443c-42dc-4469-b55a-8e5e9deab84f admin admin] PATH_INFO: `/v3/projects/0665af04c0bc45b3afa31d76b4d22dc8/users/aa71aa47202a4d878e6359c78c2d34b4/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:21.836342 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b443c-42dc-4469-b55a-8e5e9deab84f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0665af04c0bc45b3afa31d76b4d22dc8, user_id=aa71aa47202a4d878e6359c78c2d34b4, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:21.839381 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b443c-42dc-4469-b55a-8e5e9deab84f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:21.854680 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1235/2478] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:54:21 2022] PUT /identity/v3/projects/0665af04c0bc45b3afa31d76b4d22dc8/users/aa71aa47202a4d878e6359c78c2d34b4/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:21.866126 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b9a53-df5a-4c74-a079-451331c1d96f None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:21.866413 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b9a53-df5a-4c74-a079-451331c1d96f None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:21.866684 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b9a53-df5a-4c74-a079-451331c1d96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:21.896666 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-3f3b9a53-df5a-4c74-a079-451331c1d96f None None] MFA Rules not processed for user `aa71aa47202a4d878e6359c78c2d34b4`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:21.898116 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-3f3b9a53-df5a-4c74-a079-451331c1d96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:21.966046 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1244/2479] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:21.977101 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b443c-42dc-4469-b55a-8e5e9deab84f admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:21.978829 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-d50b443c-42dc-4469-b55a-8e5e9deab84f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:22.038204 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b443c-42dc-4469-b55a-8e5e9deab84f admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:22.041905 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c6f9b-d572-407d-944a-c5d22794c83b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:22.042553 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c6f9b-d572-407d-944a-c5d22794c83b service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:22.042819 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c6f9b-d572-407d-944a-c5d22794c83b service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:22.043091 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c6f9b-d572-407d-944a-c5d22794c83b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:22.052142 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c6f9b-d572-407d-944a-c5d22794c83b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:22.053615 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c6f9b-d572-407d-944a-c5d22794c83b service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:22.062245 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1236/2480] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:54:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:54:48.985104 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b9a53-df5a-4c74-a079-451331c1d96f None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:49.050111 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b9a53-df5a-4c74-a079-451331c1d96f None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:49.054913 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0950e-97bb-4482-b908-65637b92b8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:49.055786 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0950e-97bb-4482-b908-65637b92b8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:49.056064 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0950e-97bb-4482-b908-65637b92b8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:49.056334 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0950e-97bb-4482-b908-65637b92b8e6 admin admin] PATH_INFO: `/v3/users/aa71aa47202a4d878e6359c78c2d34b4` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:49.057553 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0950e-97bb-4482-b908-65637b92b8e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa71aa47202a4d878e6359c78c2d34b4)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:49.059480 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0950e-97bb-4482-b908-65637b92b8e6 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:49.107633 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-53f0950e-97bb-4482-b908-65637b92b8e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa71aa47202a4d878e6359c78c2d34b4'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:49.108298 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-53f0950e-97bb-4482-b908-65637b92b8e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa71aa47202a4d878e6359c78c2d34b4'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:49.108912 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-53f0950e-97bb-4482-b908-65637b92b8e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa71aa47202a4d878e6359c78c2d34b4'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:49.122380 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-53f0950e-97bb-4482-b908-65637b92b8e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa71aa47202a4d878e6359c78c2d34b4'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:49.130125 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-53f0950e-97bb-4482-b908-65637b92b8e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa71aa47202a4d878e6359c78c2d34b4'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:49.146059 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1245/2481] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:54:48 2022] DELETE /identity/v3/users/aa71aa47202a4d878e6359c78c2d34b4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:49.151151 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b157b6f-8516-4c2e-96a1-207f54611cda None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:49.151675 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b157b6f-8516-4c2e-96a1-207f54611cda None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:49.151675 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b157b6f-8516-4c2e-96a1-207f54611cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:49.169919 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-9b157b6f-8516-4c2e-96a1-207f54611cda None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:49.171113 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-9b157b6f-8516-4c2e-96a1-207f54611cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:49.231158 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1237/2482] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:49.241138 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0950e-97bb-4482-b908-65637b92b8e6 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:49.242873 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-53f0950e-97bb-4482-b908-65637b92b8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:49.299813 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0950e-97bb-4482-b908-65637b92b8e6 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:49.303821 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d590133-000d-40d6-b78c-d120b021b5a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:49.304448 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d590133-000d-40d6-b78c-d120b021b5a5 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:49.304722 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d590133-000d-40d6-b78c-d120b021b5a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:49.305032 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d590133-000d-40d6-b78c-d120b021b5a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:49.314604 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d590133-000d-40d6-b78c-d120b021b5a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:49.316031 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d590133-000d-40d6-b78c-d120b021b5a5 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:49.325244 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1246/2483] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:54:49.604345 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b157b6f-8516-4c2e-96a1-207f54611cda None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:49.605916 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-9b157b6f-8516-4c2e-96a1-207f54611cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:49.619061 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b157b6f-8516-4c2e-96a1-207f54611cda None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:49.623939 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c2e11-4c77-49bf-9d10-575c61d999b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:49.624795 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c2e11-4c77-49bf-9d10-575c61d999b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:49.625215 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c2e11-4c77-49bf-9d10-575c61d999b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:49.625413 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c2e11-4c77-49bf-9d10-575c61d999b1 admin admin] PATH_INFO: `/v3/projects/0665af04c0bc45b3afa31d76b4d22dc8` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:49.626553 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c2e11-4c77-49bf-9d10-575c61d999b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0665af04c0bc45b3afa31d76b4d22dc8)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:49.628455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c2e11-4c77-49bf-9d10-575c61d999b1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:49.676043 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a85c2e11-4c77-49bf-9d10-575c61d999b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0665af04c0bc45b3afa31d76b4d22dc8', 'request_id': 'req-a85c2e11-4c77-49bf-9d10-575c61d999b1'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:49.682146 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a85c2e11-4c77-49bf-9d10-575c61d999b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0665af04c0bc45b3afa31d76b4d22dc8', 'request_id': 'req-a85c2e11-4c77-49bf-9d10-575c61d999b1'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:49.690154 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a85c2e11-4c77-49bf-9d10-575c61d999b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0665af04c0bc45b3afa31d76b4d22dc8', 'request_id': 'req-a85c2e11-4c77-49bf-9d10-575c61d999b1'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:49.699917 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a85c2e11-4c77-49bf-9d10-575c61d999b1 admin admin] The token cache is being invalidate because project 0665af04c0bc45b3afa31d76b4d22dc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:54:49.700200 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a85c2e11-4c77-49bf-9d10-575c61d999b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:49.700820 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-a85c2e11-4c77-49bf-9d10-575c61d999b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:54:49.702459 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1238/2484] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:54:49 2022] DELETE /identity/v3/projects/0665af04c0bc45b3afa31d76b4d22dc8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:49.708465 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cd92c-605c-47c9-9208-0b383b08b7e1 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:49.708755 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cd92c-605c-47c9-9208-0b383b08b7e1 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:49.709060 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cd92c-605c-47c9-9208-0b383b08b7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:49.727500 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-298cd92c-605c-47c9-9208-0b383b08b7e1 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:49.728714 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-298cd92c-605c-47c9-9208-0b383b08b7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:49.791679 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1247/2485] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:49.799865 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1daf2b-ca5d-40d0-8d2f-b7b6f9c9e492 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:49.800169 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1daf2b-ca5d-40d0-8d2f-b7b6f9c9e492 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:49.800441 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1daf2b-ca5d-40d0-8d2f-b7b6f9c9e492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:49.818427 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-af1daf2b-ca5d-40d0-8d2f-b7b6f9c9e492 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:49.819559 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-af1daf2b-ca5d-40d0-8d2f-b7b6f9c9e492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:49.828027 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1239/2486] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:49.832251 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cd92c-605c-47c9-9208-0b383b08b7e1 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:49.842085 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cd92c-605c-47c9-9208-0b383b08b7e1 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:49.849413 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c7fc2-8786-48c3-84c6-22851bbbd79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:49.850230 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c7fc2-8786-48c3-84c6-22851bbbd79f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:49.850510 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c7fc2-8786-48c3-84c6-22851bbbd79f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:49.850867 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c7fc2-8786-48c3-84c6-22851bbbd79f admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:49.852003 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c7fc2-8786-48c3-84c6-22851bbbd79f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:54:49.852452 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c7fc2-8786-48c3-84c6-22851bbbd79f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:49.854869 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c7fc2-8786-48c3-84c6-22851bbbd79f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:49.873283 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1248/2487] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:54:49.878184 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1daf2b-ca5d-40d0-8d2f-b7b6f9c9e492 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:49.887826 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1daf2b-ca5d-40d0-8d2f-b7b6f9c9e492 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:49.893959 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02732a93-3462-4593-b8dc-bb4216274d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:49.894609 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02732a93-3462-4593-b8dc-bb4216274d0a admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:49.894889 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02732a93-3462-4593-b8dc-bb4216274d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:49.895159 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02732a93-3462-4593-b8dc-bb4216274d0a admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:49.895837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02732a93-3462-4593-b8dc-bb4216274d0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:49.897779 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02732a93-3462-4593-b8dc-bb4216274d0a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:49.926667 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1240/2488] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:54:49 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:54:49.930974 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c7fc2-8786-48c3-84c6-22851bbbd79f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:49.940819 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c7fc2-8786-48c3-84c6-22851bbbd79f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:49.996926 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef385108-f31f-42e7-b601-ea69023efe69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:49.997604 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef385108-f31f-42e7-b601-ea69023efe69 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:49.997852 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef385108-f31f-42e7-b601-ea69023efe69 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:49.998128 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef385108-f31f-42e7-b601-ea69023efe69 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:49.998820 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef385108-f31f-42e7-b601-ea69023efe69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:50.000774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef385108-f31f-42e7-b601-ea69023efe69 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:50.023032 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1249/2489] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:54:49 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:54:50.027595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02732a93-3462-4593-b8dc-bb4216274d0a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:50.038173 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02732a93-3462-4593-b8dc-bb4216274d0a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:50.043333 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a61a8e-26b9-47b2-9a49-e990225467d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:50.043991 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a61a8e-26b9-47b2-9a49-e990225467d8 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:50.044270 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a61a8e-26b9-47b2-9a49-e990225467d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:50.044543 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a61a8e-26b9-47b2-9a49-e990225467d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:50.045307 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a61a8e-26b9-47b2-9a49-e990225467d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:50.046900 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a61a8e-26b9-47b2-9a49-e990225467d8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:50.057384 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1241/2490] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:54:50.061295 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef385108-f31f-42e7-b601-ea69023efe69 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:50.071313 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef385108-f31f-42e7-b601-ea69023efe69 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:50.076537 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afa280-031d-423a-a660-a350c69f7a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:50.077217 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afa280-031d-423a-a660-a350c69f7a0b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:50.077500 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afa280-031d-423a-a660-a350c69f7a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:50.077770 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afa280-031d-423a-a660-a350c69f7a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:50.078501 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afa280-031d-423a-a660-a350c69f7a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:50.080071 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afa280-031d-423a-a660-a350c69f7a0b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:50.089875 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1250/2491] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:54:50.093944 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a61a8e-26b9-47b2-9a49-e990225467d8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:50.104383 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a61a8e-26b9-47b2-9a49-e990225467d8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:50.110082 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf935d0c-6bf9-45e9-80b8-317513028c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:50.110954 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf935d0c-6bf9-45e9-80b8-317513028c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:50.111234 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf935d0c-6bf9-45e9-80b8-317513028c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:50.111503 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf935d0c-6bf9-45e9-80b8-317513028c7d admin admin] PATH_INFO: `/v3/projects/3d9d593a7df24852b21f9c751e44e357/users/8a5aa603fbc640d484042afa6006846c/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:50.127344 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf935d0c-6bf9-45e9-80b8-317513028c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9d593a7df24852b21f9c751e44e357, user_id=8a5aa603fbc640d484042afa6006846c, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:50.130075 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf935d0c-6bf9-45e9-80b8-317513028c7d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:50.150972 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1242/2492] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:54:50 2022] PUT /identity/v3/projects/3d9d593a7df24852b21f9c751e44e357/users/8a5aa603fbc640d484042afa6006846c/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:54:50.157009 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa1b40-4b6f-4aa8-b8d1-c246a67bb94e None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:50.157299 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa1b40-4b6f-4aa8-b8d1-c246a67bb94e None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:50.157600 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa1b40-4b6f-4aa8-b8d1-c246a67bb94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:50.175129 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-87fa1b40-4b6f-4aa8-b8d1-c246a67bb94e None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:50.176308 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-87fa1b40-4b6f-4aa8-b8d1-c246a67bb94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:50.238619 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1251/2493] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:50.248416 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf935d0c-6bf9-45e9-80b8-317513028c7d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:50.250538 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-bf935d0c-6bf9-45e9-80b8-317513028c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:50.304750 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf935d0c-6bf9-45e9-80b8-317513028c7d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:50.308737 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9561e7-9fa5-4521-b32d-971e4f78371f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:50.309402 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9561e7-9fa5-4521-b32d-971e4f78371f service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:50.309684 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9561e7-9fa5-4521-b32d-971e4f78371f service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:50.309949 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9561e7-9fa5-4521-b32d-971e4f78371f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:50.319008 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9561e7-9fa5-4521-b32d-971e4f78371f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:50.320443 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9561e7-9fa5-4521-b32d-971e4f78371f service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:50.329644 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1243/2494] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:54:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:54:50.925192 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3aac-79b9-4543-acd1-30450c603098 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:50.925490 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3aac-79b9-4543-acd1-30450c603098 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:50.925802 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3aac-79b9-4543-acd1-30450c603098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:50.952573 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-3efa3aac-79b9-4543-acd1-30450c603098 None None] MFA Rules not processed for user `8a5aa603fbc640d484042afa6006846c`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:50.953878 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-3efa3aac-79b9-4543-acd1-30450c603098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:51.022010 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1252/2495] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:54:51.032494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9561e7-9fa5-4521-b32d-971e4f78371f service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:54:51.034195 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-7e9561e7-9fa5-4521-b32d-971e4f78371f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:51.093289 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9561e7-9fa5-4521-b32d-971e4f78371f service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:54:51.097403 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2b28a-76ee-4bd6-828e-34c6f00ed82c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:54:51.098046 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2b28a-76ee-4bd6-828e-34c6f00ed82c service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:51.098307 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2b28a-76ee-4bd6-828e-34c6f00ed82c service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:51.098577 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2b28a-76ee-4bd6-828e-34c6f00ed82c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:51.107738 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2b28a-76ee-4bd6-828e-34c6f00ed82c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:54:51.109211 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2b28a-76ee-4bd6-828e-34c6f00ed82c service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:54:51.118517 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1244/2496] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:54:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:54:53.528278 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54e542-cd31-4779-88aa-547af117d5d4 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:54:53.529071 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54e542-cd31-4779-88aa-547af117d5d4 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:54:53.529188 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54e542-cd31-4779-88aa-547af117d5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:54:53.553775 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-cd54e542-cd31-4779-88aa-547af117d5d4 None None] MFA Rules not processed for user `8a5aa603fbc640d484042afa6006846c`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:54:53.554967 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-cd54e542-cd31-4779-88aa-547af117d5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:54:53.563071 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1253/2497] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:54:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:55:09.113215 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2b28a-76ee-4bd6-828e-34c6f00ed82c service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:55:09.114882 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-1fc2b28a-76ee-4bd6-828e-34c6f00ed82c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:09.128525 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2b28a-76ee-4bd6-828e-34c6f00ed82c service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:55:09.132621 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df8e9b-bfee-4485-b26c-2c2795fa3b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:55:09.133302 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df8e9b-bfee-4485-b26c-2c2795fa3b13 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:09.133580 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df8e9b-bfee-4485-b26c-2c2795fa3b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:09.133855 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df8e9b-bfee-4485-b26c-2c2795fa3b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:09.135912 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-f0df8e9b-bfee-4485-b26c-2c2795fa3b13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:09.222000 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df8e9b-bfee-4485-b26c-2c2795fa3b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:55:09.223444 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df8e9b-bfee-4485-b26c-2c2795fa3b13 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:55:09.243213 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1245/2498] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:55:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:55:09.808178 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7646908-6d05-4492-8ad3-d23577a68941 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:09.808782 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7646908-6d05-4492-8ad3-d23577a68941 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:09.808782 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7646908-6d05-4492-8ad3-d23577a68941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:09.826005 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-c7646908-6d05-4492-8ad3-d23577a68941 None None] MFA Rules not processed for user `b2d11897809b4e388b063bb512e0be33`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:55:09.827172 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-c7646908-6d05-4492-8ad3-d23577a68941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:09.891970 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1254/2499] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:55:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:55:10.414261 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df8e9b-bfee-4485-b26c-2c2795fa3b13 service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:55:10.427929 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df8e9b-bfee-4485-b26c-2c2795fa3b13 service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:55:10.435031 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5eebb-cf39-407d-8892-273a948b6961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:55:10.435698 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5eebb-cf39-407d-8892-273a948b6961 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:10.435977 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5eebb-cf39-407d-8892-273a948b6961 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:10.436248 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5eebb-cf39-407d-8892-273a948b6961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:10.438373 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-54f5eebb-cf39-407d-8892-273a948b6961 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:10.457672 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5eebb-cf39-407d-8892-273a948b6961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:55:10.459221 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5eebb-cf39-407d-8892-273a948b6961 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:55:10.470690 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1246/2500] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:55:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:55:12.802249 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d2263-ea3b-4cab-b8dd-cf6144c7ffc8 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:12.803096 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d2263-ea3b-4cab-b8dd-cf6144c7ffc8 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:12.803548 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d2263-ea3b-4cab-b8dd-cf6144c7ffc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:12.822999 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-342d2263-ea3b-4cab-b8dd-cf6144c7ffc8 None None] MFA Rules not processed for user `8a5aa603fbc640d484042afa6006846c`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:55:12.824550 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-342d2263-ea3b-4cab-b8dd-cf6144c7ffc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:12.835342 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1255/2501] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:55:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:55:13.401882 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5eebb-cf39-407d-8892-273a948b6961 service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:55:13.411137 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5eebb-cf39-407d-8892-273a948b6961 service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:55:13.415755 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51078d38-179b-4d56-ac26-7954b74b5287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:55:13.416396 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51078d38-179b-4d56-ac26-7954b74b5287 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:13.416674 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51078d38-179b-4d56-ac26-7954b74b5287 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:13.416963 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51078d38-179b-4d56-ac26-7954b74b5287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:13.419490 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-51078d38-179b-4d56-ac26-7954b74b5287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:13.430228 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51078d38-179b-4d56-ac26-7954b74b5287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:55:13.431672 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51078d38-179b-4d56-ac26-7954b74b5287 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:55:13.440375 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1247/2502] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:55:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:55:13.847156 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d2263-ea3b-4cab-b8dd-cf6144c7ffc8 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:55:13.848943 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-342d2263-ea3b-4cab-b8dd-cf6144c7ffc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:13.935670 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d2263-ea3b-4cab-b8dd-cf6144c7ffc8 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:55:13.941187 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947a486-5095-4096-a2af-b3b872b2e5a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3b8e620cfd42fe993c73dc83a246be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:55:13.941927 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947a486-5095-4096-a2af-b3b872b2e5a2 service placement] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:13.942280 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947a486-5095-4096-a2af-b3b872b2e5a2 service placement] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:13.942659 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947a486-5095-4096-a2af-b3b872b2e5a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:13.944578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-c947a486-5095-4096-a2af-b3b872b2e5a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:13.957572 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947a486-5095-4096-a2af-b3b872b2e5a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:55:13.959258 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947a486-5095-4096-a2af-b3b872b2e5a2 service placement] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:55:13.970263 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1256/2503] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:55:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:55:16.317886 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51078d38-179b-4d56-ac26-7954b74b5287 service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:55:16.319920 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-51078d38-179b-4d56-ac26-7954b74b5287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:16.335307 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51078d38-179b-4d56-ac26-7954b74b5287 service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:55:16.344288 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47724656-6088-4038-bfd1-a9f22503efd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:55:16.345026 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47724656-6088-4038-bfd1-a9f22503efd5 service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:16.345302 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47724656-6088-4038-bfd1-a9f22503efd5 service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:16.345574 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47724656-6088-4038-bfd1-a9f22503efd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:16.347481 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-47724656-6088-4038-bfd1-a9f22503efd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:16.419536 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47724656-6088-4038-bfd1-a9f22503efd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:55:16.421358 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47724656-6088-4038-bfd1-a9f22503efd5 service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:55:16.430372 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1248/2504] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:55:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:55:22.491123 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947a486-5095-4096-a2af-b3b872b2e5a2 service placement] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:55:22.501118 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947a486-5095-4096-a2af-b3b872b2e5a2 service placement] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:55:22.505227 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131998e1-03e8-48d8-80a4-65e993c4458f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:55:22.505943 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131998e1-03e8-48d8-80a4-65e993c4458f service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:22.506412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131998e1-03e8-48d8-80a4-65e993c4458f service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:22.506860 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131998e1-03e8-48d8-80a4-65e993c4458f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:22.508777 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-131998e1-03e8-48d8-80a4-65e993c4458f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:22.521722 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131998e1-03e8-48d8-80a4-65e993c4458f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:55:22.523376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131998e1-03e8-48d8-80a4-65e993c4458f service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:55:22.533648 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1257/2505] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:55:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:55:24.695303 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bab89-578e-4847-821b-720b87cd8091 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:24.695812 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bab89-578e-4847-821b-720b87cd8091 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:24.695918 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bab89-578e-4847-821b-720b87cd8091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:24.713848 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b27bab89-578e-4847-821b-720b87cd8091 None None] MFA Rules not processed for user `947bc36861e64e31811cb898f46a72e1`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:55:24.715007 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b27bab89-578e-4847-821b-720b87cd8091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:24.771965 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1249/2506] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:55:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:55:24.784216 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131998e1-03e8-48d8-80a4-65e993c4458f service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:55:24.785634 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-131998e1-03e8-48d8-80a4-65e993c4458f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:24.803396 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131998e1-03e8-48d8-80a4-65e993c4458f service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:55:24.809725 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8492f4-0228-44f5-8d4b-ae5b78df14c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:55:24.810445 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8492f4-0228-44f5-8d4b-ae5b78df14c8 service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:24.810790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8492f4-0228-44f5-8d4b-ae5b78df14c8 service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:24.811128 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8492f4-0228-44f5-8d4b-ae5b78df14c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:24.813148 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-ee8492f4-0228-44f5-8d4b-ae5b78df14c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:24.823852 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8492f4-0228-44f5-8d4b-ae5b78df14c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:55:24.825468 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8492f4-0228-44f5-8d4b-ae5b78df14c8 service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:55:24.835003 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1258/2507] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:55:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:55:25.152314 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bab89-578e-4847-821b-720b87cd8091 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:55:25.161797 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bab89-578e-4847-821b-720b87cd8091 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:55:25.165332 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a563e94-020f-49df-b1cb-c9660a244d1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:55:25.165972 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a563e94-020f-49df-b1cb-c9660a244d1f service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:25.166254 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a563e94-020f-49df-b1cb-c9660a244d1f service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:25.166527 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a563e94-020f-49df-b1cb-c9660a244d1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:25.168401 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-6a563e94-020f-49df-b1cb-c9660a244d1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:25.177787 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a563e94-020f-49df-b1cb-c9660a244d1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:55:25.179208 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a563e94-020f-49df-b1cb-c9660a244d1f service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:55:25.186934 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1250/2508] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:55:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:55:32.230483 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4e1e7-c547-4e56-87d7-ad6430dade41 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:32.231005 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4e1e7-c547-4e56-87d7-ad6430dade41 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:32.231005 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4e1e7-c547-4e56-87d7-ad6430dade41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:32.284034 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-97d4e1e7-c547-4e56-87d7-ad6430dade41 None None] MFA Rules not processed for user `3b3dbe4735a54de1825abc28ecf00b84`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:55:32.286130 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-97d4e1e7-c547-4e56-87d7-ad6430dade41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:32.360136 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1259/2509] 10.222.0.31 () {58 vars in 1009 bytes} [Mon Jan 10 17:55:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:55:32.407653 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a563e94-020f-49df-b1cb-c9660a244d1f service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:55:32.409253 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-6a563e94-020f-49df-b1cb-c9660a244d1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:32.499973 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a563e94-020f-49df-b1cb-c9660a244d1f service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:55:32.505069 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc76cca-0f07-4f81-9f20-8e21c1ba2b54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257a86ce85b4b4386cde32c8ed4b39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:55:32.505726 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc76cca-0f07-4f81-9f20-8e21c1ba2b54 service swift] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:32.506017 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc76cca-0f07-4f81-9f20-8e21c1ba2b54 service swift] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:32.506299 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc76cca-0f07-4f81-9f20-8e21c1ba2b54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:32.515277 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc76cca-0f07-4f81-9f20-8e21c1ba2b54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:55:32.516909 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc76cca-0f07-4f81-9f20-8e21c1ba2b54 service swift] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:55:32.526454 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1251/2510] 10.222.0.31 () {60 vars in 1384 bytes} [Mon Jan 10 17:55:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:55:39.675362 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5acfd3-718e-433b-b4d1-b2771153641c None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:39.675944 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5acfd3-718e-433b-b4d1-b2771153641c None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:39.675944 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5acfd3-718e-433b-b4d1-b2771153641c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:39.721832 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-4b5acfd3-718e-433b-b4d1-b2771153641c None None] MFA Rules not processed for user `3b3dbe4735a54de1825abc28ecf00b84`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:55:39.726301 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-4b5acfd3-718e-433b-b4d1-b2771153641c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:39.748526 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1260/2511] 10.222.0.31 () {58 vars in 1009 bytes} [Mon Jan 10 17:55:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:55:39.769651 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc76cca-0f07-4f81-9f20-8e21c1ba2b54 service swift] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:55:39.781548 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc76cca-0f07-4f81-9f20-8e21c1ba2b54 service swift] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:55:39.795640 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5cee5-4320-4fb4-b5dd-ce2ca12224f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257a86ce85b4b4386cde32c8ed4b39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:55:39.797210 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5cee5-4320-4fb4-b5dd-ce2ca12224f6 service swift] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:39.800037 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5cee5-4320-4fb4-b5dd-ce2ca12224f6 service swift] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:39.800575 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5cee5-4320-4fb4-b5dd-ce2ca12224f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:39.826156 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5cee5-4320-4fb4-b5dd-ce2ca12224f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:55:39.826156 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5cee5-4320-4fb4-b5dd-ce2ca12224f6 service swift] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:55:39.834734 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1252/2512] 10.222.0.31 () {60 vars in 1384 bytes} [Mon Jan 10 17:55:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:55:43.866346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5acfd3-718e-433b-b4d1-b2771153641c None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:55:43.895353 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5acfd3-718e-433b-b4d1-b2771153641c None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:55:43.903517 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6173b-8f68-4879-ac4b-e9d5f03c292c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:55:43.904809 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6173b-8f68-4879-ac4b-e9d5f03c292c service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:43.905401 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6173b-8f68-4879-ac4b-e9d5f03c292c service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:43.905906 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6173b-8f68-4879-ac4b-e9d5f03c292c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:43.908120 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f1c6173b-8f68-4879-ac4b-e9d5f03c292c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:43.928522 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6173b-8f68-4879-ac4b-e9d5f03c292c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:55:43.930587 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6173b-8f68-4879-ac4b-e9d5f03c292c service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:55:43.946852 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1261/2513] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:55:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:55:46.710453 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5cee5-4320-4fb4-b5dd-ce2ca12224f6 service swift] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:55:46.727083 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5cee5-4320-4fb4-b5dd-ce2ca12224f6 service swift] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:55:46.733794 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8d7d7-b1cf-4e27-90a2-2691cb28a662 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:55:46.734734 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8d7d7-b1cf-4e27-90a2-2691cb28a662 service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:46.735265 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8d7d7-b1cf-4e27-90a2-2691cb28a662 service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:46.735843 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8d7d7-b1cf-4e27-90a2-2691cb28a662 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:46.738532 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-cfa8d7d7-b1cf-4e27-90a2-2691cb28a662 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:46.751575 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8d7d7-b1cf-4e27-90a2-2691cb28a662 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:55:46.753814 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8d7d7-b1cf-4e27-90a2-2691cb28a662 service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:55:46.780776 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1253/2514] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:55:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:55:49.544481 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151d924-8016-4ccf-a6ad-0b84a5428ff8 None None] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:49.545443 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151d924-8016-4ccf-a6ad-0b84a5428ff8 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:49.545961 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151d924-8016-4ccf-a6ad-0b84a5428ff8 None None] PATH_INFO: `/` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:49.548793 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1262/2515] 10.222.0.31 () {54 vars in 921 bytes} [Mon Jan 10 17:55:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 17:55:49.556218 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d403a78-aaba-4645-8dfd-612333cc4693 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:49.557333 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d403a78-aaba-4645-8dfd-612333cc4693 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:49.557777 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d403a78-aaba-4645-8dfd-612333cc4693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:49.595512 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-0d403a78-aaba-4645-8dfd-612333cc4693 None None] MFA Rules not processed for user `2174a30e22c746589b3faaf4ccc8de3d`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:55:49.601091 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-0d403a78-aaba-4645-8dfd-612333cc4693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:49.642506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1254/2516] 10.222.0.31 () {58 vars in 1018 bytes} [Mon Jan 10 17:55:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:55:49.654977 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151d924-8016-4ccf-a6ad-0b84a5428ff8 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:55:49.676615 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151d924-8016-4ccf-a6ad-0b84a5428ff8 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:55:49.687834 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72515c-07e4-44ab-ac1e-9c77caffd51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:55:49.688594 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72515c-07e4-44ab-ac1e-9c77caffd51b service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:49.689020 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72515c-07e4-44ab-ac1e-9c77caffd51b service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:49.689388 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72515c-07e4-44ab-ac1e-9c77caffd51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:49.705934 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72515c-07e4-44ab-ac1e-9c77caffd51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:55:49.707512 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72515c-07e4-44ab-ac1e-9c77caffd51b service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:55:49.730781 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1263/2517] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:55:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:55:54.636052 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f7a34-de12-47f2-8c24-100540b809cb None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:54.637451 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f7a34-de12-47f2-8c24-100540b809cb None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:54.638696 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f7a34-de12-47f2-8c24-100540b809cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:54.674521 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-517f7a34-de12-47f2-8c24-100540b809cb None None] MFA Rules not processed for user `3b3dbe4735a54de1825abc28ecf00b84`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:55:54.677421 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-517f7a34-de12-47f2-8c24-100540b809cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:55:54.693960 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1255/2518] 10.222.0.31 () {58 vars in 1009 bytes} [Mon Jan 10 17:55:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:55:54.763250 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72515c-07e4-44ab-ac1e-9c77caffd51b service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:55:54.798942 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72515c-07e4-44ab-ac1e-9c77caffd51b service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:55:54.807161 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd601e10-e374-41fd-bbe5-7c2bbe62965f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257a86ce85b4b4386cde32c8ed4b39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:55:54.808506 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd601e10-e374-41fd-bbe5-7c2bbe62965f service swift] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:55:54.809257 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd601e10-e374-41fd-bbe5-7c2bbe62965f service swift] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:55:54.809991 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd601e10-e374-41fd-bbe5-7c2bbe62965f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:55:54.823498 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd601e10-e374-41fd-bbe5-7c2bbe62965f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:55:54.825335 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd601e10-e374-41fd-bbe5-7c2bbe62965f service swift] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:55:54.837880 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1264/2519] 10.222.0.31 () {60 vars in 1384 bytes} [Mon Jan 10 17:55:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:56:00.222476 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1782a-5cd3-479c-8685-8ef4411f49ca None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:00.223052 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1782a-5cd3-479c-8685-8ef4411f49ca None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:00.223052 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1782a-5cd3-479c-8685-8ef4411f49ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:00.241660 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-78f1782a-5cd3-479c-8685-8ef4411f49ca None None] MFA Rules not processed for user `3b3dbe4735a54de1825abc28ecf00b84`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:56:00.242871 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-78f1782a-5cd3-479c-8685-8ef4411f49ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:00.251881 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1256/2520] 10.222.0.31 () {58 vars in 967 bytes} [Mon Jan 10 17:56:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:56:00.264809 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd601e10-e374-41fd-bbe5-7c2bbe62965f service swift] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:00.275478 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd601e10-e374-41fd-bbe5-7c2bbe62965f service swift] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:00.280452 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e0c5b-24a8-4b51-85f6-3d23c6c87139 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257a86ce85b4b4386cde32c8ed4b39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:00.281128 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e0c5b-24a8-4b51-85f6-3d23c6c87139 service swift] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:00.281402 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e0c5b-24a8-4b51-85f6-3d23c6c87139 service swift] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:00.281671 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e0c5b-24a8-4b51-85f6-3d23c6c87139 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:00.290388 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e0c5b-24a8-4b51-85f6-3d23c6c87139 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:00.292167 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e0c5b-24a8-4b51-85f6-3d23c6c87139 service swift] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:00.302213 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1265/2521] 10.222.0.31 () {60 vars in 1384 bytes} [Mon Jan 10 17:56:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:56:04.446046 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1782a-5cd3-479c-8685-8ef4411f49ca None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:04.459936 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1782a-5cd3-479c-8685-8ef4411f49ca None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:04.469108 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76632e96-bcf5-488e-8c4c-22a2e3d5ffca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:04.469991 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76632e96-bcf5-488e-8c4c-22a2e3d5ffca admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:04.470318 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76632e96-bcf5-488e-8c4c-22a2e3d5ffca admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:04.470536 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76632e96-bcf5-488e-8c4c-22a2e3d5ffca admin admin] PATH_INFO: `/v3/users/8a5aa603fbc640d484042afa6006846c` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:04.471782 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76632e96-bcf5-488e-8c4c-22a2e3d5ffca admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a5aa603fbc640d484042afa6006846c)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:04.474029 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76632e96-bcf5-488e-8c4c-22a2e3d5ffca admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:04.532442 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-76632e96-bcf5-488e-8c4c-22a2e3d5ffca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a5aa603fbc640d484042afa6006846c'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:56:04.543863 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-76632e96-bcf5-488e-8c4c-22a2e3d5ffca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a5aa603fbc640d484042afa6006846c'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:56:04.550500 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-76632e96-bcf5-488e-8c4c-22a2e3d5ffca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a5aa603fbc640d484042afa6006846c'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:56:04.558756 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-76632e96-bcf5-488e-8c4c-22a2e3d5ffca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a5aa603fbc640d484042afa6006846c'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:56:04.559438 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-76632e96-bcf5-488e-8c4c-22a2e3d5ffca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a5aa603fbc640d484042afa6006846c'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:56:04.566319 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1257/2522] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:56:04 2022] DELETE /identity/v3/users/8a5aa603fbc640d484042afa6006846c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:56:04.741984 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e0c5b-24a8-4b51-85f6-3d23c6c87139 service swift] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:04.758803 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e0c5b-24a8-4b51-85f6-3d23c6c87139 service swift] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:04.817670 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05710bc1-13ec-47dd-96c8-e0960834a5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:04.818580 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05710bc1-13ec-47dd-96c8-e0960834a5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:04.818872 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05710bc1-13ec-47dd-96c8-e0960834a5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:04.819177 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05710bc1-13ec-47dd-96c8-e0960834a5bd admin admin] PATH_INFO: `/v3/projects/3d9d593a7df24852b21f9c751e44e357` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:04.820371 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05710bc1-13ec-47dd-96c8-e0960834a5bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d9d593a7df24852b21f9c751e44e357)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:04.822336 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05710bc1-13ec-47dd-96c8-e0960834a5bd admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:04.868611 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-05710bc1-13ec-47dd-96c8-e0960834a5bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d9d593a7df24852b21f9c751e44e357', 'request_id': 'req-05710bc1-13ec-47dd-96c8-e0960834a5bd'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:56:04.874449 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-05710bc1-13ec-47dd-96c8-e0960834a5bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d9d593a7df24852b21f9c751e44e357', 'request_id': 'req-05710bc1-13ec-47dd-96c8-e0960834a5bd'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:56:04.882870 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-05710bc1-13ec-47dd-96c8-e0960834a5bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d9d593a7df24852b21f9c751e44e357', 'request_id': 'req-05710bc1-13ec-47dd-96c8-e0960834a5bd'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:56:04.894986 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-05710bc1-13ec-47dd-96c8-e0960834a5bd admin admin] The token cache is being invalidate because project 3d9d593a7df24852b21f9c751e44e357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:56:04.895212 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-05710bc1-13ec-47dd-96c8-e0960834a5bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:56:04.895909 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-05710bc1-13ec-47dd-96c8-e0960834a5bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:56:04.897689 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1266/2523] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:56:04 2022] DELETE /identity/v3/projects/3d9d593a7df24852b21f9c751e44e357 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:56:04.907277 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c1bdf-78e2-4932-96f6-a5d7303bd787 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:04.907631 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c1bdf-78e2-4932-96f6-a5d7303bd787 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:04.907984 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c1bdf-78e2-4932-96f6-a5d7303bd787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:04.933518 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-ca8c1bdf-78e2-4932-96f6-a5d7303bd787 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:56:04.934727 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-ca8c1bdf-78e2-4932-96f6-a5d7303bd787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:04.995562 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1258/2524] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:56:05.004155 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e84d1-84c9-4e2c-9bfa-d180d4ce1f7e None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:05.004445 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e84d1-84c9-4e2c-9bfa-d180d4ce1f7e None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:05.004728 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e84d1-84c9-4e2c-9bfa-d180d4ce1f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:05.025072 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-e56e84d1-84c9-4e2c-9bfa-d180d4ce1f7e None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:56:05.026445 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-e56e84d1-84c9-4e2c-9bfa-d180d4ce1f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:05.034886 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1267/2525] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:56:05.039241 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c1bdf-78e2-4932-96f6-a5d7303bd787 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:05.049281 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c1bdf-78e2-4932-96f6-a5d7303bd787 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:05.054065 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9adb9-2dfa-4ad9-abe4-9c5955b4c300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:05.054795 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9adb9-2dfa-4ad9-abe4-9c5955b4c300 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:05.055078 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9adb9-2dfa-4ad9-abe4-9c5955b4c300 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:05.055379 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9adb9-2dfa-4ad9-abe4-9c5955b4c300 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:05.056327 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9adb9-2dfa-4ad9-abe4-9c5955b4c300 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:56:05.056743 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9adb9-2dfa-4ad9-abe4-9c5955b4c300 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:05.058355 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9adb9-2dfa-4ad9-abe4-9c5955b4c300 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:05.071005 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1259/2526] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:56:05.076176 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e84d1-84c9-4e2c-9bfa-d180d4ce1f7e None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:05.087560 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e84d1-84c9-4e2c-9bfa-d180d4ce1f7e None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:05.093606 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512594c6-debd-41da-83bc-3514865d14ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:05.094323 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512594c6-debd-41da-83bc-3514865d14ad admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:05.094603 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512594c6-debd-41da-83bc-3514865d14ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:05.094876 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512594c6-debd-41da-83bc-3514865d14ad admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:05.095583 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512594c6-debd-41da-83bc-3514865d14ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:05.097507 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512594c6-debd-41da-83bc-3514865d14ad admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:05.125872 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1268/2527] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:56:05 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:56:05.128955 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9adb9-2dfa-4ad9-abe4-9c5955b4c300 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:05.138819 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9adb9-2dfa-4ad9-abe4-9c5955b4c300 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:05.195502 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491cc9c-fcc9-41a2-803d-fc055772ed41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:05.196071 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491cc9c-fcc9-41a2-803d-fc055772ed41 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:05.196351 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491cc9c-fcc9-41a2-803d-fc055772ed41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:05.196624 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491cc9c-fcc9-41a2-803d-fc055772ed41 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:05.197361 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491cc9c-fcc9-41a2-803d-fc055772ed41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:05.199278 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491cc9c-fcc9-41a2-803d-fc055772ed41 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:05.224020 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1260/2528] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:56:05 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:56:05.230622 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512594c6-debd-41da-83bc-3514865d14ad admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:05.242170 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512594c6-debd-41da-83bc-3514865d14ad admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:05.248105 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3758a8f-0763-4cb7-93d1-3b96417929a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:05.248828 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3758a8f-0763-4cb7-93d1-3b96417929a1 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:05.249161 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3758a8f-0763-4cb7-93d1-3b96417929a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:05.249461 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3758a8f-0763-4cb7-93d1-3b96417929a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:05.250471 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3758a8f-0763-4cb7-93d1-3b96417929a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:05.252325 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3758a8f-0763-4cb7-93d1-3b96417929a1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:05.263968 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1269/2529] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:56:05.268569 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491cc9c-fcc9-41a2-803d-fc055772ed41 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:05.279652 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491cc9c-fcc9-41a2-803d-fc055772ed41 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:05.285431 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916799f-56ac-45e7-a082-d73654167582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:05.286096 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916799f-56ac-45e7-a082-d73654167582 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:05.286382 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916799f-56ac-45e7-a082-d73654167582 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:05.286649 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916799f-56ac-45e7-a082-d73654167582 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:05.287418 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916799f-56ac-45e7-a082-d73654167582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:05.289080 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916799f-56ac-45e7-a082-d73654167582 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:05.299355 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1261/2530] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:56:05.303939 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3758a8f-0763-4cb7-93d1-3b96417929a1 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:05.314651 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3758a8f-0763-4cb7-93d1-3b96417929a1 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:05.320774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf5012-9dfb-4748-a033-a2dadc1207f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:05.322031 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf5012-9dfb-4748-a033-a2dadc1207f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:05.322353 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf5012-9dfb-4748-a033-a2dadc1207f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:05.322701 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf5012-9dfb-4748-a033-a2dadc1207f1 admin admin] PATH_INFO: `/v3/projects/177909419ff9413893866fd1a6a16a97/users/c5ae7ce87dd0438d9bbbc4fb35cfbc5c/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:05.339947 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf5012-9dfb-4748-a033-a2dadc1207f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=177909419ff9413893866fd1a6a16a97, user_id=c5ae7ce87dd0438d9bbbc4fb35cfbc5c, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:05.342819 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf5012-9dfb-4748-a033-a2dadc1207f1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:05.357293 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1270/2531] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:56:05 2022] PUT /identity/v3/projects/177909419ff9413893866fd1a6a16a97/users/c5ae7ce87dd0438d9bbbc4fb35cfbc5c/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:56:05.362482 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57273b-2904-49ac-8078-2b6f21739ae0 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:05.362771 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57273b-2904-49ac-8078-2b6f21739ae0 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:05.363045 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57273b-2904-49ac-8078-2b6f21739ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:05.381717 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-4c57273b-2904-49ac-8078-2b6f21739ae0 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:56:05.382927 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-4c57273b-2904-49ac-8078-2b6f21739ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:05.443784 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1262/2532] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:56:05.453695 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf5012-9dfb-4748-a033-a2dadc1207f1 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:05.455623 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-8adf5012-9dfb-4748-a033-a2dadc1207f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:05.516094 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf5012-9dfb-4748-a033-a2dadc1207f1 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:05.521082 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea7da7-99eb-42e6-a866-304ba44c4a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:05.521726 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea7da7-99eb-42e6-a866-304ba44c4a63 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:05.522007 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea7da7-99eb-42e6-a866-304ba44c4a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:05.522291 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea7da7-99eb-42e6-a866-304ba44c4a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:05.532300 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea7da7-99eb-42e6-a866-304ba44c4a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:05.533745 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea7da7-99eb-42e6-a866-304ba44c4a63 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:05.543370 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1271/2533] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:56:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:56:09.831279 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47fc82-350e-4465-9555-08e982d9bd39 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:09.831867 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47fc82-350e-4465-9555-08e982d9bd39 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:09.831974 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47fc82-350e-4465-9555-08e982d9bd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:09.859504 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-8f47fc82-350e-4465-9555-08e982d9bd39 None None] MFA Rules not processed for user `c5ae7ce87dd0438d9bbbc4fb35cfbc5c`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:56:09.861344 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-8f47fc82-350e-4465-9555-08e982d9bd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:09.934243 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1263/2534] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:56:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:56:09.938960 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea7da7-99eb-42e6-a866-304ba44c4a63 service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:09.949087 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea7da7-99eb-42e6-a866-304ba44c4a63 service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:09.953736 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c487510-7194-424d-98cf-d90874d1964a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:09.954389 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c487510-7194-424d-98cf-d90874d1964a admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:09.954664 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c487510-7194-424d-98cf-d90874d1964a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:09.954952 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c487510-7194-424d-98cf-d90874d1964a admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:09.956298 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c487510-7194-424d-98cf-d90874d1964a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:09.958267 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c487510-7194-424d-98cf-d90874d1964a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:09.991986 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1272/2535] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:56:09 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:56:09.996999 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47fc82-350e-4465-9555-08e982d9bd39 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:10.008243 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47fc82-350e-4465-9555-08e982d9bd39 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:10.063491 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f6ae5-7c5b-4b9d-9fb5-73cce9fdd3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:10.064142 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f6ae5-7c5b-4b9d-9fb5-73cce9fdd3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:10.064426 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f6ae5-7c5b-4b9d-9fb5-73cce9fdd3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:10.064695 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f6ae5-7c5b-4b9d-9fb5-73cce9fdd3b2 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:10.065438 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f6ae5-7c5b-4b9d-9fb5-73cce9fdd3b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:10.067378 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f6ae5-7c5b-4b9d-9fb5-73cce9fdd3b2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:10.088582 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1264/2536] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:56:09 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:56:10.092794 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c487510-7194-424d-98cf-d90874d1964a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:10.103467 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c487510-7194-424d-98cf-d90874d1964a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:10.108539 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356dfd8-4bf2-420d-b8ba-135f3f1a135d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:10.109228 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356dfd8-4bf2-420d-b8ba-135f3f1a135d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:10.109505 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356dfd8-4bf2-420d-b8ba-135f3f1a135d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:10.109745 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356dfd8-4bf2-420d-b8ba-135f3f1a135d admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:10.110688 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356dfd8-4bf2-420d-b8ba-135f3f1a135d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:10.112271 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356dfd8-4bf2-420d-b8ba-135f3f1a135d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:10.122891 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1273/2537] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:56:10.127083 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f6ae5-7c5b-4b9d-9fb5-73cce9fdd3b2 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:10.136881 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f6ae5-7c5b-4b9d-9fb5-73cce9fdd3b2 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:10.141755 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3a889-060f-47bc-a7c7-f276c332027e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:10.142642 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3a889-060f-47bc-a7c7-f276c332027e admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:10.142920 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3a889-060f-47bc-a7c7-f276c332027e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:10.143189 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3a889-060f-47bc-a7c7-f276c332027e admin admin] PATH_INFO: `/v3/projects/0e9d9c7dd8a0405d8a151f37390075c6/users/155ae167b59c404ea37fc98bbc1d3686/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:10.157965 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3a889-060f-47bc-a7c7-f276c332027e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e9d9c7dd8a0405d8a151f37390075c6, user_id=155ae167b59c404ea37fc98bbc1d3686, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:10.160603 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3a889-060f-47bc-a7c7-f276c332027e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:10.176501 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1265/2538] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:56:10 2022] PUT /identity/v3/projects/0e9d9c7dd8a0405d8a151f37390075c6/users/155ae167b59c404ea37fc98bbc1d3686/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:56:10.180388 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356dfd8-4bf2-420d-b8ba-135f3f1a135d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:10.190637 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356dfd8-4bf2-420d-b8ba-135f3f1a135d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:10.245989 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd74a2c-73ed-4ad6-b4c6-21000b47585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:10.247265 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd74a2c-73ed-4ad6-b4c6-21000b47585f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:10.247550 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd74a2c-73ed-4ad6-b4c6-21000b47585f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:10.247820 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd74a2c-73ed-4ad6-b4c6-21000b47585f admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:10.248571 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd74a2c-73ed-4ad6-b4c6-21000b47585f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:10.250219 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd74a2c-73ed-4ad6-b4c6-21000b47585f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:10.261035 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1274/2539] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:56:10.265362 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3a889-060f-47bc-a7c7-f276c332027e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:10.276183 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3a889-060f-47bc-a7c7-f276c332027e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:10.281322 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaffcef-2d94-4b2e-9f71-36cedaf1caac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:10.282248 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaffcef-2d94-4b2e-9f71-36cedaf1caac admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:10.282533 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaffcef-2d94-4b2e-9f71-36cedaf1caac admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:10.282815 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaffcef-2d94-4b2e-9f71-36cedaf1caac admin admin] PATH_INFO: `/v3/projects/0e9d9c7dd8a0405d8a151f37390075c6/users/155ae167b59c404ea37fc98bbc1d3686/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:10.284840 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaffcef-2d94-4b2e-9f71-36cedaf1caac admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e9d9c7dd8a0405d8a151f37390075c6, user_id=155ae167b59c404ea37fc98bbc1d3686, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:10.287549 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaffcef-2d94-4b2e-9f71-36cedaf1caac admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:10.300498 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1266/2540] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:56:10 2022] PUT /identity/v3/projects/0e9d9c7dd8a0405d8a151f37390075c6/users/155ae167b59c404ea37fc98bbc1d3686/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:56:13.442873 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526b416-6cc2-4dbb-b9b9-7db8a15381a8 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:13.443409 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526b416-6cc2-4dbb-b9b9-7db8a15381a8 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:13.443409 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526b416-6cc2-4dbb-b9b9-7db8a15381a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:13.485390 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-c526b416-6cc2-4dbb-b9b9-7db8a15381a8 None None] MFA Rules not processed for user `3b3dbe4735a54de1825abc28ecf00b84`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:56:13.486906 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-c526b416-6cc2-4dbb-b9b9-7db8a15381a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:13.633035 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1275/2541] 10.222.0.31 () {58 vars in 967 bytes} [Mon Jan 10 17:56:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:56:13.649379 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaffcef-2d94-4b2e-9f71-36cedaf1caac admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:13.651227 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-abaffcef-2d94-4b2e-9f71-36cedaf1caac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:13.746860 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaffcef-2d94-4b2e-9f71-36cedaf1caac admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:13.752715 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0e23b-6769-4af0-959d-187a4c3c1cb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257a86ce85b4b4386cde32c8ed4b39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:13.753671 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0e23b-6769-4af0-959d-187a4c3c1cb8 service swift] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:13.754690 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0e23b-6769-4af0-959d-187a4c3c1cb8 service swift] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:13.755179 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0e23b-6769-4af0-959d-187a4c3c1cb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:13.767693 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0e23b-6769-4af0-959d-187a4c3c1cb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:13.771848 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0e23b-6769-4af0-959d-187a4c3c1cb8 service swift] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:13.783918 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1267/2542] 10.222.0.31 () {60 vars in 1384 bytes} [Mon Jan 10 17:56:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:56:14.657200 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526b416-6cc2-4dbb-b9b9-7db8a15381a8 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:14.658637 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-c526b416-6cc2-4dbb-b9b9-7db8a15381a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:14.804601 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526b416-6cc2-4dbb-b9b9-7db8a15381a8 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:14.814746 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9c629-cd13-4ab4-8ad6-d993ce87aebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:14.817353 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9c629-cd13-4ab4-8ad6-d993ce87aebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:14.817845 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9c629-cd13-4ab4-8ad6-d993ce87aebf admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:14.818287 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9c629-cd13-4ab4-8ad6-d993ce87aebf admin admin] PATH_INFO: `/v3/users/b2d11897809b4e388b063bb512e0be33` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:14.819883 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9c629-cd13-4ab4-8ad6-d993ce87aebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d11897809b4e388b063bb512e0be33)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:14.822230 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9c629-cd13-4ab4-8ad6-d993ce87aebf admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:14.910620 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-1aa9c629-cd13-4ab4-8ad6-d993ce87aebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d11897809b4e388b063bb512e0be33'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:56:14.916511 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-1aa9c629-cd13-4ab4-8ad6-d993ce87aebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d11897809b4e388b063bb512e0be33'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:56:14.917723 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-1aa9c629-cd13-4ab4-8ad6-d993ce87aebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d11897809b4e388b063bb512e0be33'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:56:14.952534 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-1aa9c629-cd13-4ab4-8ad6-d993ce87aebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d11897809b4e388b063bb512e0be33'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:56:14.961260 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-1aa9c629-cd13-4ab4-8ad6-d993ce87aebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d11897809b4e388b063bb512e0be33'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:56:14.985121 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1276/2543] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:56:14 2022] DELETE /identity/v3/users/b2d11897809b4e388b063bb512e0be33 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:56:15.257534 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0e23b-6769-4af0-959d-187a4c3c1cb8 service swift] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:15.268430 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0e23b-6769-4af0-959d-187a4c3c1cb8 service swift] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:15.372842 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d5aea-24a9-44aa-9edd-c032da96e46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:15.374071 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d5aea-24a9-44aa-9edd-c032da96e46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:15.374509 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d5aea-24a9-44aa-9edd-c032da96e46c admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:15.375781 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d5aea-24a9-44aa-9edd-c032da96e46c admin admin] PATH_INFO: `/v3/projects/dc1f36430c0e404b83f29da9c4d07551` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:15.380383 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d5aea-24a9-44aa-9edd-c032da96e46c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc1f36430c0e404b83f29da9c4d07551)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:15.382695 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d5aea-24a9-44aa-9edd-c032da96e46c admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:15.490074 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-895d5aea-24a9-44aa-9edd-c032da96e46c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc1f36430c0e404b83f29da9c4d07551', 'request_id': 'req-895d5aea-24a9-44aa-9edd-c032da96e46c'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:56:15.499725 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-895d5aea-24a9-44aa-9edd-c032da96e46c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc1f36430c0e404b83f29da9c4d07551', 'request_id': 'req-895d5aea-24a9-44aa-9edd-c032da96e46c'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:56:15.510858 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-895d5aea-24a9-44aa-9edd-c032da96e46c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc1f36430c0e404b83f29da9c4d07551', 'request_id': 'req-895d5aea-24a9-44aa-9edd-c032da96e46c'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:56:15.526909 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-895d5aea-24a9-44aa-9edd-c032da96e46c admin admin] The token cache is being invalidate because project dc1f36430c0e404b83f29da9c4d07551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:56:15.527351 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-895d5aea-24a9-44aa-9edd-c032da96e46c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:56:15.528150 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-895d5aea-24a9-44aa-9edd-c032da96e46c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:56:15.533033 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1268/2544] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:56:15 2022] DELETE /identity/v3/projects/dc1f36430c0e404b83f29da9c4d07551 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:56:15.536139 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b52cd-295e-4502-a349-dd23290248ff None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:15.536734 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b52cd-295e-4502-a349-dd23290248ff None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:15.537186 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b52cd-295e-4502-a349-dd23290248ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:15.577084 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-251b52cd-295e-4502-a349-dd23290248ff None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:56:15.581729 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-251b52cd-295e-4502-a349-dd23290248ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:15.679986 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1277/2545] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:56:15.688132 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fadc79-0e69-480f-b9f3-1e1bbe64727e None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:15.688511 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fadc79-0e69-480f-b9f3-1e1bbe64727e None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:15.688894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fadc79-0e69-480f-b9f3-1e1bbe64727e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:15.712592 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-11fadc79-0e69-480f-b9f3-1e1bbe64727e None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:56:15.713848 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-11fadc79-0e69-480f-b9f3-1e1bbe64727e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:15.736433 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1269/2546] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:56:15.737937 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b52cd-295e-4502-a349-dd23290248ff None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:15.750388 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b52cd-295e-4502-a349-dd23290248ff None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:15.763471 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ee2ac-5eb6-4f81-a9bc-9f2c2a4a6030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:15.764550 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ee2ac-5eb6-4f81-a9bc-9f2c2a4a6030 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:15.765102 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ee2ac-5eb6-4f81-a9bc-9f2c2a4a6030 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:15.765529 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ee2ac-5eb6-4f81-a9bc-9f2c2a4a6030 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:15.766560 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ee2ac-5eb6-4f81-a9bc-9f2c2a4a6030 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:56:15.767074 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ee2ac-5eb6-4f81-a9bc-9f2c2a4a6030 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:15.770318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ee2ac-5eb6-4f81-a9bc-9f2c2a4a6030 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:15.785634 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1278/2547] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:56:15.790319 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fadc79-0e69-480f-b9f3-1e1bbe64727e None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:15.800458 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fadc79-0e69-480f-b9f3-1e1bbe64727e None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:15.813465 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348f396-eed7-4b1c-bf38-ae1b35cfdb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:15.815049 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348f396-eed7-4b1c-bf38-ae1b35cfdb28 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:15.815889 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348f396-eed7-4b1c-bf38-ae1b35cfdb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:15.816435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348f396-eed7-4b1c-bf38-ae1b35cfdb28 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:15.817458 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348f396-eed7-4b1c-bf38-ae1b35cfdb28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:15.819739 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348f396-eed7-4b1c-bf38-ae1b35cfdb28 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:15.868048 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1270/2548] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:56:15 2022] POST /identity/v3/projects => generated 379 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:56:15.869022 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ee2ac-5eb6-4f81-a9bc-9f2c2a4a6030 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:15.888407 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ee2ac-5eb6-4f81-a9bc-9f2c2a4a6030 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:15.982924 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8964f7-e85d-4e6a-9aee-0a1f5b7727bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:15.983905 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8964f7-e85d-4e6a-9aee-0a1f5b7727bb admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:15.984505 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8964f7-e85d-4e6a-9aee-0a1f5b7727bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:15.984975 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8964f7-e85d-4e6a-9aee-0a1f5b7727bb admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:15.986760 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8964f7-e85d-4e6a-9aee-0a1f5b7727bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:15.990334 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8964f7-e85d-4e6a-9aee-0a1f5b7727bb admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:16.032264 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1279/2549] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:56:15 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:56:16.035632 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348f396-eed7-4b1c-bf38-ae1b35cfdb28 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:16.048106 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348f396-eed7-4b1c-bf38-ae1b35cfdb28 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:16.055512 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee164d2-8139-416f-9885-69e91d58478a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:16.055763 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee164d2-8139-416f-9885-69e91d58478a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:16.056053 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee164d2-8139-416f-9885-69e91d58478a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:16.056345 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee164d2-8139-416f-9885-69e91d58478a admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:16.057148 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee164d2-8139-416f-9885-69e91d58478a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:16.058795 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee164d2-8139-416f-9885-69e91d58478a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:16.073456 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1271/2550] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:56:16.077059 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8964f7-e85d-4e6a-9aee-0a1f5b7727bb admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:16.093699 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8964f7-e85d-4e6a-9aee-0a1f5b7727bb admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:16.110458 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f011c-4b05-4492-955c-9e6f7defe6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:16.111302 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f011c-4b05-4492-955c-9e6f7defe6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:16.111938 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f011c-4b05-4492-955c-9e6f7defe6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:16.112388 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f011c-4b05-4492-955c-9e6f7defe6e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:16.113202 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f011c-4b05-4492-955c-9e6f7defe6e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:16.115085 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f011c-4b05-4492-955c-9e6f7defe6e4 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:16.135638 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1280/2551] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:56:16.139381 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee164d2-8139-416f-9885-69e91d58478a admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:16.154994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee164d2-8139-416f-9885-69e91d58478a admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:16.165139 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76894e-a265-4e96-b55a-06c4476f726d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:16.166608 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76894e-a265-4e96-b55a-06c4476f726d admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:16.166898 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76894e-a265-4e96-b55a-06c4476f726d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:16.167222 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76894e-a265-4e96-b55a-06c4476f726d admin admin] PATH_INFO: `/v3/projects/70891404a20f4177b6c2d794789ffaf8/users/e620249a17b347e98b3fb78f1cbba2db/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:16.194516 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76894e-a265-4e96-b55a-06c4476f726d admin admin] RBAC: Authorizing `identity:create_grant(project_id=70891404a20f4177b6c2d794789ffaf8, user_id=e620249a17b347e98b3fb78f1cbba2db, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:16.198097 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76894e-a265-4e96-b55a-06c4476f726d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:16.223570 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1272/2552] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:56:16 2022] PUT /identity/v3/projects/70891404a20f4177b6c2d794789ffaf8/users/e620249a17b347e98b3fb78f1cbba2db/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:56:16.228332 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e08ba3-f452-4224-a238-391a4ae6f1c3 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:16.228956 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e08ba3-f452-4224-a238-391a4ae6f1c3 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:16.229441 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e08ba3-f452-4224-a238-391a4ae6f1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:16.254854 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-02e08ba3-f452-4224-a238-391a4ae6f1c3 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:56:16.260990 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-02e08ba3-f452-4224-a238-391a4ae6f1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:16.344888 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1281/2553] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:56:16.352416 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76894e-a265-4e96-b55a-06c4476f726d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:16.354768 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-2c76894e-a265-4e96-b55a-06c4476f726d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:16.495540 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76894e-a265-4e96-b55a-06c4476f726d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:16.503435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d22054-4378-4242-a693-de933ca9875f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:16.504557 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d22054-4378-4242-a693-de933ca9875f service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:16.505098 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d22054-4378-4242-a693-de933ca9875f service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:16.505944 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d22054-4378-4242-a693-de933ca9875f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:16.529520 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d22054-4378-4242-a693-de933ca9875f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:16.531712 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d22054-4378-4242-a693-de933ca9875f service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:16.547628 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1273/2554] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:56:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:56:17.010816 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e2a50-e256-4184-bbaf-9f1857c13bc8 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:17.011759 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e2a50-e256-4184-bbaf-9f1857c13bc8 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:17.012198 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e2a50-e256-4184-bbaf-9f1857c13bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:17.056805 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-0b3e2a50-e256-4184-bbaf-9f1857c13bc8 None None] MFA Rules not processed for user `155ae167b59c404ea37fc98bbc1d3686`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:56:17.058334 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-0b3e2a50-e256-4184-bbaf-9f1857c13bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:17.174276 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1282/2555] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:56:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:56:17.175876 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d22054-4378-4242-a693-de933ca9875f service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:17.177417 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-40d22054-4378-4242-a693-de933ca9875f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:17.272392 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d22054-4378-4242-a693-de933ca9875f service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:17.277397 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b9a2d-6216-407b-8e6a-de5d74f4407c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15232a1930bc43e8bb5aa7310a709056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:17.278188 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b9a2d-6216-407b-8e6a-de5d74f4407c service glance] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:17.278754 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b9a2d-6216-407b-8e6a-de5d74f4407c service glance] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:17.278892 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b9a2d-6216-407b-8e6a-de5d74f4407c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:17.280827 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-bc6b9a2d-6216-407b-8e6a-de5d74f4407c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:17.348228 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b9a2d-6216-407b-8e6a-de5d74f4407c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:17.349787 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b9a2d-6216-407b-8e6a-de5d74f4407c service glance] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:17.361408 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1274/2556] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:56:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:56:17.478667 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e1dcf-db5f-42cf-a067-e8e4370bc406 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:17.479089 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e1dcf-db5f-42cf-a067-e8e4370bc406 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:17.479470 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e1dcf-db5f-42cf-a067-e8e4370bc406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:17.522214 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-698e1dcf-db5f-42cf-a067-e8e4370bc406 None None] MFA Rules not processed for user `3b3dbe4735a54de1825abc28ecf00b84`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:56:17.524642 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-698e1dcf-db5f-42cf-a067-e8e4370bc406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:17.595911 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1283/2557] 10.222.0.31 () {58 vars in 1009 bytes} [Mon Jan 10 17:56:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:56:17.611035 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b9a2d-6216-407b-8e6a-de5d74f4407c service glance] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:17.612528 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-bc6b9a2d-6216-407b-8e6a-de5d74f4407c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:17.730168 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b9a2d-6216-407b-8e6a-de5d74f4407c service glance] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:17.737597 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43437ac0-3432-4b9e-a1c7-d6312032dc40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257a86ce85b4b4386cde32c8ed4b39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:17.738367 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43437ac0-3432-4b9e-a1c7-d6312032dc40 service swift] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:17.738762 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43437ac0-3432-4b9e-a1c7-d6312032dc40 service swift] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:17.739133 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43437ac0-3432-4b9e-a1c7-d6312032dc40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:17.749077 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43437ac0-3432-4b9e-a1c7-d6312032dc40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:17.750845 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43437ac0-3432-4b9e-a1c7-d6312032dc40 service swift] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:17.762653 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1275/2558] 10.222.0.31 () {60 vars in 1384 bytes} [Mon Jan 10 17:56:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:56:22.830857 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5dde8-740c-4d1f-907e-b8939358ed59 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:22.831393 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5dde8-740c-4d1f-907e-b8939358ed59 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:22.831393 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5dde8-740c-4d1f-907e-b8939358ed59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:22.868293 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-bfc5dde8-740c-4d1f-907e-b8939358ed59 None None] MFA Rules not processed for user `e620249a17b347e98b3fb78f1cbba2db`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:56:22.869832 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-bfc5dde8-740c-4d1f-907e-b8939358ed59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:22.955232 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1284/2559] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:56:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:56:22.956452 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43437ac0-3432-4b9e-a1c7-d6312032dc40 service swift] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:22.971685 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43437ac0-3432-4b9e-a1c7-d6312032dc40 service swift] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:22.977717 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde5250-117c-4f84-8f2f-00db693a7df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:22.978970 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde5250-117c-4f84-8f2f-00db693a7df1 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:22.979415 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde5250-117c-4f84-8f2f-00db693a7df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:22.979693 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde5250-117c-4f84-8f2f-00db693a7df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:22.980424 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde5250-117c-4f84-8f2f-00db693a7df1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:22.983176 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde5250-117c-4f84-8f2f-00db693a7df1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:23.031778 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1276/2560] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:56:22 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:56:23.034274 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5dde8-740c-4d1f-907e-b8939358ed59 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:23.080492 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5dde8-740c-4d1f-907e-b8939358ed59 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:23.193835 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d19e7-cdc4-40d7-8576-9e197f1e306d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:23.194440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d19e7-cdc4-40d7-8576-9e197f1e306d admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:23.194726 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d19e7-cdc4-40d7-8576-9e197f1e306d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:23.195004 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d19e7-cdc4-40d7-8576-9e197f1e306d admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:23.195818 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d19e7-cdc4-40d7-8576-9e197f1e306d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:23.199450 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d19e7-cdc4-40d7-8576-9e197f1e306d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:23.231821 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1285/2561] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:56:23 2022] POST /identity/v3/users => generated 295 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:56:23.232662 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde5250-117c-4f84-8f2f-00db693a7df1 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:23.247771 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde5250-117c-4f84-8f2f-00db693a7df1 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:23.255153 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a1a8d-2947-49a7-a56e-558e6cfaaf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:23.256191 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a1a8d-2947-49a7-a56e-558e6cfaaf00 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:23.256315 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a1a8d-2947-49a7-a56e-558e6cfaaf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:23.256595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a1a8d-2947-49a7-a56e-558e6cfaaf00 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:23.257840 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a1a8d-2947-49a7-a56e-558e6cfaaf00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:23.260751 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a1a8d-2947-49a7-a56e-558e6cfaaf00 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:23.277636 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d19e7-cdc4-40d7-8576-9e197f1e306d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:23.291424 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d19e7-cdc4-40d7-8576-9e197f1e306d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:23.292061 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1277/2562] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:56:23.296671 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d57c95-94c6-4c09-b4bd-e66e302f1366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:23.297605 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d57c95-94c6-4c09-b4bd-e66e302f1366 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:23.297983 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d57c95-94c6-4c09-b4bd-e66e302f1366 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:23.298274 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d57c95-94c6-4c09-b4bd-e66e302f1366 admin admin] PATH_INFO: `/v3/projects/1b795c12898f4adaae232be11306ad71/users/25cd96a5e6fc4c8ab447b2480bf1dbd3/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:23.322875 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d57c95-94c6-4c09-b4bd-e66e302f1366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b795c12898f4adaae232be11306ad71, user_id=25cd96a5e6fc4c8ab447b2480bf1dbd3, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:23.325995 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d57c95-94c6-4c09-b4bd-e66e302f1366 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:23.345251 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1286/2563] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:56:23 2022] PUT /identity/v3/projects/1b795c12898f4adaae232be11306ad71/users/25cd96a5e6fc4c8ab447b2480bf1dbd3/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:56:23.349792 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a1a8d-2947-49a7-a56e-558e6cfaaf00 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:23.359990 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a1a8d-2947-49a7-a56e-558e6cfaaf00 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:23.435819 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd858af6-2af4-4c53-a757-e416fe281c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:23.436429 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd858af6-2af4-4c53-a757-e416fe281c55 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:23.436708 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd858af6-2af4-4c53-a757-e416fe281c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:23.437126 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd858af6-2af4-4c53-a757-e416fe281c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:23.437730 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd858af6-2af4-4c53-a757-e416fe281c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:23.439501 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd858af6-2af4-4c53-a757-e416fe281c55 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:23.455471 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1278/2564] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:56:23.459642 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d57c95-94c6-4c09-b4bd-e66e302f1366 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:23.477288 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d57c95-94c6-4c09-b4bd-e66e302f1366 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:23.482501 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb662b6-976d-4aed-8f03-0a4b32d348ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:23.483402 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb662b6-976d-4aed-8f03-0a4b32d348ca admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:23.483679 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb662b6-976d-4aed-8f03-0a4b32d348ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:23.483945 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb662b6-976d-4aed-8f03-0a4b32d348ca admin admin] PATH_INFO: `/v3/projects/1b795c12898f4adaae232be11306ad71/users/25cd96a5e6fc4c8ab447b2480bf1dbd3/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:23.486178 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb662b6-976d-4aed-8f03-0a4b32d348ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b795c12898f4adaae232be11306ad71, user_id=25cd96a5e6fc4c8ab447b2480bf1dbd3, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:23.489000 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb662b6-976d-4aed-8f03-0a4b32d348ca admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:23.502150 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1287/2565] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:56:23 2022] PUT /identity/v3/projects/1b795c12898f4adaae232be11306ad71/users/25cd96a5e6fc4c8ab447b2480bf1dbd3/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:56:29.472089 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a71f7-a317-4b09-9421-28967ac25905 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:29.472585 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a71f7-a317-4b09-9421-28967ac25905 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:29.472691 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a71f7-a317-4b09-9421-28967ac25905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:29.508343 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-e90a71f7-a317-4b09-9421-28967ac25905 None None] MFA Rules not processed for user `25cd96a5e6fc4c8ab447b2480bf1dbd3`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:56:29.509658 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-e90a71f7-a317-4b09-9421-28967ac25905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:29.677140 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1279/2566] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:56:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:56:29.689301 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb662b6-976d-4aed-8f03-0a4b32d348ca admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:29.691031 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-bdb662b6-976d-4aed-8f03-0a4b32d348ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:29.821310 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb662b6-976d-4aed-8f03-0a4b32d348ca admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:29.830000 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82c3b8-b597-4560-9640-82b49d582b41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:29.830767 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82c3b8-b597-4560-9640-82b49d582b41 service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:29.831173 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82c3b8-b597-4560-9640-82b49d582b41 service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:29.831515 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82c3b8-b597-4560-9640-82b49d582b41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:29.912194 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82c3b8-b597-4560-9640-82b49d582b41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:29.914332 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82c3b8-b597-4560-9640-82b49d582b41 service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:29.941080 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1288/2567] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:56:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:56:33.199455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2db2ef-5c35-4677-a125-28932567916a None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:33.199935 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2db2ef-5c35-4677-a125-28932567916a None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:33.200347 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2db2ef-5c35-4677-a125-28932567916a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:33.223275 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-db2db2ef-5c35-4677-a125-28932567916a None None] MFA Rules not processed for user `c5ae7ce87dd0438d9bbbc4fb35cfbc5c`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:56:33.224273 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-db2db2ef-5c35-4677-a125-28932567916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:33.289097 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1280/2568] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:56:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:56:35.344603 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fe866-1dcb-429d-b6c8-beb1172e5c40 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:35.345149 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fe866-1dcb-429d-b6c8-beb1172e5c40 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:35.345572 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fe866-1dcb-429d-b6c8-beb1172e5c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:35.368512 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-121fe866-1dcb-429d-b6c8-beb1172e5c40 None None] MFA Rules not processed for user `3b3dbe4735a54de1825abc28ecf00b84`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:56:35.370420 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-121fe866-1dcb-429d-b6c8-beb1172e5c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:35.443698 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1289/2569] 10.222.0.31 () {58 vars in 1009 bytes} [Mon Jan 10 17:56:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:56:35.458794 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2db2ef-5c35-4677-a125-28932567916a None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:56:35.533508 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2db2ef-5c35-4677-a125-28932567916a None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:56:35.538960 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febe0bb-ed7c-49ed-92ae-318bd370b65f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257a86ce85b4b4386cde32c8ed4b39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:56:35.539904 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febe0bb-ed7c-49ed-92ae-318bd370b65f service swift] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:35.540360 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febe0bb-ed7c-49ed-92ae-318bd370b65f service swift] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:35.540635 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febe0bb-ed7c-49ed-92ae-318bd370b65f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:35.551067 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febe0bb-ed7c-49ed-92ae-318bd370b65f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:56:35.554542 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febe0bb-ed7c-49ed-92ae-318bd370b65f service swift] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:56:35.565795 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1281/2570] 10.222.0.31 () {60 vars in 1384 bytes} [Mon Jan 10 17:56:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:56:48.144332 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08dd23e-6f08-46cf-8d22-99069c11b3c4 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:56:48.144941 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08dd23e-6f08-46cf-8d22-99069c11b3c4 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:56:48.144941 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08dd23e-6f08-46cf-8d22-99069c11b3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:56:48.163636 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-d08dd23e-6f08-46cf-8d22-99069c11b3c4 None None] MFA Rules not processed for user `e620249a17b347e98b3fb78f1cbba2db`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:56:48.164889 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-d08dd23e-6f08-46cf-8d22-99069c11b3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:56:48.172786 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1290/2571] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:56:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:03.044148 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febe0bb-ed7c-49ed-92ae-318bd370b65f service swift] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:03.046463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-2febe0bb-ed7c-49ed-92ae-318bd370b65f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:03.109404 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febe0bb-ed7c-49ed-92ae-318bd370b65f service swift] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:03.112925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dfc20-9cad-41cc-a2e5-33b847e26811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:03.113581 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dfc20-9cad-41cc-a2e5-33b847e26811 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:03.113864 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dfc20-9cad-41cc-a2e5-33b847e26811 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:03.114140 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dfc20-9cad-41cc-a2e5-33b847e26811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:03.115894 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-ac8dfc20-9cad-41cc-a2e5-33b847e26811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:03.179668 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dfc20-9cad-41cc-a2e5-33b847e26811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:03.181147 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dfc20-9cad-41cc-a2e5-33b847e26811 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:03.191055 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1282/2572] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:04.310984 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08dd23e-6f08-46cf-8d22-99069c11b3c4 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:04.322128 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08dd23e-6f08-46cf-8d22-99069c11b3c4 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:04.326095 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c5b2c-4de5-4b33-9ad5-00022a9d67fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:04.326752 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c5b2c-4de5-4b33-9ad5-00022a9d67fe service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:04.327034 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c5b2c-4de5-4b33-9ad5-00022a9d67fe service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:04.327309 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c5b2c-4de5-4b33-9ad5-00022a9d67fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:04.402400 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c5b2c-4de5-4b33-9ad5-00022a9d67fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:04.404143 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c5b2c-4de5-4b33-9ad5-00022a9d67fe service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:04.425342 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1291/2573] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:07.251760 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dfc20-9cad-41cc-a2e5-33b847e26811 service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:07.266211 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dfc20-9cad-41cc-a2e5-33b847e26811 service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:07.277277 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9ab6a-47e0-4cba-926d-cff89dc1689c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:07.278199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9ab6a-47e0-4cba-926d-cff89dc1689c service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:07.278635 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9ab6a-47e0-4cba-926d-cff89dc1689c service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:07.279100 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9ab6a-47e0-4cba-926d-cff89dc1689c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:07.282198 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-cae9ab6a-47e0-4cba-926d-cff89dc1689c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:07.302068 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9ab6a-47e0-4cba-926d-cff89dc1689c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:07.309333 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9ab6a-47e0-4cba-926d-cff89dc1689c service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:07.350708 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1283/2574] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:08.476220 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c5b2c-4de5-4b33-9ad5-00022a9d67fe service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:08.488363 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c5b2c-4de5-4b33-9ad5-00022a9d67fe service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:08.496647 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6425d-f4b3-4c61-b298-6bc408bcc6a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:08.497471 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6425d-f4b3-4c61-b298-6bc408bcc6a6 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:08.497824 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6425d-f4b3-4c61-b298-6bc408bcc6a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:08.498208 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6425d-f4b3-4c61-b298-6bc408bcc6a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:08.519257 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9ab6a-47e0-4cba-926d-cff89dc1689c service nova] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:08.520181 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6425d-f4b3-4c61-b298-6bc408bcc6a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:08.522279 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6425d-f4b3-4c61-b298-6bc408bcc6a6 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:08.522583 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-cae9ab6a-47e0-4cba-926d-cff89dc1689c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:08.544128 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1292/2575] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:08.545690 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9ab6a-47e0-4cba-926d-cff89dc1689c service nova] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:08.570818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622db61-d5f0-4b6a-a5ee-8c3f05a4bf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:08.571823 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622db61-d5f0-4b6a-a5ee-8c3f05a4bf8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:08.572327 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622db61-d5f0-4b6a-a5ee-8c3f05a4bf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:08.575250 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622db61-d5f0-4b6a-a5ee-8c3f05a4bf8b admin admin] PATH_INFO: `/v3/users/d0e34ddaca124f638fdf8e43fbb08437` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:08.577567 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622db61-d5f0-4b6a-a5ee-8c3f05a4bf8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e34ddaca124f638fdf8e43fbb08437)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:08.579765 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622db61-d5f0-4b6a-a5ee-8c3f05a4bf8b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:08.644377 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-7622db61-d5f0-4b6a-a5ee-8c3f05a4bf8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e34ddaca124f638fdf8e43fbb08437'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:08.661722 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-7622db61-d5f0-4b6a-a5ee-8c3f05a4bf8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e34ddaca124f638fdf8e43fbb08437'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:08.679633 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-7622db61-d5f0-4b6a-a5ee-8c3f05a4bf8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e34ddaca124f638fdf8e43fbb08437'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:08.690162 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-7622db61-d5f0-4b6a-a5ee-8c3f05a4bf8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e34ddaca124f638fdf8e43fbb08437'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:08.691331 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-7622db61-d5f0-4b6a-a5ee-8c3f05a4bf8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e34ddaca124f638fdf8e43fbb08437'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:08.702833 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1284/2576] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:08 2022] DELETE /identity/v3/users/d0e34ddaca124f638fdf8e43fbb08437 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:57:09.040476 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6425d-f4b3-4c61-b298-6bc408bcc6a6 service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:09.059786 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6425d-f4b3-4c61-b298-6bc408bcc6a6 service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:09.159401 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4338a5-874c-43aa-9ea3-ac0f6d4b42f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:09.160699 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4338a5-874c-43aa-9ea3-ac0f6d4b42f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:09.161013 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4338a5-874c-43aa-9ea3-ac0f6d4b42f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:09.161470 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4338a5-874c-43aa-9ea3-ac0f6d4b42f7 admin admin] PATH_INFO: `/v3/projects/a256dbcb3e024f32bd6f56fbc869046c` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:09.163216 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4338a5-874c-43aa-9ea3-ac0f6d4b42f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a256dbcb3e024f32bd6f56fbc869046c)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:09.165657 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4338a5-874c-43aa-9ea3-ac0f6d4b42f7 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:09.218936 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-7e4338a5-874c-43aa-9ea3-ac0f6d4b42f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a256dbcb3e024f32bd6f56fbc869046c', 'request_id': 'req-7e4338a5-874c-43aa-9ea3-ac0f6d4b42f7'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:09.225700 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-7e4338a5-874c-43aa-9ea3-ac0f6d4b42f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a256dbcb3e024f32bd6f56fbc869046c', 'request_id': 'req-7e4338a5-874c-43aa-9ea3-ac0f6d4b42f7'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:09.234723 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-7e4338a5-874c-43aa-9ea3-ac0f6d4b42f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a256dbcb3e024f32bd6f56fbc869046c', 'request_id': 'req-7e4338a5-874c-43aa-9ea3-ac0f6d4b42f7'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:09.248801 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-7e4338a5-874c-43aa-9ea3-ac0f6d4b42f7 admin admin] The token cache is being invalidate because project a256dbcb3e024f32bd6f56fbc869046c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:09.249122 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-7e4338a5-874c-43aa-9ea3-ac0f6d4b42f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:09.249989 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-7e4338a5-874c-43aa-9ea3-ac0f6d4b42f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:09.252345 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1293/2577] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:09 2022] DELETE /identity/v3/projects/a256dbcb3e024f32bd6f56fbc869046c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:09.257920 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47981a-c8cd-4a3b-a2c4-c995d01d704b None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:09.258402 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47981a-c8cd-4a3b-a2c4-c995d01d704b None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:09.258882 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47981a-c8cd-4a3b-a2c4-c995d01d704b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:09.279415 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-ba47981a-c8cd-4a3b-a2c4-c995d01d704b None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:09.280999 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-ba47981a-c8cd-4a3b-a2c4-c995d01d704b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:09.354865 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1285/2578] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:09.363387 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de95e8-8f11-4ab0-a62f-2d48e3bf4da2 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:09.363719 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de95e8-8f11-4ab0-a62f-2d48e3bf4da2 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:09.364004 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de95e8-8f11-4ab0-a62f-2d48e3bf4da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:09.385117 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-36de95e8-8f11-4ab0-a62f-2d48e3bf4da2 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:09.386379 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-36de95e8-8f11-4ab0-a62f-2d48e3bf4da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:09.394720 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1294/2579] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:09.399917 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47981a-c8cd-4a3b-a2c4-c995d01d704b None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:09.424818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47981a-c8cd-4a3b-a2c4-c995d01d704b None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:09.432598 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282a540-3e3f-4bc8-a84d-7e4f6675091d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:09.433735 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282a540-3e3f-4bc8-a84d-7e4f6675091d admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:09.434021 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282a540-3e3f-4bc8-a84d-7e4f6675091d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:09.434294 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282a540-3e3f-4bc8-a84d-7e4f6675091d admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:09.435047 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282a540-3e3f-4bc8-a84d-7e4f6675091d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:57:09.435354 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282a540-3e3f-4bc8-a84d-7e4f6675091d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:09.437069 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282a540-3e3f-4bc8-a84d-7e4f6675091d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:09.452109 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1286/2580] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:57:09.456439 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de95e8-8f11-4ab0-a62f-2d48e3bf4da2 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:09.467284 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de95e8-8f11-4ab0-a62f-2d48e3bf4da2 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:09.474605 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e08918-94a2-4680-89b9-3873767fe88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:09.475520 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e08918-94a2-4680-89b9-3873767fe88f admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:09.476061 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e08918-94a2-4680-89b9-3873767fe88f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:09.476760 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e08918-94a2-4680-89b9-3873767fe88f admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:09.480929 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e08918-94a2-4680-89b9-3873767fe88f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:09.483786 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e08918-94a2-4680-89b9-3873767fe88f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:09.532356 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1295/2581] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:57:09 2022] POST /identity/v3/projects => generated 363 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:09.536611 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282a540-3e3f-4bc8-a84d-7e4f6675091d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:09.547444 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282a540-3e3f-4bc8-a84d-7e4f6675091d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:09.616774 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd066c6d-eaa2-47e0-90c5-ebb8aefb0dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:09.617534 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd066c6d-eaa2-47e0-90c5-ebb8aefb0dad admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:09.617884 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd066c6d-eaa2-47e0-90c5-ebb8aefb0dad admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:09.618219 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd066c6d-eaa2-47e0-90c5-ebb8aefb0dad admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:09.619773 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd066c6d-eaa2-47e0-90c5-ebb8aefb0dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:09.622127 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd066c6d-eaa2-47e0-90c5-ebb8aefb0dad admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:09.658848 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1287/2582] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:57:09 2022] POST /identity/v3/users => generated 282 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:09.662600 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e08918-94a2-4680-89b9-3873767fe88f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:09.677289 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e08918-94a2-4680-89b9-3873767fe88f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:09.682637 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9ee02-efed-440e-b642-d92f77795c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:09.683853 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9ee02-efed-440e-b642-d92f77795c56 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:09.684623 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9ee02-efed-440e-b642-d92f77795c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:09.685194 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9ee02-efed-440e-b642-d92f77795c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:09.686181 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9ee02-efed-440e-b642-d92f77795c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:09.688620 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9ee02-efed-440e-b642-d92f77795c56 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:09.705519 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd066c6d-eaa2-47e0-90c5-ebb8aefb0dad admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:09.706992 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1296/2583] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:57:09.717544 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd066c6d-eaa2-47e0-90c5-ebb8aefb0dad admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:09.723513 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522abff-152d-4acb-bf04-e4a8d46c5f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:09.724772 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522abff-152d-4acb-bf04-e4a8d46c5f01 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:09.725463 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522abff-152d-4acb-bf04-e4a8d46c5f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:09.726004 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522abff-152d-4acb-bf04-e4a8d46c5f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:09.726965 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522abff-152d-4acb-bf04-e4a8d46c5f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:09.729560 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522abff-152d-4acb-bf04-e4a8d46c5f01 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:09.744700 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1288/2584] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:57:09.749741 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9ee02-efed-440e-b642-d92f77795c56 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:09.761113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9ee02-efed-440e-b642-d92f77795c56 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:09.766730 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07134908-8a7f-48e6-85f5-6c1c5a3fe0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:09.768071 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07134908-8a7f-48e6-85f5-6c1c5a3fe0eb admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:09.768605 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07134908-8a7f-48e6-85f5-6c1c5a3fe0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:09.769384 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07134908-8a7f-48e6-85f5-6c1c5a3fe0eb admin admin] PATH_INFO: `/v3/projects/caf55dd1f47c4bfdb137fee96a9aae60/users/2c0238d0ddcf4b919401bc740d761490/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:09.788120 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07134908-8a7f-48e6-85f5-6c1c5a3fe0eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf55dd1f47c4bfdb137fee96a9aae60, user_id=2c0238d0ddcf4b919401bc740d761490, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:09.791786 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07134908-8a7f-48e6-85f5-6c1c5a3fe0eb admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:09.811774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1297/2585] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:09 2022] PUT /identity/v3/projects/caf55dd1f47c4bfdb137fee96a9aae60/users/2c0238d0ddcf4b919401bc740d761490/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:09.822552 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d560f-623d-47bf-b40e-2c8e0d2ae92a None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:09.822865 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d560f-623d-47bf-b40e-2c8e0d2ae92a None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:09.823142 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d560f-623d-47bf-b40e-2c8e0d2ae92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:09.863575 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b35d560f-623d-47bf-b40e-2c8e0d2ae92a None None] MFA Rules not processed for user `2c0238d0ddcf4b919401bc740d761490`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:09.865567 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b35d560f-623d-47bf-b40e-2c8e0d2ae92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:09.960927 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07134908-8a7f-48e6-85f5-6c1c5a3fe0eb admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:09.961357 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1289/2586] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:09 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:10.059075 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07134908-8a7f-48e6-85f5-6c1c5a3fe0eb admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:10.074680 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0e7c8-3d2a-4fe5-96dd-5f81c657b03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:10.075462 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0e7c8-3d2a-4fe5-96dd-5f81c657b03d admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:10.075746 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0e7c8-3d2a-4fe5-96dd-5f81c657b03d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:10.076017 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0e7c8-3d2a-4fe5-96dd-5f81c657b03d admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:10.076728 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0e7c8-3d2a-4fe5-96dd-5f81c657b03d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:10.081076 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0e7c8-3d2a-4fe5-96dd-5f81c657b03d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:10.117561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1298/2587] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:57:09 2022] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:57:10.121712 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d560f-623d-47bf-b40e-2c8e0d2ae92a None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:10.150915 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d560f-623d-47bf-b40e-2c8e0d2ae92a None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:10.235334 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1067c9c-92f1-4a5f-8cee-cf6a6bb96b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:10.236337 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1067c9c-92f1-4a5f-8cee-cf6a6bb96b3e admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:10.237204 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1067c9c-92f1-4a5f-8cee-cf6a6bb96b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:10.237563 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1067c9c-92f1-4a5f-8cee-cf6a6bb96b3e admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:10.238349 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1067c9c-92f1-4a5f-8cee-cf6a6bb96b3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:10.240366 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1067c9c-92f1-4a5f-8cee-cf6a6bb96b3e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:10.276417 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1290/2588] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:57:10 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:57:10.277640 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0e7c8-3d2a-4fe5-96dd-5f81c657b03d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:10.293127 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0e7c8-3d2a-4fe5-96dd-5f81c657b03d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:10.301649 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e978a0-599a-4f65-aa85-e4b62311ad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:10.302794 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e978a0-599a-4f65-aa85-e4b62311ad9e admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:10.303401 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e978a0-599a-4f65-aa85-e4b62311ad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:10.303866 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e978a0-599a-4f65-aa85-e4b62311ad9e admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:10.304803 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e978a0-599a-4f65-aa85-e4b62311ad9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:10.306928 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e978a0-599a-4f65-aa85-e4b62311ad9e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:10.320753 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1299/2589] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:10.324659 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1067c9c-92f1-4a5f-8cee-cf6a6bb96b3e admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:10.334958 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1067c9c-92f1-4a5f-8cee-cf6a6bb96b3e admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:10.341252 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a84c5f-95ea-473e-a60c-0c21177cb5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:10.342333 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a84c5f-95ea-473e-a60c-0c21177cb5d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:10.343277 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a84c5f-95ea-473e-a60c-0c21177cb5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:10.343650 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a84c5f-95ea-473e-a60c-0c21177cb5d2 admin admin] PATH_INFO: `/v3/projects/4da86af32e0548de8dfc2a859d239599/users/1170e4a5e069412ba4e4a78e1a48ecdb/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:10.383148 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a84c5f-95ea-473e-a60c-0c21177cb5d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da86af32e0548de8dfc2a859d239599, user_id=1170e4a5e069412ba4e4a78e1a48ecdb, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:10.385947 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a84c5f-95ea-473e-a60c-0c21177cb5d2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:10.407019 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1291/2590] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:10 2022] PUT /identity/v3/projects/4da86af32e0548de8dfc2a859d239599/users/1170e4a5e069412ba4e4a78e1a48ecdb/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:10.408720 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e978a0-599a-4f65-aa85-e4b62311ad9e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:10.420398 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e978a0-599a-4f65-aa85-e4b62311ad9e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:10.536467 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a4984-511f-43a4-a7a6-894723b02ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:10.537193 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a4984-511f-43a4-a7a6-894723b02ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:10.537572 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a4984-511f-43a4-a7a6-894723b02ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:10.537913 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a4984-511f-43a4-a7a6-894723b02ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:10.538722 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a4984-511f-43a4-a7a6-894723b02ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:10.541147 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a4984-511f-43a4-a7a6-894723b02ac5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:10.555851 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1300/2591] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:10.558997 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a84c5f-95ea-473e-a60c-0c21177cb5d2 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:10.570999 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a84c5f-95ea-473e-a60c-0c21177cb5d2 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:10.576467 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c909731-aa36-4845-ba9f-276c82fd8cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:10.577665 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c909731-aa36-4845-ba9f-276c82fd8cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:10.578136 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c909731-aa36-4845-ba9f-276c82fd8cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:10.578572 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c909731-aa36-4845-ba9f-276c82fd8cd6 admin admin] PATH_INFO: `/v3/projects/4da86af32e0548de8dfc2a859d239599/users/1170e4a5e069412ba4e4a78e1a48ecdb/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:10.583435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c909731-aa36-4845-ba9f-276c82fd8cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da86af32e0548de8dfc2a859d239599, user_id=1170e4a5e069412ba4e4a78e1a48ecdb, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:10.591237 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c909731-aa36-4845-ba9f-276c82fd8cd6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:10.664062 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1292/2592] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:10 2022] PUT /identity/v3/projects/4da86af32e0548de8dfc2a859d239599/users/1170e4a5e069412ba4e4a78e1a48ecdb/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:57:10.665262 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4807f6a-91dc-492d-9e92-bda72d600556 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:10.665635 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4807f6a-91dc-492d-9e92-bda72d600556 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:10.667048 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4807f6a-91dc-492d-9e92-bda72d600556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:10.735021 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-c4807f6a-91dc-492d-9e92-bda72d600556 None None] MFA Rules not processed for user `1170e4a5e069412ba4e4a78e1a48ecdb`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:10.737242 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-c4807f6a-91dc-492d-9e92-bda72d600556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:10.861928 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1301/2593] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:10 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:10.873736 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c909731-aa36-4845-ba9f-276c82fd8cd6 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:10.875704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-9c909731-aa36-4845-ba9f-276c82fd8cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:10.974012 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c909731-aa36-4845-ba9f-276c82fd8cd6 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:10.978442 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21cb41-2de4-4d45-a648-840489f0d892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:10.979733 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21cb41-2de4-4d45-a648-840489f0d892 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:10.979733 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21cb41-2de4-4d45-a648-840489f0d892 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:10.979733 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21cb41-2de4-4d45-a648-840489f0d892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:10.989911 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21cb41-2de4-4d45-a648-840489f0d892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:10.991540 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21cb41-2de4-4d45-a648-840489f0d892 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:11.003673 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1293/2594] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:10 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:11.108443 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4807f6a-91dc-492d-9e92-bda72d600556 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:11.119423 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4807f6a-91dc-492d-9e92-bda72d600556 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:11.123169 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e92a2-068b-4d6a-8a0b-98d977f5534d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:11.123922 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e92a2-068b-4d6a-8a0b-98d977f5534d service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:11.124281 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e92a2-068b-4d6a-8a0b-98d977f5534d service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:11.124625 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e92a2-068b-4d6a-8a0b-98d977f5534d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:11.205699 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e92a2-068b-4d6a-8a0b-98d977f5534d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:11.207314 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e92a2-068b-4d6a-8a0b-98d977f5534d service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:11.218865 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1302/2595] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:11 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:13.994903 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21cb41-2de4-4d45-a648-840489f0d892 service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:14.065575 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21cb41-2de4-4d45-a648-840489f0d892 service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:14.071528 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be33a8c-3775-4604-8970-d432a7cf0713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:14.072443 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be33a8c-3775-4604-8970-d432a7cf0713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:14.072704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be33a8c-3775-4604-8970-d432a7cf0713 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:14.073003 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be33a8c-3775-4604-8970-d432a7cf0713 admin admin] PATH_INFO: `/v3/users/2c0238d0ddcf4b919401bc740d761490` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:14.074391 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be33a8c-3775-4604-8970-d432a7cf0713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c0238d0ddcf4b919401bc740d761490)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:14.077458 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be33a8c-3775-4604-8970-d432a7cf0713 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:14.125127 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1be33a8c-3775-4604-8970-d432a7cf0713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c0238d0ddcf4b919401bc740d761490'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:14.137315 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1be33a8c-3775-4604-8970-d432a7cf0713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c0238d0ddcf4b919401bc740d761490'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:14.145015 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1be33a8c-3775-4604-8970-d432a7cf0713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c0238d0ddcf4b919401bc740d761490'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:14.155824 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1be33a8c-3775-4604-8970-d432a7cf0713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c0238d0ddcf4b919401bc740d761490'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:14.156634 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1be33a8c-3775-4604-8970-d432a7cf0713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c0238d0ddcf4b919401bc740d761490'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:14.163155 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1294/2596] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:13 2022] DELETE /identity/v3/users/2c0238d0ddcf4b919401bc740d761490 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:14.168099 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f286fc-c94d-4925-901a-bfc9fa6d7536 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:14.168593 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f286fc-c94d-4925-901a-bfc9fa6d7536 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:14.168686 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f286fc-c94d-4925-901a-bfc9fa6d7536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:14.185765 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-d3f286fc-c94d-4925-901a-bfc9fa6d7536 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:14.187065 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-d3f286fc-c94d-4925-901a-bfc9fa6d7536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:14.249282 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1303/2597] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:14.259245 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be33a8c-3775-4604-8970-d432a7cf0713 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:14.260993 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-1be33a8c-3775-4604-8970-d432a7cf0713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:14.328183 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be33a8c-3775-4604-8970-d432a7cf0713 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:14.336903 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb56c67-3563-4c00-baf4-bf3d53365883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:14.337716 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb56c67-3563-4c00-baf4-bf3d53365883 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:14.337993 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb56c67-3563-4c00-baf4-bf3d53365883 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:14.338290 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb56c67-3563-4c00-baf4-bf3d53365883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:14.352467 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb56c67-3563-4c00-baf4-bf3d53365883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:14.354157 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb56c67-3563-4c00-baf4-bf3d53365883 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:14.366073 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1295/2598] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:14.644197 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f286fc-c94d-4925-901a-bfc9fa6d7536 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:14.646429 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-d3f286fc-c94d-4925-901a-bfc9fa6d7536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:14.660606 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f286fc-c94d-4925-901a-bfc9fa6d7536 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:14.666478 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384980f-5e6b-4bf3-a5ba-a1f279b9834e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:14.667472 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384980f-5e6b-4bf3-a5ba-a1f279b9834e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:14.667761 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384980f-5e6b-4bf3-a5ba-a1f279b9834e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:14.668061 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384980f-5e6b-4bf3-a5ba-a1f279b9834e admin admin] PATH_INFO: `/v3/projects/caf55dd1f47c4bfdb137fee96a9aae60` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:14.669563 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384980f-5e6b-4bf3-a5ba-a1f279b9834e admin admin] RBAC: Authorizing `identity:delete_project(project_id=caf55dd1f47c4bfdb137fee96a9aae60)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:14.671584 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384980f-5e6b-4bf3-a5ba-a1f279b9834e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:14.724266 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6384980f-5e6b-4bf3-a5ba-a1f279b9834e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf55dd1f47c4bfdb137fee96a9aae60', 'request_id': 'req-6384980f-5e6b-4bf3-a5ba-a1f279b9834e'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:14.730670 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6384980f-5e6b-4bf3-a5ba-a1f279b9834e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf55dd1f47c4bfdb137fee96a9aae60', 'request_id': 'req-6384980f-5e6b-4bf3-a5ba-a1f279b9834e'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:14.739493 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6384980f-5e6b-4bf3-a5ba-a1f279b9834e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf55dd1f47c4bfdb137fee96a9aae60', 'request_id': 'req-6384980f-5e6b-4bf3-a5ba-a1f279b9834e'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:14.754744 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6384980f-5e6b-4bf3-a5ba-a1f279b9834e admin admin] The token cache is being invalidate because project caf55dd1f47c4bfdb137fee96a9aae60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:14.755078 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6384980f-5e6b-4bf3-a5ba-a1f279b9834e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:14.755981 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6384980f-5e6b-4bf3-a5ba-a1f279b9834e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:14.758196 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1304/2599] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:14 2022] DELETE /identity/v3/projects/caf55dd1f47c4bfdb137fee96a9aae60 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:14.771298 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb56c67-3563-4c00-baf4-bf3d53365883 service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:14.782468 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb56c67-3563-4c00-baf4-bf3d53365883 service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:14.840387 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e196a-510e-4300-bf43-76bed8a2aa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:14.841314 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e196a-510e-4300-bf43-76bed8a2aa4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:14.841595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e196a-510e-4300-bf43-76bed8a2aa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:14.841872 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e196a-510e-4300-bf43-76bed8a2aa4e admin admin] PATH_INFO: `/v3/users/1170e4a5e069412ba4e4a78e1a48ecdb` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:14.843178 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e196a-510e-4300-bf43-76bed8a2aa4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1170e4a5e069412ba4e4a78e1a48ecdb)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:14.845211 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e196a-510e-4300-bf43-76bed8a2aa4e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:14.891164 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-3b3e196a-510e-4300-bf43-76bed8a2aa4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1170e4a5e069412ba4e4a78e1a48ecdb'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:14.904645 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-3b3e196a-510e-4300-bf43-76bed8a2aa4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1170e4a5e069412ba4e4a78e1a48ecdb'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:14.912282 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-3b3e196a-510e-4300-bf43-76bed8a2aa4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1170e4a5e069412ba4e4a78e1a48ecdb'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:14.921652 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-3b3e196a-510e-4300-bf43-76bed8a2aa4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1170e4a5e069412ba4e4a78e1a48ecdb'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:14.922320 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-3b3e196a-510e-4300-bf43-76bed8a2aa4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1170e4a5e069412ba4e4a78e1a48ecdb'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:14.928751 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1296/2600] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:14 2022] DELETE /identity/v3/users/1170e4a5e069412ba4e4a78e1a48ecdb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:15.213448 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384980f-5e6b-4bf3-a5ba-a1f279b9834e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:15.215236 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-6384980f-5e6b-4bf3-a5ba-a1f279b9834e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:15.228322 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384980f-5e6b-4bf3-a5ba-a1f279b9834e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:15.288138 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e85a4c-bb6d-4ce5-8f41-d34360c3dfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:15.289871 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e85a4c-bb6d-4ce5-8f41-d34360c3dfde admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:15.290431 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e85a4c-bb6d-4ce5-8f41-d34360c3dfde admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:15.291086 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e85a4c-bb6d-4ce5-8f41-d34360c3dfde admin admin] PATH_INFO: `/v3/projects/4da86af32e0548de8dfc2a859d239599` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:15.293656 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e85a4c-bb6d-4ce5-8f41-d34360c3dfde admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da86af32e0548de8dfc2a859d239599)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:15.297335 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e85a4c-bb6d-4ce5-8f41-d34360c3dfde admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:15.364278 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f5e85a4c-bb6d-4ce5-8f41-d34360c3dfde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da86af32e0548de8dfc2a859d239599', 'request_id': 'req-f5e85a4c-bb6d-4ce5-8f41-d34360c3dfde'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:15.371472 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f5e85a4c-bb6d-4ce5-8f41-d34360c3dfde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da86af32e0548de8dfc2a859d239599', 'request_id': 'req-f5e85a4c-bb6d-4ce5-8f41-d34360c3dfde'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:15.381243 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f5e85a4c-bb6d-4ce5-8f41-d34360c3dfde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da86af32e0548de8dfc2a859d239599', 'request_id': 'req-f5e85a4c-bb6d-4ce5-8f41-d34360c3dfde'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:15.395857 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f5e85a4c-bb6d-4ce5-8f41-d34360c3dfde admin admin] The token cache is being invalidate because project 4da86af32e0548de8dfc2a859d239599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:15.396147 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f5e85a4c-bb6d-4ce5-8f41-d34360c3dfde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:15.396872 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f5e85a4c-bb6d-4ce5-8f41-d34360c3dfde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:15.398591 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1305/2601] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:15 2022] DELETE /identity/v3/projects/4da86af32e0548de8dfc2a859d239599 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:15.407095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb3513-36bf-439c-80d2-dee809801968 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:15.407621 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb3513-36bf-439c-80d2-dee809801968 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:15.407729 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb3513-36bf-439c-80d2-dee809801968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:15.427804 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-41bb3513-36bf-439c-80d2-dee809801968 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:15.429080 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-41bb3513-36bf-439c-80d2-dee809801968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:15.507762 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1297/2602] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:15.516889 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd261ed4-7937-47ef-952e-75a75cba1db0 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:15.517209 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd261ed4-7937-47ef-952e-75a75cba1db0 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:15.517497 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd261ed4-7937-47ef-952e-75a75cba1db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:15.537975 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-bd261ed4-7937-47ef-952e-75a75cba1db0 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:15.539177 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-bd261ed4-7937-47ef-952e-75a75cba1db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:15.548690 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1306/2603] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:15.553285 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb3513-36bf-439c-80d2-dee809801968 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:15.563614 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb3513-36bf-439c-80d2-dee809801968 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:15.569465 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c902356-d6f3-4d3c-a7b6-68b6809835a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:15.570188 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c902356-d6f3-4d3c-a7b6-68b6809835a4 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:15.570464 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c902356-d6f3-4d3c-a7b6-68b6809835a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:15.570725 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c902356-d6f3-4d3c-a7b6-68b6809835a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:15.571466 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c902356-d6f3-4d3c-a7b6-68b6809835a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:57:15.571790 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c902356-d6f3-4d3c-a7b6-68b6809835a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:15.573510 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c902356-d6f3-4d3c-a7b6-68b6809835a4 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:15.585439 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1298/2604] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:57:15.589962 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd261ed4-7937-47ef-952e-75a75cba1db0 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:15.599994 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd261ed4-7937-47ef-952e-75a75cba1db0 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:15.605786 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617cf7c-fc37-4f34-b16d-747904c2cc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:15.606446 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617cf7c-fc37-4f34-b16d-747904c2cc90 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:15.606730 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617cf7c-fc37-4f34-b16d-747904c2cc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:15.607007 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617cf7c-fc37-4f34-b16d-747904c2cc90 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:15.607731 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617cf7c-fc37-4f34-b16d-747904c2cc90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:15.609678 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617cf7c-fc37-4f34-b16d-747904c2cc90 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:15.639412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1307/2605] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:57:15 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:15.643663 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c902356-d6f3-4d3c-a7b6-68b6809835a4 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:15.653790 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c902356-d6f3-4d3c-a7b6-68b6809835a4 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:15.710323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a2364-bee7-47d7-8ce3-a081f63fed80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:15.710982 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a2364-bee7-47d7-8ce3-a081f63fed80 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:15.711267 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a2364-bee7-47d7-8ce3-a081f63fed80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:15.711540 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a2364-bee7-47d7-8ce3-a081f63fed80 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:15.712242 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a2364-bee7-47d7-8ce3-a081f63fed80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:15.714362 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a2364-bee7-47d7-8ce3-a081f63fed80 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:15.739056 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1299/2606] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:57:15 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:15.743266 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617cf7c-fc37-4f34-b16d-747904c2cc90 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:15.753889 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617cf7c-fc37-4f34-b16d-747904c2cc90 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:15.759390 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dade3-76fd-479b-806a-aa138a94a939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:15.760043 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dade3-76fd-479b-806a-aa138a94a939 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:15.760316 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dade3-76fd-479b-806a-aa138a94a939 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:15.760611 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dade3-76fd-479b-806a-aa138a94a939 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:15.761363 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dade3-76fd-479b-806a-aa138a94a939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:15.763060 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dade3-76fd-479b-806a-aa138a94a939 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:15.773599 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1308/2607] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:15.778850 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a2364-bee7-47d7-8ce3-a081f63fed80 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:15.794096 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a2364-bee7-47d7-8ce3-a081f63fed80 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:15.801358 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b410b-7b6d-4d74-a274-64d7d5eab5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:15.802214 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b410b-7b6d-4d74-a274-64d7d5eab5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:15.802519 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b410b-7b6d-4d74-a274-64d7d5eab5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:15.802816 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b410b-7b6d-4d74-a274-64d7d5eab5b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:15.803854 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b410b-7b6d-4d74-a274-64d7d5eab5b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:15.806156 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b410b-7b6d-4d74-a274-64d7d5eab5b5 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:15.816607 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1300/2608] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:57:15.822424 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dade3-76fd-479b-806a-aa138a94a939 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:15.837777 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dade3-76fd-479b-806a-aa138a94a939 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:15.844028 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d2947-1273-457d-b2e1-133ea302c2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:15.844938 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d2947-1273-457d-b2e1-133ea302c2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:15.845222 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d2947-1273-457d-b2e1-133ea302c2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:15.845498 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d2947-1273-457d-b2e1-133ea302c2f6 admin admin] PATH_INFO: `/v3/projects/cf84ad032d1a43ce8429755f0fc34372/users/82406e9c2daf47339ea9326dec3e1a70/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:15.860430 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d2947-1273-457d-b2e1-133ea302c2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf84ad032d1a43ce8429755f0fc34372, user_id=82406e9c2daf47339ea9326dec3e1a70, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:15.863131 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d2947-1273-457d-b2e1-133ea302c2f6 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:15.879284 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1309/2609] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:15 2022] PUT /identity/v3/projects/cf84ad032d1a43ce8429755f0fc34372/users/82406e9c2daf47339ea9326dec3e1a70/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:15.891776 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2004dbd-1e24-4b8a-86b5-68dd91eb8b85 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:15.892085 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2004dbd-1e24-4b8a-86b5-68dd91eb8b85 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:15.892345 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2004dbd-1e24-4b8a-86b5-68dd91eb8b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:15.929568 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b2004dbd-1e24-4b8a-86b5-68dd91eb8b85 None None] MFA Rules not processed for user `82406e9c2daf47339ea9326dec3e1a70`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:15.930756 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b2004dbd-1e24-4b8a-86b5-68dd91eb8b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:15.949861 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d2947-1273-457d-b2e1-133ea302c2f6 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:15.951586 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-fe8d2947-1273-457d-b2e1-133ea302c2f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:15.997113 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1301/2610] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:16.001638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2004dbd-1e24-4b8a-86b5-68dd91eb8b85 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:16.008720 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d2947-1273-457d-b2e1-133ea302c2f6 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:16.012533 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada1643-0d6f-481c-be06-09a88c3750d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:16.013345 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada1643-0d6f-481c-be06-09a88c3750d3 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:16.013689 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada1643-0d6f-481c-be06-09a88c3750d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:16.013970 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada1643-0d6f-481c-be06-09a88c3750d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:16.015796 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-0ada1643-0d6f-481c-be06-09a88c3750d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:16.059379 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2004dbd-1e24-4b8a-86b5-68dd91eb8b85 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:16.063905 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75645e-dd15-48f3-85ef-5696443b107b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:16.064566 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75645e-dd15-48f3-85ef-5696443b107b admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:16.064864 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75645e-dd15-48f3-85ef-5696443b107b admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:16.065233 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75645e-dd15-48f3-85ef-5696443b107b admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:16.065947 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75645e-dd15-48f3-85ef-5696443b107b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:16.067851 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75645e-dd15-48f3-85ef-5696443b107b admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:16.077386 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada1643-0d6f-481c-be06-09a88c3750d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:16.078875 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada1643-0d6f-481c-be06-09a88c3750d3 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:16.090488 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1310/2611] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:16.096758 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1302/2612] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:57:16 2022] POST /identity/v3/projects => generated 389 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:57:16.098025 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada1643-0d6f-481c-be06-09a88c3750d3 service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:16.107757 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada1643-0d6f-481c-be06-09a88c3750d3 service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:16.164234 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd38dd-9861-4a4c-a59a-3ed0d1a8f85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:16.164882 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd38dd-9861-4a4c-a59a-3ed0d1a8f85a admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:16.165172 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd38dd-9861-4a4c-a59a-3ed0d1a8f85a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:16.165463 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd38dd-9861-4a4c-a59a-3ed0d1a8f85a admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:16.166158 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd38dd-9861-4a4c-a59a-3ed0d1a8f85a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:16.168151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd38dd-9861-4a4c-a59a-3ed0d1a8f85a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:16.190366 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1311/2613] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:57:16 2022] POST /identity/v3/users => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:16.194469 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75645e-dd15-48f3-85ef-5696443b107b admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:16.204615 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75645e-dd15-48f3-85ef-5696443b107b admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:16.209682 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cf82a-9a37-4d2e-a927-3a210ba31083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:16.210607 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cf82a-9a37-4d2e-a927-3a210ba31083 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:16.210967 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cf82a-9a37-4d2e-a927-3a210ba31083 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:16.211248 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cf82a-9a37-4d2e-a927-3a210ba31083 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:16.211995 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cf82a-9a37-4d2e-a927-3a210ba31083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:16.213661 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cf82a-9a37-4d2e-a927-3a210ba31083 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:16.224603 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1303/2614] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:16.228607 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd38dd-9861-4a4c-a59a-3ed0d1a8f85a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:16.238899 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd38dd-9861-4a4c-a59a-3ed0d1a8f85a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:16.243800 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c09603-633b-4b95-8d77-aa0c84889b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:16.244660 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c09603-633b-4b95-8d77-aa0c84889b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:16.244979 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c09603-633b-4b95-8d77-aa0c84889b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:16.245450 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c09603-633b-4b95-8d77-aa0c84889b50 admin admin] PATH_INFO: `/v3/projects/87da7f5cab3440d48a55fa43e60463d6/users/4f2a1f3c8a4f49e39edb7b3b483c4769/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:16.261280 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c09603-633b-4b95-8d77-aa0c84889b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87da7f5cab3440d48a55fa43e60463d6, user_id=4f2a1f3c8a4f49e39edb7b3b483c4769, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:16.264331 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c09603-633b-4b95-8d77-aa0c84889b50 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:16.279687 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1312/2615] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:16 2022] PUT /identity/v3/projects/87da7f5cab3440d48a55fa43e60463d6/users/4f2a1f3c8a4f49e39edb7b3b483c4769/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:16.283813 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cf82a-9a37-4d2e-a927-3a210ba31083 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:16.293910 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cf82a-9a37-4d2e-a927-3a210ba31083 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:16.348532 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be50989-f70b-4ce8-bd64-57e29331d192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:16.349242 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be50989-f70b-4ce8-bd64-57e29331d192 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:16.349526 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be50989-f70b-4ce8-bd64-57e29331d192 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:16.349802 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be50989-f70b-4ce8-bd64-57e29331d192 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:16.350554 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be50989-f70b-4ce8-bd64-57e29331d192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:16.352151 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be50989-f70b-4ce8-bd64-57e29331d192 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:16.362253 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1304/2616] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:16.366589 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c09603-633b-4b95-8d77-aa0c84889b50 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:16.377687 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c09603-633b-4b95-8d77-aa0c84889b50 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:16.382832 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72784b-14bb-42a0-8d05-0fb65a0cafc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:16.383778 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72784b-14bb-42a0-8d05-0fb65a0cafc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:16.384085 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72784b-14bb-42a0-8d05-0fb65a0cafc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:16.384543 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72784b-14bb-42a0-8d05-0fb65a0cafc2 admin admin] PATH_INFO: `/v3/projects/87da7f5cab3440d48a55fa43e60463d6/users/4f2a1f3c8a4f49e39edb7b3b483c4769/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:16.387043 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72784b-14bb-42a0-8d05-0fb65a0cafc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87da7f5cab3440d48a55fa43e60463d6, user_id=4f2a1f3c8a4f49e39edb7b3b483c4769, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:16.389896 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72784b-14bb-42a0-8d05-0fb65a0cafc2 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:16.400653 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1313/2617] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:16 2022] PUT /identity/v3/projects/87da7f5cab3440d48a55fa43e60463d6/users/4f2a1f3c8a4f49e39edb7b3b483c4769/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:16.410744 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214e77d-22d5-4852-8e5a-5ed0037a675d None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:16.411272 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214e77d-22d5-4852-8e5a-5ed0037a675d None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:16.411272 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214e77d-22d5-4852-8e5a-5ed0037a675d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:16.437676 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-3214e77d-22d5-4852-8e5a-5ed0037a675d None None] MFA Rules not processed for user `4f2a1f3c8a4f49e39edb7b3b483c4769`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:16.438879 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-3214e77d-22d5-4852-8e5a-5ed0037a675d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:16.505704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1305/2618] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:16.515228 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72784b-14bb-42a0-8d05-0fb65a0cafc2 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:16.517153 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-ac72784b-14bb-42a0-8d05-0fb65a0cafc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:16.571263 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72784b-14bb-42a0-8d05-0fb65a0cafc2 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:16.575222 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28f2d0-a3c8-4914-ab85-7e8e9c5fd4b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:16.575867 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28f2d0-a3c8-4914-ab85-7e8e9c5fd4b0 service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:16.576145 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28f2d0-a3c8-4914-ab85-7e8e9c5fd4b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:16.576418 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28f2d0-a3c8-4914-ab85-7e8e9c5fd4b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:16.585668 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28f2d0-a3c8-4914-ab85-7e8e9c5fd4b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:16.587115 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28f2d0-a3c8-4914-ab85-7e8e9c5fd4b0 service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:16.596497 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1314/2619] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:16.715434 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214e77d-22d5-4852-8e5a-5ed0037a675d None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:16.777623 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214e77d-22d5-4852-8e5a-5ed0037a675d None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:16.782386 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cdeb0-fc1d-45f9-99fb-017ae6cb1c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:16.783298 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cdeb0-fc1d-45f9-99fb-017ae6cb1c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:16.783580 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cdeb0-fc1d-45f9-99fb-017ae6cb1c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:16.783852 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cdeb0-fc1d-45f9-99fb-017ae6cb1c7f admin admin] PATH_INFO: `/v3/users/82406e9c2daf47339ea9326dec3e1a70` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:16.785097 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cdeb0-fc1d-45f9-99fb-017ae6cb1c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=82406e9c2daf47339ea9326dec3e1a70)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:16.787020 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cdeb0-fc1d-45f9-99fb-017ae6cb1c7f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:16.833652 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-432cdeb0-fc1d-45f9-99fb-017ae6cb1c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82406e9c2daf47339ea9326dec3e1a70'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:16.845465 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-432cdeb0-fc1d-45f9-99fb-017ae6cb1c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82406e9c2daf47339ea9326dec3e1a70'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:16.852542 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-432cdeb0-fc1d-45f9-99fb-017ae6cb1c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82406e9c2daf47339ea9326dec3e1a70'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:16.861138 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-432cdeb0-fc1d-45f9-99fb-017ae6cb1c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82406e9c2daf47339ea9326dec3e1a70'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:16.861832 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-432cdeb0-fc1d-45f9-99fb-017ae6cb1c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82406e9c2daf47339ea9326dec3e1a70'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:16.867915 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1306/2620] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:16 2022] DELETE /identity/v3/users/82406e9c2daf47339ea9326dec3e1a70 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:16.873584 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ac71a-e748-48e5-b4f2-82fb8064edc8 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:16.873934 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ac71a-e748-48e5-b4f2-82fb8064edc8 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:16.874216 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ac71a-e748-48e5-b4f2-82fb8064edc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:16.892142 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-eb7ac71a-e748-48e5-b4f2-82fb8064edc8 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:16.893373 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-eb7ac71a-e748-48e5-b4f2-82fb8064edc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:16.952737 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1315/2621] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:16.962591 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cdeb0-fc1d-45f9-99fb-017ae6cb1c7f admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:16.964193 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-432cdeb0-fc1d-45f9-99fb-017ae6cb1c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:17.027226 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cdeb0-fc1d-45f9-99fb-017ae6cb1c7f admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:17.036397 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557ce50-515c-479b-9ff4-c57fe9421458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:17.037114 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557ce50-515c-479b-9ff4-c57fe9421458 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:17.037402 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557ce50-515c-479b-9ff4-c57fe9421458 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:17.038138 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557ce50-515c-479b-9ff4-c57fe9421458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:17.047747 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557ce50-515c-479b-9ff4-c57fe9421458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:17.049373 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557ce50-515c-479b-9ff4-c57fe9421458 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:17.060360 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1307/2622] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:17.333712 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ac71a-e748-48e5-b4f2-82fb8064edc8 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:17.335245 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-eb7ac71a-e748-48e5-b4f2-82fb8064edc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:17.348296 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ac71a-e748-48e5-b4f2-82fb8064edc8 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:17.353708 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09c59a-0213-45eb-a7e8-67fcafabb1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:17.355133 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09c59a-0213-45eb-a7e8-67fcafabb1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:17.355698 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09c59a-0213-45eb-a7e8-67fcafabb1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:17.355965 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09c59a-0213-45eb-a7e8-67fcafabb1fd admin admin] PATH_INFO: `/v3/projects/cf84ad032d1a43ce8429755f0fc34372` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:17.357328 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09c59a-0213-45eb-a7e8-67fcafabb1fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf84ad032d1a43ce8429755f0fc34372)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:17.359132 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09c59a-0213-45eb-a7e8-67fcafabb1fd admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:17.407189 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-5b09c59a-0213-45eb-a7e8-67fcafabb1fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf84ad032d1a43ce8429755f0fc34372', 'request_id': 'req-5b09c59a-0213-45eb-a7e8-67fcafabb1fd'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:17.412418 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-5b09c59a-0213-45eb-a7e8-67fcafabb1fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf84ad032d1a43ce8429755f0fc34372', 'request_id': 'req-5b09c59a-0213-45eb-a7e8-67fcafabb1fd'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:17.420421 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-5b09c59a-0213-45eb-a7e8-67fcafabb1fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf84ad032d1a43ce8429755f0fc34372', 'request_id': 'req-5b09c59a-0213-45eb-a7e8-67fcafabb1fd'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:17.431893 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-5b09c59a-0213-45eb-a7e8-67fcafabb1fd admin admin] The token cache is being invalidate because project cf84ad032d1a43ce8429755f0fc34372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:17.432151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-5b09c59a-0213-45eb-a7e8-67fcafabb1fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:17.432827 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-5b09c59a-0213-45eb-a7e8-67fcafabb1fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:17.434418 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1316/2623] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:17 2022] DELETE /identity/v3/projects/cf84ad032d1a43ce8429755f0fc34372 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:17.438558 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557ce50-515c-479b-9ff4-c57fe9421458 service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:17.448132 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557ce50-515c-479b-9ff4-c57fe9421458 service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:17.510256 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730336f-b1ac-486f-9c0a-f296ec32c290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:17.511148 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730336f-b1ac-486f-9c0a-f296ec32c290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:17.511437 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730336f-b1ac-486f-9c0a-f296ec32c290 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:17.511827 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730336f-b1ac-486f-9c0a-f296ec32c290 admin admin] PATH_INFO: `/v3/users/4f2a1f3c8a4f49e39edb7b3b483c4769` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:17.513080 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730336f-b1ac-486f-9c0a-f296ec32c290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f2a1f3c8a4f49e39edb7b3b483c4769)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:17.515068 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730336f-b1ac-486f-9c0a-f296ec32c290 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:17.565219 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e730336f-b1ac-486f-9c0a-f296ec32c290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f2a1f3c8a4f49e39edb7b3b483c4769'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:17.577566 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e730336f-b1ac-486f-9c0a-f296ec32c290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f2a1f3c8a4f49e39edb7b3b483c4769'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:17.585027 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e730336f-b1ac-486f-9c0a-f296ec32c290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f2a1f3c8a4f49e39edb7b3b483c4769'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:17.596434 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e730336f-b1ac-486f-9c0a-f296ec32c290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f2a1f3c8a4f49e39edb7b3b483c4769'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:17.597262 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e730336f-b1ac-486f-9c0a-f296ec32c290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f2a1f3c8a4f49e39edb7b3b483c4769'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:17.604048 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1308/2624] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:17 2022] DELETE /identity/v3/users/4f2a1f3c8a4f49e39edb7b3b483c4769 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:57:17.893042 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09c59a-0213-45eb-a7e8-67fcafabb1fd admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:17.894664 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-5b09c59a-0213-45eb-a7e8-67fcafabb1fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:17.927365 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09c59a-0213-45eb-a7e8-67fcafabb1fd admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:17.989538 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82c1cb-67f1-44a7-b938-75a985a6a8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:17.990510 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82c1cb-67f1-44a7-b938-75a985a6a8fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:17.990852 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82c1cb-67f1-44a7-b938-75a985a6a8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:17.991186 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82c1cb-67f1-44a7-b938-75a985a6a8fa admin admin] PATH_INFO: `/v3/projects/87da7f5cab3440d48a55fa43e60463d6` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:17.992450 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82c1cb-67f1-44a7-b938-75a985a6a8fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=87da7f5cab3440d48a55fa43e60463d6)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:17.994480 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82c1cb-67f1-44a7-b938-75a985a6a8fa admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:18.050070 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2b82c1cb-67f1-44a7-b938-75a985a6a8fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87da7f5cab3440d48a55fa43e60463d6', 'request_id': 'req-2b82c1cb-67f1-44a7-b938-75a985a6a8fa'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:18.056770 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2b82c1cb-67f1-44a7-b938-75a985a6a8fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87da7f5cab3440d48a55fa43e60463d6', 'request_id': 'req-2b82c1cb-67f1-44a7-b938-75a985a6a8fa'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:18.067502 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2b82c1cb-67f1-44a7-b938-75a985a6a8fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87da7f5cab3440d48a55fa43e60463d6', 'request_id': 'req-2b82c1cb-67f1-44a7-b938-75a985a6a8fa'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:18.082542 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2b82c1cb-67f1-44a7-b938-75a985a6a8fa admin admin] The token cache is being invalidate because project 87da7f5cab3440d48a55fa43e60463d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:18.082835 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2b82c1cb-67f1-44a7-b938-75a985a6a8fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:18.083470 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-2b82c1cb-67f1-44a7-b938-75a985a6a8fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:18.085268 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1317/2625] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:17 2022] DELETE /identity/v3/projects/87da7f5cab3440d48a55fa43e60463d6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:18.090975 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558d17f-c641-49ad-9634-333e7bb8e36e None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:18.091277 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558d17f-c641-49ad-9634-333e7bb8e36e None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:18.091560 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558d17f-c641-49ad-9634-333e7bb8e36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:18.109699 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-4558d17f-c641-49ad-9634-333e7bb8e36e None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:18.110903 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-4558d17f-c641-49ad-9634-333e7bb8e36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:18.169690 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1309/2626] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:18.177602 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaedd98-4ee9-465f-bf4b-c7df35645168 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:18.178066 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaedd98-4ee9-465f-bf4b-c7df35645168 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:18.178403 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaedd98-4ee9-465f-bf4b-c7df35645168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:18.196645 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-bfaedd98-4ee9-465f-bf4b-c7df35645168 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:18.197972 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-bfaedd98-4ee9-465f-bf4b-c7df35645168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:18.205852 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1318/2627] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:18.210080 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558d17f-c641-49ad-9634-333e7bb8e36e None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:18.219773 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558d17f-c641-49ad-9634-333e7bb8e36e None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:18.224620 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522285f-3516-4406-9b39-adb6617e02d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:18.225316 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522285f-3516-4406-9b39-adb6617e02d6 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:18.225595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522285f-3516-4406-9b39-adb6617e02d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:18.225863 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522285f-3516-4406-9b39-adb6617e02d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:18.226585 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522285f-3516-4406-9b39-adb6617e02d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:57:18.226890 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522285f-3516-4406-9b39-adb6617e02d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:18.228490 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522285f-3516-4406-9b39-adb6617e02d6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:18.240000 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1310/2628] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:57:18.244429 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaedd98-4ee9-465f-bf4b-c7df35645168 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:18.254006 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaedd98-4ee9-465f-bf4b-c7df35645168 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:18.260099 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26c764-a583-4bbf-8e84-a49d7e1ea018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:18.260764 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26c764-a583-4bbf-8e84-a49d7e1ea018 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:18.261080 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26c764-a583-4bbf-8e84-a49d7e1ea018 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:18.261354 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26c764-a583-4bbf-8e84-a49d7e1ea018 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:18.262127 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26c764-a583-4bbf-8e84-a49d7e1ea018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:18.264056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26c764-a583-4bbf-8e84-a49d7e1ea018 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:18.292839 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1319/2629] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:57:18 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:57:18.297169 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522285f-3516-4406-9b39-adb6617e02d6 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:18.307146 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522285f-3516-4406-9b39-adb6617e02d6 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:18.365326 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7c0d5-4bf2-4125-a6eb-4f2ad60a2636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:18.366153 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7c0d5-4bf2-4125-a6eb-4f2ad60a2636 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:18.366330 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7c0d5-4bf2-4125-a6eb-4f2ad60a2636 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:18.366599 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7c0d5-4bf2-4125-a6eb-4f2ad60a2636 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:18.367325 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7c0d5-4bf2-4125-a6eb-4f2ad60a2636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:18.370316 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7c0d5-4bf2-4125-a6eb-4f2ad60a2636 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:18.396434 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1311/2630] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:57:18 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:18.402136 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26c764-a583-4bbf-8e84-a49d7e1ea018 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:18.419255 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26c764-a583-4bbf-8e84-a49d7e1ea018 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:18.424215 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cea802-fd39-41c3-ab8e-86e20675e548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:18.425049 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cea802-fd39-41c3-ab8e-86e20675e548 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:18.426230 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cea802-fd39-41c3-ab8e-86e20675e548 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:18.426581 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cea802-fd39-41c3-ab8e-86e20675e548 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:18.427419 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cea802-fd39-41c3-ab8e-86e20675e548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:18.429173 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cea802-fd39-41c3-ab8e-86e20675e548 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:18.441864 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1320/2631] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:57:18.447268 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7c0d5-4bf2-4125-a6eb-4f2ad60a2636 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:18.458954 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7c0d5-4bf2-4125-a6eb-4f2ad60a2636 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:18.464445 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a3a4d-ee2f-455a-8055-b1cfb46bb666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:18.465378 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a3a4d-ee2f-455a-8055-b1cfb46bb666 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:18.465750 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a3a4d-ee2f-455a-8055-b1cfb46bb666 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:18.466127 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a3a4d-ee2f-455a-8055-b1cfb46bb666 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:18.466975 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a3a4d-ee2f-455a-8055-b1cfb46bb666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:18.468983 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a3a4d-ee2f-455a-8055-b1cfb46bb666 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:18.482696 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1312/2632] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:57:18.496894 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cea802-fd39-41c3-ab8e-86e20675e548 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:18.503311 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cea802-fd39-41c3-ab8e-86e20675e548 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:18.508813 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1167ed5-b0a9-4f1f-b579-1f967ea3b1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:18.509782 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1167ed5-b0a9-4f1f-b579-1f967ea3b1ab admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:18.510062 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1167ed5-b0a9-4f1f-b579-1f967ea3b1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:18.510339 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1167ed5-b0a9-4f1f-b579-1f967ea3b1ab admin admin] PATH_INFO: `/v3/projects/9e44a3e4be264526a327db526f7bd0fb/users/362bb78532db4260a6b592c5700aa987/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:18.530151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1167ed5-b0a9-4f1f-b579-1f967ea3b1ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e44a3e4be264526a327db526f7bd0fb, user_id=362bb78532db4260a6b592c5700aa987, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:18.533264 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1167ed5-b0a9-4f1f-b579-1f967ea3b1ab admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:18.551820 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1321/2633] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:18 2022] PUT /identity/v3/projects/9e44a3e4be264526a327db526f7bd0fb/users/362bb78532db4260a6b592c5700aa987/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:57:18.566159 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9b357-8b2d-4373-99c1-361a3d7bec0f None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:18.566456 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9b357-8b2d-4373-99c1-361a3d7bec0f None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:18.566736 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9b357-8b2d-4373-99c1-361a3d7bec0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:18.600052 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-54d9b357-8b2d-4373-99c1-361a3d7bec0f None None] MFA Rules not processed for user `362bb78532db4260a6b592c5700aa987`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:18.601316 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-54d9b357-8b2d-4373-99c1-361a3d7bec0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:18.666746 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1313/2634] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:18.671303 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1167ed5-b0a9-4f1f-b579-1f967ea3b1ab admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:18.733718 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1167ed5-b0a9-4f1f-b579-1f967ea3b1ab admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:18.738846 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1ca54-ba76-47a9-8b58-6e719acbd286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:18.739505 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1ca54-ba76-47a9-8b58-6e719acbd286 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:18.739790 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1ca54-ba76-47a9-8b58-6e719acbd286 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:18.740054 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1ca54-ba76-47a9-8b58-6e719acbd286 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:18.740760 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1ca54-ba76-47a9-8b58-6e719acbd286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:18.742700 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1ca54-ba76-47a9-8b58-6e719acbd286 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:18.769443 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1322/2635] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:57:18 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:57:18.773336 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9b357-8b2d-4373-99c1-361a3d7bec0f None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:18.785304 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9b357-8b2d-4373-99c1-361a3d7bec0f None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:18.839863 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f0159-8b11-43a5-8683-d8a503144eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:18.840455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f0159-8b11-43a5-8683-d8a503144eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:18.840731 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f0159-8b11-43a5-8683-d8a503144eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:18.841035 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f0159-8b11-43a5-8683-d8a503144eb1 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:18.841753 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f0159-8b11-43a5-8683-d8a503144eb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:18.843680 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f0159-8b11-43a5-8683-d8a503144eb1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:18.872646 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1314/2636] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:57:18 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:57:18.876637 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1ca54-ba76-47a9-8b58-6e719acbd286 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:18.887740 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1ca54-ba76-47a9-8b58-6e719acbd286 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:18.896573 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dfaba-4702-412d-8617-416c5d8e7d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:18.896793 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dfaba-4702-412d-8617-416c5d8e7d36 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:18.897173 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dfaba-4702-412d-8617-416c5d8e7d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:18.897440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dfaba-4702-412d-8617-416c5d8e7d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:18.898323 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73dfaba-4702-412d-8617-416c5d8e7d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:18.901906 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73dfaba-4702-412d-8617-416c5d8e7d36 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:18.913904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1323/2637] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:18.917771 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f0159-8b11-43a5-8683-d8a503144eb1 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:18.929570 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f0159-8b11-43a5-8683-d8a503144eb1 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:18.935339 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f0d22-8d06-4649-9c8c-5304ade0d2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:18.935885 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f0d22-8d06-4649-9c8c-5304ade0d2dc admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:18.936227 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f0d22-8d06-4649-9c8c-5304ade0d2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:18.936564 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f0d22-8d06-4649-9c8c-5304ade0d2dc admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:18.937438 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f0d22-8d06-4649-9c8c-5304ade0d2dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:18.939285 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f0d22-8d06-4649-9c8c-5304ade0d2dc admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:18.953639 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1315/2638] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:57:18.955470 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dfaba-4702-412d-8617-416c5d8e7d36 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:18.967063 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dfaba-4702-412d-8617-416c5d8e7d36 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:18.972870 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c000000-ca92-4486-8c84-2aac0a5a3d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:18.974086 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c000000-ca92-4486-8c84-2aac0a5a3d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:18.974488 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c000000-ca92-4486-8c84-2aac0a5a3d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:18.974855 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c000000-ca92-4486-8c84-2aac0a5a3d9b admin admin] PATH_INFO: `/v3/projects/e75965d6a6fd4ac48dc0893cf1e93cd1/users/ee344f2167c34a14ae736402a39ae4d9/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:18.993358 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c000000-ca92-4486-8c84-2aac0a5a3d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e75965d6a6fd4ac48dc0893cf1e93cd1, user_id=ee344f2167c34a14ae736402a39ae4d9, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:18.996325 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c000000-ca92-4486-8c84-2aac0a5a3d9b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:19.021306 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1324/2639] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:18 2022] PUT /identity/v3/projects/e75965d6a6fd4ac48dc0893cf1e93cd1/users/ee344f2167c34a14ae736402a39ae4d9/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:19.031706 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330316cd-5840-4f41-8f2c-1b13df89f730 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:19.032087 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330316cd-5840-4f41-8f2c-1b13df89f730 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:19.032455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330316cd-5840-4f41-8f2c-1b13df89f730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:19.066413 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-330316cd-5840-4f41-8f2c-1b13df89f730 None None] MFA Rules not processed for user `ee344f2167c34a14ae736402a39ae4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:19.067735 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-330316cd-5840-4f41-8f2c-1b13df89f730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:19.140082 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1316/2640] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:19.144286 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c000000-ca92-4486-8c84-2aac0a5a3d9b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:19.231944 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c000000-ca92-4486-8c84-2aac0a5a3d9b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:19.241735 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f88d7-5aa9-4638-8101-7423663020ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:19.242872 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f88d7-5aa9-4638-8101-7423663020ce admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:19.243400 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f88d7-5aa9-4638-8101-7423663020ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:19.243797 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f88d7-5aa9-4638-8101-7423663020ce admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:19.244675 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f88d7-5aa9-4638-8101-7423663020ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:19.246979 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f88d7-5aa9-4638-8101-7423663020ce admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:19.286015 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1325/2641] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:57:19 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:19.289709 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330316cd-5840-4f41-8f2c-1b13df89f730 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:19.301495 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330316cd-5840-4f41-8f2c-1b13df89f730 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:19.358344 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9652f0-53b6-4cb7-b92d-b1dc74e91308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:19.359121 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9652f0-53b6-4cb7-b92d-b1dc74e91308 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:19.359461 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9652f0-53b6-4cb7-b92d-b1dc74e91308 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:19.359827 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9652f0-53b6-4cb7-b92d-b1dc74e91308 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:19.360615 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9652f0-53b6-4cb7-b92d-b1dc74e91308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:19.362986 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9652f0-53b6-4cb7-b92d-b1dc74e91308 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:19.389459 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1317/2642] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:57:19 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:19.398343 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f88d7-5aa9-4638-8101-7423663020ce admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:19.409242 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f88d7-5aa9-4638-8101-7423663020ce admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:19.414137 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b9f57-0b71-40b7-8067-1859a07ae670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:19.414804 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b9f57-0b71-40b7-8067-1859a07ae670 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:19.415087 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b9f57-0b71-40b7-8067-1859a07ae670 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:19.415352 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b9f57-0b71-40b7-8067-1859a07ae670 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:19.416126 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b9f57-0b71-40b7-8067-1859a07ae670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:19.417867 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b9f57-0b71-40b7-8067-1859a07ae670 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:19.429074 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1326/2643] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:19.433348 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9652f0-53b6-4cb7-b92d-b1dc74e91308 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:19.443133 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9652f0-53b6-4cb7-b92d-b1dc74e91308 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:19.447974 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7175ba6-4cc9-424f-b668-b09a1ad6c25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:19.449113 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7175ba6-4cc9-424f-b668-b09a1ad6c25f admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:19.449617 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7175ba6-4cc9-424f-b668-b09a1ad6c25f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:19.450113 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7175ba6-4cc9-424f-b668-b09a1ad6c25f admin admin] PATH_INFO: `/v3/projects/c0065bf6f3fc4ccc97b3284237d5c3a2/users/09936ddceaca4c7bb6427271640a66a2/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:19.465319 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7175ba6-4cc9-424f-b668-b09a1ad6c25f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0065bf6f3fc4ccc97b3284237d5c3a2, user_id=09936ddceaca4c7bb6427271640a66a2, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:19.468077 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7175ba6-4cc9-424f-b668-b09a1ad6c25f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:19.487231 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1318/2644] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:19 2022] PUT /identity/v3/projects/c0065bf6f3fc4ccc97b3284237d5c3a2/users/09936ddceaca4c7bb6427271640a66a2/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:19.488561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b9f57-0b71-40b7-8067-1859a07ae670 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:19.493397 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7175ba6-4cc9-424f-b668-b09a1ad6c25f admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:19.498196 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b7175ba6-4cc9-424f-b668-b09a1ad6c25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:19.499609 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b9f57-0b71-40b7-8067-1859a07ae670 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:19.561148 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fe9e2-44ec-43b0-bb77-0c424d58f6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:19.561733 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fe9e2-44ec-43b0-bb77-0c424d58f6de admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:19.562052 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fe9e2-44ec-43b0-bb77-0c424d58f6de admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:19.562322 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fe9e2-44ec-43b0-bb77-0c424d58f6de admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:19.563063 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fe9e2-44ec-43b0-bb77-0c424d58f6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:19.564677 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fe9e2-44ec-43b0-bb77-0c424d58f6de admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:19.564837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7175ba6-4cc9-424f-b668-b09a1ad6c25f admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:19.569534 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d1524-6d16-4303-b819-d729020354f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:19.570414 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d1524-6d16-4303-b819-d729020354f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:19.570693 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d1524-6d16-4303-b819-d729020354f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:19.571025 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d1524-6d16-4303-b819-d729020354f6 admin admin] PATH_INFO: `/v3/users/947bc36861e64e31811cb898f46a72e1` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:19.572175 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d1524-6d16-4303-b819-d729020354f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=947bc36861e64e31811cb898f46a72e1)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:19.574202 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d1524-6d16-4303-b819-d729020354f6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:19.579752 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1327/2645] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:19.580754 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fe9e2-44ec-43b0-bb77-0c424d58f6de admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:19.590526 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fe9e2-44ec-43b0-bb77-0c424d58f6de admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:19.595277 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78be5a-44ba-4a91-b8c8-45a4d4dfdd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:19.596142 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78be5a-44ba-4a91-b8c8-45a4d4dfdd3b admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:19.596423 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78be5a-44ba-4a91-b8c8-45a4d4dfdd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:19.596735 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78be5a-44ba-4a91-b8c8-45a4d4dfdd3b admin admin] PATH_INFO: `/v3/projects/c0065bf6f3fc4ccc97b3284237d5c3a2/users/09936ddceaca4c7bb6427271640a66a2/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:19.598866 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78be5a-44ba-4a91-b8c8-45a4d4dfdd3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0065bf6f3fc4ccc97b3284237d5c3a2, user_id=09936ddceaca4c7bb6427271640a66a2, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:19.601591 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78be5a-44ba-4a91-b8c8-45a4d4dfdd3b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:19.612093 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1328/2646] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:19 2022] PUT /identity/v3/projects/c0065bf6f3fc4ccc97b3284237d5c3a2/users/09936ddceaca4c7bb6427271640a66a2/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:57:19.622956 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2411fe-c257-4c90-a3e7-2f75d48b59c7 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:19.623241 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2411fe-c257-4c90-a3e7-2f75d48b59c7 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:19.623351 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-b55d1524-6d16-4303-b819-d729020354f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '947bc36861e64e31811cb898f46a72e1'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:19.623519 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2411fe-c257-4c90-a3e7-2f75d48b59c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:19.634762 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-b55d1524-6d16-4303-b819-d729020354f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '947bc36861e64e31811cb898f46a72e1'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:19.641642 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-b55d1524-6d16-4303-b819-d729020354f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '947bc36861e64e31811cb898f46a72e1'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:19.650063 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-b55d1524-6d16-4303-b819-d729020354f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '947bc36861e64e31811cb898f46a72e1'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:19.651002 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-b55d1524-6d16-4303-b819-d729020354f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '947bc36861e64e31811cb898f46a72e1'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:19.651811 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-3d2411fe-c257-4c90-a3e7-2f75d48b59c7 None None] MFA Rules not processed for user `09936ddceaca4c7bb6427271640a66a2`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:19.653055 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-3d2411fe-c257-4c90-a3e7-2f75d48b59c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:19.657501 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1319/2647] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:19 2022] DELETE /identity/v3/users/947bc36861e64e31811cb898f46a72e1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:19.719662 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1329/2648] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:57:19.730667 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d1524-6d16-4303-b819-d729020354f6 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:19.732193 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b55d1524-6d16-4303-b819-d729020354f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:19.790952 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d1524-6d16-4303-b819-d729020354f6 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:19.794832 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418845e2-9527-4823-be75-8cde4424dbe0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:19.795477 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418845e2-9527-4823-be75-8cde4424dbe0 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:19.795892 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418845e2-9527-4823-be75-8cde4424dbe0 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:19.796010 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418845e2-9527-4823-be75-8cde4424dbe0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:19.828230 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2411fe-c257-4c90-a3e7-2f75d48b59c7 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:19.829815 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-3d2411fe-c257-4c90-a3e7-2f75d48b59c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:19.863196 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418845e2-9527-4823-be75-8cde4424dbe0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:19.864984 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418845e2-9527-4823-be75-8cde4424dbe0 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:19.875321 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1320/2649] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:19.899412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2411fe-c257-4c90-a3e7-2f75d48b59c7 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:19.917861 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418845e2-9527-4823-be75-8cde4424dbe0 service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:19.919697 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-418845e2-9527-4823-be75-8cde4424dbe0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:19.930746 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418845e2-9527-4823-be75-8cde4424dbe0 service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:19.934753 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcbbf7-d970-428b-835e-fe2111b75155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:19.935492 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcbbf7-d970-428b-835e-fe2111b75155 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:19.935830 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcbbf7-d970-428b-835e-fe2111b75155 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:19.936163 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcbbf7-d970-428b-835e-fe2111b75155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:19.938023 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-67fcbbf7-d970-428b-835e-fe2111b75155 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:19.954286 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735985f-2c64-46b0-918e-681512d9c537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:19.955154 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735985f-2c64-46b0-918e-681512d9c537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:19.955430 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735985f-2c64-46b0-918e-681512d9c537 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:19.955707 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735985f-2c64-46b0-918e-681512d9c537 admin admin] PATH_INFO: `/v3/projects/08d4842074994421989ef7568b65aea9` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:19.957038 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735985f-2c64-46b0-918e-681512d9c537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08d4842074994421989ef7568b65aea9)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:19.959010 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735985f-2c64-46b0-918e-681512d9c537 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:19.994827 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fcbbf7-d970-428b-835e-fe2111b75155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:19.996393 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fcbbf7-d970-428b-835e-fe2111b75155 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:20.006152 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1321/2650] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:57:20.007629 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6735985f-2c64-46b0-918e-681512d9c537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08d4842074994421989ef7568b65aea9', 'request_id': 'req-6735985f-2c64-46b0-918e-681512d9c537'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:20.012895 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6735985f-2c64-46b0-918e-681512d9c537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08d4842074994421989ef7568b65aea9', 'request_id': 'req-6735985f-2c64-46b0-918e-681512d9c537'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:20.023011 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6735985f-2c64-46b0-918e-681512d9c537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08d4842074994421989ef7568b65aea9', 'request_id': 'req-6735985f-2c64-46b0-918e-681512d9c537'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:20.034654 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6735985f-2c64-46b0-918e-681512d9c537 admin admin] The token cache is being invalidate because project 08d4842074994421989ef7568b65aea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:20.034933 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6735985f-2c64-46b0-918e-681512d9c537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:20.035610 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6735985f-2c64-46b0-918e-681512d9c537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:20.037425 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1330/2651] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:19 2022] DELETE /identity/v3/projects/08d4842074994421989ef7568b65aea9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:57:20.043751 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22f2cb-f962-44ba-bf34-95ca56694ead None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:20.044037 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22f2cb-f962-44ba-bf34-95ca56694ead None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:20.044359 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22f2cb-f962-44ba-bf34-95ca56694ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:20.064250 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-db22f2cb-f962-44ba-bf34-95ca56694ead None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:20.065508 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-db22f2cb-f962-44ba-bf34-95ca56694ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:20.125717 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1322/2652] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:20.133610 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da520b-fcd8-4971-9b00-f94e68d3e4c8 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:20.133894 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da520b-fcd8-4971-9b00-f94e68d3e4c8 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:20.134166 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da520b-fcd8-4971-9b00-f94e68d3e4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:20.154713 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-83da520b-fcd8-4971-9b00-f94e68d3e4c8 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:20.155948 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-83da520b-fcd8-4971-9b00-f94e68d3e4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:20.164147 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1331/2653] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:20.168728 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22f2cb-f962-44ba-bf34-95ca56694ead None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:20.178847 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22f2cb-f962-44ba-bf34-95ca56694ead None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:20.184298 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2be92-fc75-4506-b329-6215b1ec9673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:20.184987 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2be92-fc75-4506-b329-6215b1ec9673 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:20.185306 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2be92-fc75-4506-b329-6215b1ec9673 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:20.185584 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2be92-fc75-4506-b329-6215b1ec9673 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:20.186335 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2be92-fc75-4506-b329-6215b1ec9673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:57:20.186663 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2be92-fc75-4506-b329-6215b1ec9673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:20.188277 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2be92-fc75-4506-b329-6215b1ec9673 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:20.200389 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1323/2654] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:57:20.205399 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da520b-fcd8-4971-9b00-f94e68d3e4c8 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:20.215122 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da520b-fcd8-4971-9b00-f94e68d3e4c8 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:20.219874 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b49e1b-99c1-4e9b-a0ed-378718fb2b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:20.220525 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b49e1b-99c1-4e9b-a0ed-378718fb2b2d admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:20.220801 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b49e1b-99c1-4e9b-a0ed-378718fb2b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:20.221100 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b49e1b-99c1-4e9b-a0ed-378718fb2b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:20.221807 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b49e1b-99c1-4e9b-a0ed-378718fb2b2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:20.223705 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b49e1b-99c1-4e9b-a0ed-378718fb2b2d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:20.249577 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1332/2655] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:57:20 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:20.253750 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2be92-fc75-4506-b329-6215b1ec9673 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:20.264551 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2be92-fc75-4506-b329-6215b1ec9673 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:20.324483 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333d11b-155a-4c79-b07c-af5926f00d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:20.325168 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333d11b-155a-4c79-b07c-af5926f00d20 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:20.325449 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333d11b-155a-4c79-b07c-af5926f00d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:20.325723 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333d11b-155a-4c79-b07c-af5926f00d20 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:20.326575 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333d11b-155a-4c79-b07c-af5926f00d20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:20.328531 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333d11b-155a-4c79-b07c-af5926f00d20 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:20.354379 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1324/2656] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:57:20 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:20.358568 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b49e1b-99c1-4e9b-a0ed-378718fb2b2d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:20.369550 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b49e1b-99c1-4e9b-a0ed-378718fb2b2d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:20.375294 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62653e24-4a6f-45c1-ba68-eca56d5170e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:20.375990 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62653e24-4a6f-45c1-ba68-eca56d5170e1 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:20.376266 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62653e24-4a6f-45c1-ba68-eca56d5170e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:20.376538 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62653e24-4a6f-45c1-ba68-eca56d5170e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:20.377317 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62653e24-4a6f-45c1-ba68-eca56d5170e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:20.378908 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62653e24-4a6f-45c1-ba68-eca56d5170e1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:20.389981 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1333/2657] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:20.394529 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333d11b-155a-4c79-b07c-af5926f00d20 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:20.405527 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333d11b-155a-4c79-b07c-af5926f00d20 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:20.410085 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6619ed5-d9f8-4bd2-8162-dbc10a5e4f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:20.410759 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6619ed5-d9f8-4bd2-8162-dbc10a5e4f3a admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:20.411040 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6619ed5-d9f8-4bd2-8162-dbc10a5e4f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:20.411312 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6619ed5-d9f8-4bd2-8162-dbc10a5e4f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:20.412065 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6619ed5-d9f8-4bd2-8162-dbc10a5e4f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:20.413733 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6619ed5-d9f8-4bd2-8162-dbc10a5e4f3a admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:20.425203 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1325/2658] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:20.430166 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62653e24-4a6f-45c1-ba68-eca56d5170e1 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:20.441261 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62653e24-4a6f-45c1-ba68-eca56d5170e1 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:20.445886 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8601ced-1465-4d95-ba84-8396746459e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:20.446770 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8601ced-1465-4d95-ba84-8396746459e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:20.447045 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8601ced-1465-4d95-ba84-8396746459e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:20.447315 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8601ced-1465-4d95-ba84-8396746459e0 admin admin] PATH_INFO: `/v3/projects/bb223118baab411d8b61f60782ecdc56/users/ed2b09eddefd449db5a67aee88cba121/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:20.462545 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8601ced-1465-4d95-ba84-8396746459e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb223118baab411d8b61f60782ecdc56, user_id=ed2b09eddefd449db5a67aee88cba121, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:20.465306 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8601ced-1465-4d95-ba84-8396746459e0 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:20.479129 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1334/2659] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:20 2022] PUT /identity/v3/projects/bb223118baab411d8b61f60782ecdc56/users/ed2b09eddefd449db5a67aee88cba121/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:20.490333 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956e12c-6983-42cc-89d7-8e9e046dd2f5 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:20.490818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956e12c-6983-42cc-89d7-8e9e046dd2f5 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:20.490936 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956e12c-6983-42cc-89d7-8e9e046dd2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:20.518085 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-4956e12c-6983-42cc-89d7-8e9e046dd2f5 None None] MFA Rules not processed for user `ed2b09eddefd449db5a67aee88cba121`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:20.519288 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-4956e12c-6983-42cc-89d7-8e9e046dd2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:20.588241 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1326/2660] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:20.599490 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8601ced-1465-4d95-ba84-8396746459e0 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:20.601270 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-e8601ced-1465-4d95-ba84-8396746459e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:20.682166 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8601ced-1465-4d95-ba84-8396746459e0 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:20.688768 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6eeb5-a6f9-4ea3-a5b1-6d44c338054f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:20.689434 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6eeb5-a6f9-4ea3-a5b1-6d44c338054f service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:20.689716 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6eeb5-a6f9-4ea3-a5b1-6d44c338054f service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:20.689989 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6eeb5-a6f9-4ea3-a5b1-6d44c338054f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:20.698063 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6eeb5-a6f9-4ea3-a5b1-6d44c338054f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:20.699699 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6eeb5-a6f9-4ea3-a5b1-6d44c338054f service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:20.708466 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1335/2661] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:22.904720 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956e12c-6983-42cc-89d7-8e9e046dd2f5 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:22.906278 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-4956e12c-6983-42cc-89d7-8e9e046dd2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:22.974316 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956e12c-6983-42cc-89d7-8e9e046dd2f5 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:22.982256 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3997a3f-888c-41ef-8ae1-a821c53fe737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:22.983135 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3997a3f-888c-41ef-8ae1-a821c53fe737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:22.983414 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3997a3f-888c-41ef-8ae1-a821c53fe737 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:22.983739 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3997a3f-888c-41ef-8ae1-a821c53fe737 admin admin] PATH_INFO: `/v3/users/362bb78532db4260a6b592c5700aa987` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:22.985104 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3997a3f-888c-41ef-8ae1-a821c53fe737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=362bb78532db4260a6b592c5700aa987)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:22.987078 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3997a3f-888c-41ef-8ae1-a821c53fe737 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:23.039762 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e3997a3f-888c-41ef-8ae1-a821c53fe737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '362bb78532db4260a6b592c5700aa987'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:23.053274 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e3997a3f-888c-41ef-8ae1-a821c53fe737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '362bb78532db4260a6b592c5700aa987'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:23.061157 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e3997a3f-888c-41ef-8ae1-a821c53fe737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '362bb78532db4260a6b592c5700aa987'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:23.070728 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e3997a3f-888c-41ef-8ae1-a821c53fe737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '362bb78532db4260a6b592c5700aa987'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:23.071237 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e3997a3f-888c-41ef-8ae1-a821c53fe737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '362bb78532db4260a6b592c5700aa987'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:23.077574 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1327/2662] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:22 2022] DELETE /identity/v3/users/362bb78532db4260a6b592c5700aa987 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:23.082194 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccc4b6-cf64-4c63-b44d-28d9800fe7bc None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:23.082725 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccc4b6-cf64-4c63-b44d-28d9800fe7bc None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:23.082725 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccc4b6-cf64-4c63-b44d-28d9800fe7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:23.100257 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-0cccc4b6-cf64-4c63-b44d-28d9800fe7bc None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:23.101597 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-0cccc4b6-cf64-4c63-b44d-28d9800fe7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:23.163655 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1336/2663] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:57:23.173837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3997a3f-888c-41ef-8ae1-a821c53fe737 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:23.175522 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-e3997a3f-888c-41ef-8ae1-a821c53fe737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:23.238513 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3997a3f-888c-41ef-8ae1-a821c53fe737 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:23.243029 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3585cae-799e-46c8-9069-6386e537830a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:23.243685 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3585cae-799e-46c8-9069-6386e537830a service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:23.243973 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3585cae-799e-46c8-9069-6386e537830a service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:23.244259 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3585cae-799e-46c8-9069-6386e537830a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:23.253704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3585cae-799e-46c8-9069-6386e537830a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:23.255152 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3585cae-799e-46c8-9069-6386e537830a service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:23.265318 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1328/2664] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:23.375001 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccc4b6-cf64-4c63-b44d-28d9800fe7bc None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:23.376688 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-0cccc4b6-cf64-4c63-b44d-28d9800fe7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:23.407720 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccc4b6-cf64-4c63-b44d-28d9800fe7bc None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:23.413585 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf82d8d-4bf7-484c-bba1-1b6dbdb97b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:23.414659 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf82d8d-4bf7-484c-bba1-1b6dbdb97b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:23.414997 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf82d8d-4bf7-484c-bba1-1b6dbdb97b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:23.415478 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf82d8d-4bf7-484c-bba1-1b6dbdb97b3d admin admin] PATH_INFO: `/v3/users/ed2b09eddefd449db5a67aee88cba121` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:23.416976 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf82d8d-4bf7-484c-bba1-1b6dbdb97b3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed2b09eddefd449db5a67aee88cba121)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:23.419947 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf82d8d-4bf7-484c-bba1-1b6dbdb97b3d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:23.470983 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-fbf82d8d-4bf7-484c-bba1-1b6dbdb97b3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed2b09eddefd449db5a67aee88cba121'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:23.471626 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-fbf82d8d-4bf7-484c-bba1-1b6dbdb97b3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed2b09eddefd449db5a67aee88cba121'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:23.472214 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-fbf82d8d-4bf7-484c-bba1-1b6dbdb97b3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed2b09eddefd449db5a67aee88cba121'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:23.485162 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-fbf82d8d-4bf7-484c-bba1-1b6dbdb97b3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed2b09eddefd449db5a67aee88cba121'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:23.491998 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-fbf82d8d-4bf7-484c-bba1-1b6dbdb97b3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed2b09eddefd449db5a67aee88cba121'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:23.506004 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1337/2665] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:23 2022] DELETE /identity/v3/users/ed2b09eddefd449db5a67aee88cba121 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:23.510722 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed31bb3-b670-4450-875c-42d60efc24ca None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:23.511207 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed31bb3-b670-4450-875c-42d60efc24ca None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:23.511669 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed31bb3-b670-4450-875c-42d60efc24ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:23.529726 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-6ed31bb3-b670-4450-875c-42d60efc24ca None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:23.530913 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-6ed31bb3-b670-4450-875c-42d60efc24ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:23.539551 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf82d8d-4bf7-484c-bba1-1b6dbdb97b3d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:23.540989 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-fbf82d8d-4bf7-484c-bba1-1b6dbdb97b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:23.592567 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1329/2666] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:57:23.602212 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed31bb3-b670-4450-875c-42d60efc24ca None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:23.603625 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-6ed31bb3-b670-4450-875c-42d60efc24ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:23.623063 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf82d8d-4bf7-484c-bba1-1b6dbdb97b3d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:23.627710 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a645c-7b7c-4b81-be24-66b85f7c92c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:23.628569 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a645c-7b7c-4b81-be24-66b85f7c92c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:23.628838 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a645c-7b7c-4b81-be24-66b85f7c92c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:23.629230 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a645c-7b7c-4b81-be24-66b85f7c92c5 admin admin] PATH_INFO: `/v3/projects/9e44a3e4be264526a327db526f7bd0fb` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:23.630456 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a645c-7b7c-4b81-be24-66b85f7c92c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e44a3e4be264526a327db526f7bd0fb)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:23.632376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a645c-7b7c-4b81-be24-66b85f7c92c5 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:23.660567 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed31bb3-b670-4450-875c-42d60efc24ca None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:23.664636 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca584f-a305-461c-bc4d-e762f0231af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:23.665392 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca584f-a305-461c-bc4d-e762f0231af3 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:23.665674 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca584f-a305-461c-bc4d-e762f0231af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:23.665950 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca584f-a305-461c-bc4d-e762f0231af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:23.674859 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca584f-a305-461c-bc4d-e762f0231af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:23.676332 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca584f-a305-461c-bc4d-e762f0231af3 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:23.679689 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-506a645c-7b7c-4b81-be24-66b85f7c92c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e44a3e4be264526a327db526f7bd0fb', 'request_id': 'req-506a645c-7b7c-4b81-be24-66b85f7c92c5'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:23.685187 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-506a645c-7b7c-4b81-be24-66b85f7c92c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e44a3e4be264526a327db526f7bd0fb', 'request_id': 'req-506a645c-7b7c-4b81-be24-66b85f7c92c5'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:23.685808 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1330/2667] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:57:23.693758 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-506a645c-7b7c-4b81-be24-66b85f7c92c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e44a3e4be264526a327db526f7bd0fb', 'request_id': 'req-506a645c-7b7c-4b81-be24-66b85f7c92c5'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:23.705249 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-506a645c-7b7c-4b81-be24-66b85f7c92c5 admin admin] The token cache is being invalidate because project 9e44a3e4be264526a327db526f7bd0fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:23.705539 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-506a645c-7b7c-4b81-be24-66b85f7c92c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:23.706251 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-506a645c-7b7c-4b81-be24-66b85f7c92c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:23.707933 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1338/2668] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:23 2022] DELETE /identity/v3/projects/9e44a3e4be264526a327db526f7bd0fb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:23.712184 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca584f-a305-461c-bc4d-e762f0231af3 service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:23.722738 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca584f-a305-461c-bc4d-e762f0231af3 service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:23.783614 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca58401-af9b-4f9d-b349-841657a6c0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:23.784503 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca58401-af9b-4f9d-b349-841657a6c0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:23.784790 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca58401-af9b-4f9d-b349-841657a6c0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:23.785106 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca58401-af9b-4f9d-b349-841657a6c0cd admin admin] PATH_INFO: `/v3/users/ee344f2167c34a14ae736402a39ae4d9` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:23.786327 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca58401-af9b-4f9d-b349-841657a6c0cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee344f2167c34a14ae736402a39ae4d9)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:23.788297 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca58401-af9b-4f9d-b349-841657a6c0cd admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:23.838720 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-bca58401-af9b-4f9d-b349-841657a6c0cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee344f2167c34a14ae736402a39ae4d9'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:23.850178 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-bca58401-af9b-4f9d-b349-841657a6c0cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee344f2167c34a14ae736402a39ae4d9'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:23.856908 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-bca58401-af9b-4f9d-b349-841657a6c0cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee344f2167c34a14ae736402a39ae4d9'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:23.866938 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-bca58401-af9b-4f9d-b349-841657a6c0cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee344f2167c34a14ae736402a39ae4d9'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:23.867624 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-bca58401-af9b-4f9d-b349-841657a6c0cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee344f2167c34a14ae736402a39ae4d9'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:23.873650 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1331/2669] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:23 2022] DELETE /identity/v3/users/ee344f2167c34a14ae736402a39ae4d9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:23.943717 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a645c-7b7c-4b81-be24-66b85f7c92c5 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:23.945499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-506a645c-7b7c-4b81-be24-66b85f7c92c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:23.960314 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a645c-7b7c-4b81-be24-66b85f7c92c5 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:24.019694 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d0f1d-a5ba-4c57-9b11-b3e52f26ce98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:24.020658 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d0f1d-a5ba-4c57-9b11-b3e52f26ce98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:24.020965 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d0f1d-a5ba-4c57-9b11-b3e52f26ce98 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:24.021238 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d0f1d-a5ba-4c57-9b11-b3e52f26ce98 admin admin] PATH_INFO: `/v3/projects/bb223118baab411d8b61f60782ecdc56` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:24.022445 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d0f1d-a5ba-4c57-9b11-b3e52f26ce98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb223118baab411d8b61f60782ecdc56)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:24.024700 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d0f1d-a5ba-4c57-9b11-b3e52f26ce98 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:24.072490 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4c1d0f1d-a5ba-4c57-9b11-b3e52f26ce98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb223118baab411d8b61f60782ecdc56', 'request_id': 'req-4c1d0f1d-a5ba-4c57-9b11-b3e52f26ce98'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:24.077958 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4c1d0f1d-a5ba-4c57-9b11-b3e52f26ce98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb223118baab411d8b61f60782ecdc56', 'request_id': 'req-4c1d0f1d-a5ba-4c57-9b11-b3e52f26ce98'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:24.087369 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4c1d0f1d-a5ba-4c57-9b11-b3e52f26ce98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb223118baab411d8b61f60782ecdc56', 'request_id': 'req-4c1d0f1d-a5ba-4c57-9b11-b3e52f26ce98'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:24.098863 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4c1d0f1d-a5ba-4c57-9b11-b3e52f26ce98 admin admin] The token cache is being invalidate because project bb223118baab411d8b61f60782ecdc56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:24.099320 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4c1d0f1d-a5ba-4c57-9b11-b3e52f26ce98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:24.099977 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4c1d0f1d-a5ba-4c57-9b11-b3e52f26ce98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:24.101675 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1339/2670] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:23 2022] DELETE /identity/v3/projects/bb223118baab411d8b61f60782ecdc56 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:24.107375 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb813bd-fbee-4fab-b712-8a6ba1437114 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:24.107890 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb813bd-fbee-4fab-b712-8a6ba1437114 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:24.108004 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb813bd-fbee-4fab-b712-8a6ba1437114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:24.127011 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-dcb813bd-fbee-4fab-b712-8a6ba1437114 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:24.128260 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-dcb813bd-fbee-4fab-b712-8a6ba1437114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:24.140010 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d0f1d-a5ba-4c57-9b11-b3e52f26ce98 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:24.141577 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-4c1d0f1d-a5ba-4c57-9b11-b3e52f26ce98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:24.194407 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1332/2671] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:24.203614 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7987686-1293-4b5f-8dc6-d800be382fad None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:24.203990 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7987686-1293-4b5f-8dc6-d800be382fad None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:24.204327 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7987686-1293-4b5f-8dc6-d800be382fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:24.206747 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d0f1d-a5ba-4c57-9b11-b3e52f26ce98 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:24.211345 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a138257-b85b-4e9a-b578-f355d59ec437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:24.212193 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a138257-b85b-4e9a-b578-f355d59ec437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:24.212473 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a138257-b85b-4e9a-b578-f355d59ec437 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:24.212748 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a138257-b85b-4e9a-b578-f355d59ec437 admin admin] PATH_INFO: `/v3/projects/e75965d6a6fd4ac48dc0893cf1e93cd1` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:24.213978 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a138257-b85b-4e9a-b578-f355d59ec437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e75965d6a6fd4ac48dc0893cf1e93cd1)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:24.215969 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a138257-b85b-4e9a-b578-f355d59ec437 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:24.223280 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-a7987686-1293-4b5f-8dc6-d800be382fad None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:24.224473 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-a7987686-1293-4b5f-8dc6-d800be382fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:24.232202 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1333/2672] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:24.236431 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7987686-1293-4b5f-8dc6-d800be382fad None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:24.245489 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7987686-1293-4b5f-8dc6-d800be382fad None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:24.250680 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5449cc-d6f2-4e9c-b8d3-c591aa7e2f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:24.251339 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5449cc-d6f2-4e9c-b8d3-c591aa7e2f09 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:24.251620 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5449cc-d6f2-4e9c-b8d3-c591aa7e2f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:24.251893 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5449cc-d6f2-4e9c-b8d3-c591aa7e2f09 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:24.252638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5449cc-d6f2-4e9c-b8d3-c591aa7e2f09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:57:24.252975 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5449cc-d6f2-4e9c-b8d3-c591aa7e2f09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:24.254587 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5449cc-d6f2-4e9c-b8d3-c591aa7e2f09 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:24.262149 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4a138257-b85b-4e9a-b578-f355d59ec437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e75965d6a6fd4ac48dc0893cf1e93cd1', 'request_id': 'req-4a138257-b85b-4e9a-b578-f355d59ec437'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:24.267740 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1334/2673] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:57:24.268183 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4a138257-b85b-4e9a-b578-f355d59ec437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e75965d6a6fd4ac48dc0893cf1e93cd1', 'request_id': 'req-4a138257-b85b-4e9a-b578-f355d59ec437'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:24.272244 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5449cc-d6f2-4e9c-b8d3-c591aa7e2f09 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:24.277198 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4a138257-b85b-4e9a-b578-f355d59ec437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e75965d6a6fd4ac48dc0893cf1e93cd1', 'request_id': 'req-4a138257-b85b-4e9a-b578-f355d59ec437'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:24.282786 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5449cc-d6f2-4e9c-b8d3-c591aa7e2f09 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:24.288518 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4a138257-b85b-4e9a-b578-f355d59ec437 admin admin] The token cache is being invalidate because project e75965d6a6fd4ac48dc0893cf1e93cd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:24.288798 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4a138257-b85b-4e9a-b578-f355d59ec437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:24.290166 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4a138257-b85b-4e9a-b578-f355d59ec437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:24.291772 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1340/2674] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:24 2022] DELETE /identity/v3/projects/e75965d6a6fd4ac48dc0893cf1e93cd1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:57:24.295699 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a138257-b85b-4e9a-b578-f355d59ec437 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:24.297267 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-4a138257-b85b-4e9a-b578-f355d59ec437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:24.336606 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d880e42-8c1d-4951-b0fc-0411b57479b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:24.337415 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d880e42-8c1d-4951-b0fc-0411b57479b3 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:24.337702 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d880e42-8c1d-4951-b0fc-0411b57479b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:24.337978 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d880e42-8c1d-4951-b0fc-0411b57479b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:24.338693 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d880e42-8c1d-4951-b0fc-0411b57479b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:24.340657 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d880e42-8c1d-4951-b0fc-0411b57479b3 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:24.360929 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a138257-b85b-4e9a-b578-f355d59ec437 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:24.365952 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c438cb-5493-44ef-addf-072dfd3ba291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:24.366826 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c438cb-5493-44ef-addf-072dfd3ba291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:24.367111 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c438cb-5493-44ef-addf-072dfd3ba291 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:24.367383 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c438cb-5493-44ef-addf-072dfd3ba291 admin admin] PATH_INFO: `/v3/users/09936ddceaca4c7bb6427271640a66a2` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:24.367613 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1335/2675] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:57:24 2022] POST /identity/v3/projects => generated 407 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:24.369942 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c438cb-5493-44ef-addf-072dfd3ba291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09936ddceaca4c7bb6427271640a66a2)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:24.371975 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d880e42-8c1d-4951-b0fc-0411b57479b3 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:24.372305 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c438cb-5493-44ef-addf-072dfd3ba291 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:24.373753 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-2d880e42-8c1d-4951-b0fc-0411b57479b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:24.420152 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-51c438cb-5493-44ef-addf-072dfd3ba291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09936ddceaca4c7bb6427271640a66a2'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:24.420865 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-51c438cb-5493-44ef-addf-072dfd3ba291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09936ddceaca4c7bb6427271640a66a2'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:24.421572 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-51c438cb-5493-44ef-addf-072dfd3ba291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09936ddceaca4c7bb6427271640a66a2'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:24.433227 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-51c438cb-5493-44ef-addf-072dfd3ba291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09936ddceaca4c7bb6427271640a66a2'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:24.436210 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d880e42-8c1d-4951-b0fc-0411b57479b3 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:24.440355 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-51c438cb-5493-44ef-addf-072dfd3ba291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09936ddceaca4c7bb6427271640a66a2'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:24.441341 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866702b-24e5-4d65-a61c-870f9f07f82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:24.442008 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866702b-24e5-4d65-a61c-870f9f07f82d admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:24.442251 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866702b-24e5-4d65-a61c-870f9f07f82d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:24.442539 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866702b-24e5-4d65-a61c-870f9f07f82d admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:24.443265 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866702b-24e5-4d65-a61c-870f9f07f82d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:24.445358 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866702b-24e5-4d65-a61c-870f9f07f82d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:24.454941 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1341/2676] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:24 2022] DELETE /identity/v3/users/09936ddceaca4c7bb6427271640a66a2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:24.466551 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1336/2677] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:57:24 2022] POST /identity/v3/users => generated 304 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:57:24.470723 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c438cb-5493-44ef-addf-072dfd3ba291 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:24.472348 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-51c438cb-5493-44ef-addf-072dfd3ba291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:24.538872 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c438cb-5493-44ef-addf-072dfd3ba291 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:24.544489 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3f27d-af99-427b-91f6-6dd9eb3d0179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:24.545208 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3f27d-af99-427b-91f6-6dd9eb3d0179 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:24.545475 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3f27d-af99-427b-91f6-6dd9eb3d0179 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:24.545779 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3f27d-af99-427b-91f6-6dd9eb3d0179 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:24.546521 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3f27d-af99-427b-91f6-6dd9eb3d0179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:24.548132 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3f27d-af99-427b-91f6-6dd9eb3d0179 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:24.558640 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1342/2678] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:24.562773 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866702b-24e5-4d65-a61c-870f9f07f82d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:24.573222 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866702b-24e5-4d65-a61c-870f9f07f82d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:24.578533 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478488e-3c00-4d6d-974c-97d69fce531f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:24.579326 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478488e-3c00-4d6d-974c-97d69fce531f admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:24.579674 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478488e-3c00-4d6d-974c-97d69fce531f admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:24.580008 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478488e-3c00-4d6d-974c-97d69fce531f admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:24.580918 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478488e-3c00-4d6d-974c-97d69fce531f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:24.582696 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478488e-3c00-4d6d-974c-97d69fce531f admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:24.598563 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1337/2679] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:57:24.608674 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3f27d-af99-427b-91f6-6dd9eb3d0179 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:24.618656 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3f27d-af99-427b-91f6-6dd9eb3d0179 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:24.623373 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333ae61-1702-43be-b419-e32b297ebb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:24.624258 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333ae61-1702-43be-b419-e32b297ebb0c admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:24.624539 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333ae61-1702-43be-b419-e32b297ebb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:24.624816 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333ae61-1702-43be-b419-e32b297ebb0c admin admin] PATH_INFO: `/v3/projects/0dac8f71ce1b4a278d7da745f138c433/users/261d0e9a9d86430c99dfc4bc454d7f3e/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:24.639530 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333ae61-1702-43be-b419-e32b297ebb0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dac8f71ce1b4a278d7da745f138c433, user_id=261d0e9a9d86430c99dfc4bc454d7f3e, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:24.642227 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333ae61-1702-43be-b419-e32b297ebb0c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:24.657146 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1343/2680] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:24 2022] PUT /identity/v3/projects/0dac8f71ce1b4a278d7da745f138c433/users/261d0e9a9d86430c99dfc4bc454d7f3e/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:24.668191 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e887ec4-1fec-402c-9c23-9a5f79d257a9 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:24.668458 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e887ec4-1fec-402c-9c23-9a5f79d257a9 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:24.668739 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e887ec4-1fec-402c-9c23-9a5f79d257a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:24.695379 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-2e887ec4-1fec-402c-9c23-9a5f79d257a9 None None] MFA Rules not processed for user `261d0e9a9d86430c99dfc4bc454d7f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:24.696589 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-2e887ec4-1fec-402c-9c23-9a5f79d257a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:24.727382 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333ae61-1702-43be-b419-e32b297ebb0c admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:24.729372 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-c333ae61-1702-43be-b419-e32b297ebb0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:24.768360 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1338/2681] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:57:24.772575 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e887ec4-1fec-402c-9c23-9a5f79d257a9 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:24.803677 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333ae61-1702-43be-b419-e32b297ebb0c admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:24.808297 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2c030-8f7e-4d3e-b922-dbdba0904c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:24.809263 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2c030-8f7e-4d3e-b922-dbdba0904c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:24.809540 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2c030-8f7e-4d3e-b922-dbdba0904c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:24.809815 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2c030-8f7e-4d3e-b922-dbdba0904c27 admin admin] PATH_INFO: `/v3/projects/c0065bf6f3fc4ccc97b3284237d5c3a2` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:24.811072 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2c030-8f7e-4d3e-b922-dbdba0904c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0065bf6f3fc4ccc97b3284237d5c3a2)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:24.813008 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2c030-8f7e-4d3e-b922-dbdba0904c27 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:24.832266 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e887ec4-1fec-402c-9c23-9a5f79d257a9 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:24.837052 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac79c1-9024-4a41-a909-ccb0a9dcf571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:24.837794 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac79c1-9024-4a41-a909-ccb0a9dcf571 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:24.838108 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac79c1-9024-4a41-a909-ccb0a9dcf571 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:24.838411 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac79c1-9024-4a41-a909-ccb0a9dcf571 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:24.839153 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac79c1-9024-4a41-a909-ccb0a9dcf571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:24.841355 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac79c1-9024-4a41-a909-ccb0a9dcf571 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:24.858319 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a6c2c030-8f7e-4d3e-b922-dbdba0904c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0065bf6f3fc4ccc97b3284237d5c3a2', 'request_id': 'req-a6c2c030-8f7e-4d3e-b922-dbdba0904c27'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:24.863831 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a6c2c030-8f7e-4d3e-b922-dbdba0904c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0065bf6f3fc4ccc97b3284237d5c3a2', 'request_id': 'req-a6c2c030-8f7e-4d3e-b922-dbdba0904c27'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:24.867434 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1339/2682] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:57:24 2022] POST /identity/v3/projects => generated 409 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:24.872046 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac79c1-9024-4a41-a909-ccb0a9dcf571 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:24.873051 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a6c2c030-8f7e-4d3e-b922-dbdba0904c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0065bf6f3fc4ccc97b3284237d5c3a2', 'request_id': 'req-a6c2c030-8f7e-4d3e-b922-dbdba0904c27'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:24.884122 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a6c2c030-8f7e-4d3e-b922-dbdba0904c27 admin admin] The token cache is being invalidate because project c0065bf6f3fc4ccc97b3284237d5c3a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:24.884413 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a6c2c030-8f7e-4d3e-b922-dbdba0904c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:24.885087 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a6c2c030-8f7e-4d3e-b922-dbdba0904c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:24.886668 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1344/2683] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:24 2022] DELETE /identity/v3/projects/c0065bf6f3fc4ccc97b3284237d5c3a2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:57:24.893164 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab886f-1e59-48d7-9607-f89b14c07d8a None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:24.893452 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab886f-1e59-48d7-9607-f89b14c07d8a None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:24.893726 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab886f-1e59-48d7-9607-f89b14c07d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:24.912004 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-f8ab886f-1e59-48d7-9607-f89b14c07d8a None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:24.913236 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f8ab886f-1e59-48d7-9607-f89b14c07d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:24.932101 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac79c1-9024-4a41-a909-ccb0a9dcf571 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:24.937628 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdb7bc-f7c1-4bf8-8e81-ff7dc7c06224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:24.938306 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdb7bc-f7c1-4bf8-8e81-ff7dc7c06224 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:24.938586 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdb7bc-f7c1-4bf8-8e81-ff7dc7c06224 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:24.938856 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdb7bc-f7c1-4bf8-8e81-ff7dc7c06224 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:24.939558 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bdb7bc-f7c1-4bf8-8e81-ff7dc7c06224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:24.941521 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bdb7bc-f7c1-4bf8-8e81-ff7dc7c06224 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:24.963805 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1340/2684] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:57:24 2022] POST /identity/v3/users => generated 311 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:24.967902 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdb7bc-f7c1-4bf8-8e81-ff7dc7c06224 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:24.969612 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-d3bdb7bc-f7c1-4bf8-8e81-ff7dc7c06224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:24.971802 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1345/2685] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:57:24.981551 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78f400-a7a2-4b71-9bac-3387d57df758 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:24.981837 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78f400-a7a2-4b71-9bac-3387d57df758 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:24.982110 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78f400-a7a2-4b71-9bac-3387d57df758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:24.982263 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdb7bc-f7c1-4bf8-8e81-ff7dc7c06224 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:24.987348 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294921d-eacb-4e51-9158-33b039bfa554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:24.988183 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294921d-eacb-4e51-9158-33b039bfa554 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:24.988465 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294921d-eacb-4e51-9158-33b039bfa554 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:24.988740 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294921d-eacb-4e51-9158-33b039bfa554 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:24.989553 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294921d-eacb-4e51-9158-33b039bfa554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:24.991140 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294921d-eacb-4e51-9158-33b039bfa554 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:25.000366 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-1e78f400-a7a2-4b71-9bac-3387d57df758 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:25.001407 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1341/2686] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:25.004035 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-1e78f400-a7a2-4b71-9bac-3387d57df758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:25.005248 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294921d-eacb-4e51-9158-33b039bfa554 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:25.015755 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1346/2687] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:25.015918 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294921d-eacb-4e51-9158-33b039bfa554 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:25.017037 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78f400-a7a2-4b71-9bac-3387d57df758 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:25.020326 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957a848-85b5-441d-8fec-96f7e9b25072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:25.021248 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957a848-85b5-441d-8fec-96f7e9b25072 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:25.021531 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957a848-85b5-441d-8fec-96f7e9b25072 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:25.021804 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957a848-85b5-441d-8fec-96f7e9b25072 admin admin] PATH_INFO: `/v3/projects/76aa91e37b4245c3a6afb8059516ffaf/users/bab07c44d17f4ac5a5a26ab5d6625cb4/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:25.026234 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78f400-a7a2-4b71-9bac-3387d57df758 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:25.030908 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836191a-7c33-48a7-b2a8-f9dbdc965b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:25.031547 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836191a-7c33-48a7-b2a8-f9dbdc965b40 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:25.031825 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836191a-7c33-48a7-b2a8-f9dbdc965b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:25.032150 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836191a-7c33-48a7-b2a8-f9dbdc965b40 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:25.032914 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836191a-7c33-48a7-b2a8-f9dbdc965b40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:57:25.033223 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836191a-7c33-48a7-b2a8-f9dbdc965b40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:25.034800 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836191a-7c33-48a7-b2a8-f9dbdc965b40 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:25.037047 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957a848-85b5-441d-8fec-96f7e9b25072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76aa91e37b4245c3a6afb8059516ffaf, user_id=bab07c44d17f4ac5a5a26ab5d6625cb4, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:25.039723 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957a848-85b5-441d-8fec-96f7e9b25072 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:25.046626 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1347/2688] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:57:25.051102 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836191a-7c33-48a7-b2a8-f9dbdc965b40 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:25.054185 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1342/2689] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:25 2022] PUT /identity/v3/projects/76aa91e37b4245c3a6afb8059516ffaf/users/bab07c44d17f4ac5a5a26ab5d6625cb4/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:57:25.057961 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957a848-85b5-441d-8fec-96f7e9b25072 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:25.061012 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836191a-7c33-48a7-b2a8-f9dbdc965b40 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:25.114869 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957a848-85b5-441d-8fec-96f7e9b25072 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:25.115501 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cd169-0518-4b86-9985-dd9a615076dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:25.115883 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cd169-0518-4b86-9985-dd9a615076dc admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:25.116120 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cd169-0518-4b86-9985-dd9a615076dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:25.116389 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cd169-0518-4b86-9985-dd9a615076dc admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:25.117133 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cd169-0518-4b86-9985-dd9a615076dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:25.119120 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cd169-0518-4b86-9985-dd9a615076dc admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:25.120180 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99768e4e-eb17-4770-a0a0-790701cde5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:25.120843 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99768e4e-eb17-4770-a0a0-790701cde5ba admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:25.121146 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99768e4e-eb17-4770-a0a0-790701cde5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:25.121451 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99768e4e-eb17-4770-a0a0-790701cde5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:25.122235 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99768e4e-eb17-4770-a0a0-790701cde5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:25.123753 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99768e4e-eb17-4770-a0a0-790701cde5ba admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:25.133485 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1343/2690] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:57:25.138069 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99768e4e-eb17-4770-a0a0-790701cde5ba admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:25.146283 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1348/2691] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:57:25 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:57:25.147918 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99768e4e-eb17-4770-a0a0-790701cde5ba admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:25.151779 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cd169-0518-4b86-9985-dd9a615076dc admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:25.206174 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3614b1e-350d-4edc-82b7-1360db1f48de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:25.207071 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3614b1e-350d-4edc-82b7-1360db1f48de admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:25.207353 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3614b1e-350d-4edc-82b7-1360db1f48de admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:25.207628 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3614b1e-350d-4edc-82b7-1360db1f48de admin admin] PATH_INFO: `/v3/projects/76aa91e37b4245c3a6afb8059516ffaf/users/bab07c44d17f4ac5a5a26ab5d6625cb4/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:25.209595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3614b1e-350d-4edc-82b7-1360db1f48de admin admin] RBAC: Authorizing `identity:create_grant(project_id=76aa91e37b4245c3a6afb8059516ffaf, user_id=bab07c44d17f4ac5a5a26ab5d6625cb4, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:25.211602 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cd169-0518-4b86-9985-dd9a615076dc admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:25.212253 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3614b1e-350d-4edc-82b7-1360db1f48de admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:25.216502 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe57f5-814b-4402-b943-d0f61f2e9045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:25.217264 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe57f5-814b-4402-b943-d0f61f2e9045 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:25.217547 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe57f5-814b-4402-b943-d0f61f2e9045 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:25.217854 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe57f5-814b-4402-b943-d0f61f2e9045 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:25.218561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe57f5-814b-4402-b943-d0f61f2e9045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:25.220481 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe57f5-814b-4402-b943-d0f61f2e9045 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:25.222600 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1344/2692] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:25 2022] PUT /identity/v3/projects/76aa91e37b4245c3a6afb8059516ffaf/users/bab07c44d17f4ac5a5a26ab5d6625cb4/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:25.233124 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d33fcb-749b-4462-bfae-4d2ac034b0dc None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:25.233489 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d33fcb-749b-4462-bfae-4d2ac034b0dc None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:25.233784 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d33fcb-749b-4462-bfae-4d2ac034b0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:25.242173 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1349/2693] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:57:25 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:57:25.246111 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe57f5-814b-4402-b943-d0f61f2e9045 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:25.255457 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe57f5-814b-4402-b943-d0f61f2e9045 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:25.259638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-c9d33fcb-749b-4462-bfae-4d2ac034b0dc None None] MFA Rules not processed for user `bab07c44d17f4ac5a5a26ab5d6625cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:25.260818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-c9d33fcb-749b-4462-bfae-4d2ac034b0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:25.312398 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573df23-4e95-494e-b6e5-13a53fbf7e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:25.313102 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573df23-4e95-494e-b6e5-13a53fbf7e9c admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:25.313390 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573df23-4e95-494e-b6e5-13a53fbf7e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:25.313666 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573df23-4e95-494e-b6e5-13a53fbf7e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:25.314398 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573df23-4e95-494e-b6e5-13a53fbf7e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:25.315997 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573df23-4e95-494e-b6e5-13a53fbf7e9c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:25.325976 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1350/2694] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:25.329041 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1345/2695] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:25 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:57:25.329659 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573df23-4e95-494e-b6e5-13a53fbf7e9c admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:25.337834 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d33fcb-749b-4462-bfae-4d2ac034b0dc None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:25.339042 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573df23-4e95-494e-b6e5-13a53fbf7e9c admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:25.339193 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-c9d33fcb-749b-4462-bfae-4d2ac034b0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:25.343639 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff77f44-7b42-4c0e-8939-d6924f82ee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:25.344282 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff77f44-7b42-4c0e-8939-d6924f82ee3c admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:25.344561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff77f44-7b42-4c0e-8939-d6924f82ee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:25.344836 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff77f44-7b42-4c0e-8939-d6924f82ee3c admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:25.345608 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff77f44-7b42-4c0e-8939-d6924f82ee3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:25.347187 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff77f44-7b42-4c0e-8939-d6924f82ee3c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:25.356969 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1351/2696] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:57:25.360884 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff77f44-7b42-4c0e-8939-d6924f82ee3c admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:25.370030 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff77f44-7b42-4c0e-8939-d6924f82ee3c admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:25.374966 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80369bf-3e1b-4b78-bfbf-b9198f3e0887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:25.375772 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80369bf-3e1b-4b78-bfbf-b9198f3e0887 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:25.376054 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80369bf-3e1b-4b78-bfbf-b9198f3e0887 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:25.376329 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80369bf-3e1b-4b78-bfbf-b9198f3e0887 admin admin] PATH_INFO: `/v3/projects/f6932b1dd58742b091dde781ec5a8126/users/24c0532cc09746ddbf32ec96c16eec30/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:25.390327 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80369bf-3e1b-4b78-bfbf-b9198f3e0887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6932b1dd58742b091dde781ec5a8126, user_id=24c0532cc09746ddbf32ec96c16eec30, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:25.392972 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80369bf-3e1b-4b78-bfbf-b9198f3e0887 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:25.393435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d33fcb-749b-4462-bfae-4d2ac034b0dc None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:25.397055 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f13f6-4cbe-474d-a8ea-544eec8a8159 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:25.397697 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f13f6-4cbe-474d-a8ea-544eec8a8159 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:25.397977 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f13f6-4cbe-474d-a8ea-544eec8a8159 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:25.398247 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f13f6-4cbe-474d-a8ea-544eec8a8159 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:25.407264 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1352/2697] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:25 2022] PUT /identity/v3/projects/f6932b1dd58742b091dde781ec5a8126/users/24c0532cc09746ddbf32ec96c16eec30/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:57:25.407579 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f13f6-4cbe-474d-a8ea-544eec8a8159 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:25.409099 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f13f6-4cbe-474d-a8ea-544eec8a8159 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:25.412189 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c5f0d-a089-4214-acb3-9b4e4af30dac None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:25.412575 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c5f0d-a089-4214-acb3-9b4e4af30dac None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:25.412826 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c5f0d-a089-4214-acb3-9b4e4af30dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:25.418373 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1346/2698] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:25 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:57:25.430512 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-c69c5f0d-a089-4214-acb3-9b4e4af30dac None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:25.431716 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-c69c5f0d-a089-4214-acb3-9b4e4af30dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:25.490082 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1353/2699] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:25.499832 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f13f6-4cbe-474d-a8ea-544eec8a8159 service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:25.501354 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-905f13f6-4cbe-474d-a8ea-544eec8a8159 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:25.555712 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c5f0d-a089-4214-acb3-9b4e4af30dac None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:25.561769 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f13f6-4cbe-474d-a8ea-544eec8a8159 service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:25.607003 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c5f0d-a089-4214-acb3-9b4e4af30dac None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:25.607862 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e844328-ec83-4da3-92f0-09a6ae8eac1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:25.608498 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e844328-ec83-4da3-92f0-09a6ae8eac1f service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:25.608781 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e844328-ec83-4da3-92f0-09a6ae8eac1f service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:25.609087 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e844328-ec83-4da3-92f0-09a6ae8eac1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:25.610752 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbf5b3-7ea8-4bb1-bc74-2f8be69231bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:25.611417 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbf5b3-7ea8-4bb1-bc74-2f8be69231bf service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:25.611696 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbf5b3-7ea8-4bb1-bc74-2f8be69231bf service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:25.611968 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbf5b3-7ea8-4bb1-bc74-2f8be69231bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:25.613745 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-89bbf5b3-7ea8-4bb1-bc74-2f8be69231bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:25.618309 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e844328-ec83-4da3-92f0-09a6ae8eac1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:25.619721 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e844328-ec83-4da3-92f0-09a6ae8eac1f service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:25.629741 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1347/2700] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:25.673703 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbf5b3-7ea8-4bb1-bc74-2f8be69231bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:25.675151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbf5b3-7ea8-4bb1-bc74-2f8be69231bf service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:25.684441 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1354/2701] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:25 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:57:26.266139 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d762450-aa78-4856-b4bd-664ff1577d25 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:26.266711 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d762450-aa78-4856-b4bd-664ff1577d25 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:26.266994 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d762450-aa78-4856-b4bd-664ff1577d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:26.294859 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-1d762450-aa78-4856-b4bd-664ff1577d25 None None] MFA Rules not processed for user `24c0532cc09746ddbf32ec96c16eec30`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:26.296330 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-1d762450-aa78-4856-b4bd-664ff1577d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:26.360970 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1348/2702] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:26.365492 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbf5b3-7ea8-4bb1-bc74-2f8be69231bf service cinder] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:26.376059 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbf5b3-7ea8-4bb1-bc74-2f8be69231bf service cinder] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:26.380768 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d990b48-10a9-4aa8-b44c-9fed4333b073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:26.381452 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d990b48-10a9-4aa8-b44c-9fed4333b073 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:26.381730 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d990b48-10a9-4aa8-b44c-9fed4333b073 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:26.382002 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d990b48-10a9-4aa8-b44c-9fed4333b073 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:26.382698 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d990b48-10a9-4aa8-b44c-9fed4333b073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:26.384586 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d990b48-10a9-4aa8-b44c-9fed4333b073 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:26.412330 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1355/2703] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:57:26 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:26.416435 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d762450-aa78-4856-b4bd-664ff1577d25 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:26.427077 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d762450-aa78-4856-b4bd-664ff1577d25 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:26.481213 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9426ff1-170a-423c-bdb8-c0e91179c6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:26.481813 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9426ff1-170a-423c-bdb8-c0e91179c6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:26.482132 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9426ff1-170a-423c-bdb8-c0e91179c6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:26.482408 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9426ff1-170a-423c-bdb8-c0e91179c6b2 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:26.483213 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9426ff1-170a-423c-bdb8-c0e91179c6b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:26.485236 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9426ff1-170a-423c-bdb8-c0e91179c6b2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:26.507043 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1349/2704] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:57:26 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:26.512628 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d990b48-10a9-4aa8-b44c-9fed4333b073 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:26.523748 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d990b48-10a9-4aa8-b44c-9fed4333b073 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:26.529529 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034d06b-8982-4d10-a0fb-ffd4b0396b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:26.530183 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034d06b-8982-4d10-a0fb-ffd4b0396b5b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:26.530490 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034d06b-8982-4d10-a0fb-ffd4b0396b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:26.530763 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034d06b-8982-4d10-a0fb-ffd4b0396b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:26.531504 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034d06b-8982-4d10-a0fb-ffd4b0396b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:26.533140 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034d06b-8982-4d10-a0fb-ffd4b0396b5b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:26.543610 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1356/2705] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:26.547779 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9426ff1-170a-423c-bdb8-c0e91179c6b2 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:26.557410 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9426ff1-170a-423c-bdb8-c0e91179c6b2 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:26.562549 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e46452-f8f6-44ea-becf-4b7d173220b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:26.563422 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e46452-f8f6-44ea-becf-4b7d173220b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:26.563708 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e46452-f8f6-44ea-becf-4b7d173220b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:26.563987 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e46452-f8f6-44ea-becf-4b7d173220b0 admin admin] PATH_INFO: `/v3/projects/2b417b53da774378a3bb1afffdf2bee5/users/352974ac496f4d9685593c66a1bd5981/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:26.578520 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e46452-f8f6-44ea-becf-4b7d173220b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b417b53da774378a3bb1afffdf2bee5, user_id=352974ac496f4d9685593c66a1bd5981, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:26.581327 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e46452-f8f6-44ea-becf-4b7d173220b0 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:26.596510 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1350/2706] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:26 2022] PUT /identity/v3/projects/2b417b53da774378a3bb1afffdf2bee5/users/352974ac496f4d9685593c66a1bd5981/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:26.600615 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034d06b-8982-4d10-a0fb-ffd4b0396b5b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:26.611182 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034d06b-8982-4d10-a0fb-ffd4b0396b5b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:26.675245 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d370d36-1883-4b24-b306-cdc475920d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:26.675898 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d370d36-1883-4b24-b306-cdc475920d8e admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:26.676192 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d370d36-1883-4b24-b306-cdc475920d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:26.676468 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d370d36-1883-4b24-b306-cdc475920d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:26.677235 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d370d36-1883-4b24-b306-cdc475920d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:26.678845 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d370d36-1883-4b24-b306-cdc475920d8e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:26.688763 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1357/2707] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:26.693186 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e46452-f8f6-44ea-becf-4b7d173220b0 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:26.704044 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e46452-f8f6-44ea-becf-4b7d173220b0 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:26.709403 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4aa554-8370-4a9e-82a9-ca8c6804e515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:26.710284 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4aa554-8370-4a9e-82a9-ca8c6804e515 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:26.710593 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4aa554-8370-4a9e-82a9-ca8c6804e515 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:26.710865 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4aa554-8370-4a9e-82a9-ca8c6804e515 admin admin] PATH_INFO: `/v3/projects/2b417b53da774378a3bb1afffdf2bee5/users/352974ac496f4d9685593c66a1bd5981/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:26.712993 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4aa554-8370-4a9e-82a9-ca8c6804e515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b417b53da774378a3bb1afffdf2bee5, user_id=352974ac496f4d9685593c66a1bd5981, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:26.715666 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4aa554-8370-4a9e-82a9-ca8c6804e515 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:26.726374 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1351/2708] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:26 2022] PUT /identity/v3/projects/2b417b53da774378a3bb1afffdf2bee5/users/352974ac496f4d9685593c66a1bd5981/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:27.358824 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2ecfe-c1ed-4150-ab41-f5be9a9d84ac None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:27.359346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2ecfe-c1ed-4150-ab41-f5be9a9d84ac None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:27.359937 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2ecfe-c1ed-4150-ab41-f5be9a9d84ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:27.387590 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-1ed2ecfe-c1ed-4150-ab41-f5be9a9d84ac None None] MFA Rules not processed for user `352974ac496f4d9685593c66a1bd5981`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:27.388822 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-1ed2ecfe-c1ed-4150-ab41-f5be9a9d84ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:27.456432 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1358/2709] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:27 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:27.467327 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4aa554-8370-4a9e-82a9-ca8c6804e515 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:27.469402 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-3f4aa554-8370-4a9e-82a9-ca8c6804e515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:27.526298 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4aa554-8370-4a9e-82a9-ca8c6804e515 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:27.529980 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba71c8d-d175-40dc-a184-d0d9559a541c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:27.530653 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba71c8d-d175-40dc-a184-d0d9559a541c service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:27.530940 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba71c8d-d175-40dc-a184-d0d9559a541c service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:27.531215 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba71c8d-d175-40dc-a184-d0d9559a541c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:27.586398 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba71c8d-d175-40dc-a184-d0d9559a541c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:27.587789 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba71c8d-d175-40dc-a184-d0d9559a541c service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:27.596735 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1352/2710] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:31.073975 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2ecfe-c1ed-4150-ab41-f5be9a9d84ac None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:31.084170 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2ecfe-c1ed-4150-ab41-f5be9a9d84ac None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:31.087974 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eced0a-2be3-4cd3-b783-de47ae8e4489 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:31.088622 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eced0a-2be3-4cd3-b783-de47ae8e4489 service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:31.088937 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eced0a-2be3-4cd3-b783-de47ae8e4489 service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:31.089214 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eced0a-2be3-4cd3-b783-de47ae8e4489 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:31.098245 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eced0a-2be3-4cd3-b783-de47ae8e4489 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:31.099706 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eced0a-2be3-4cd3-b783-de47ae8e4489 service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:31.108922 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1359/2711] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:31 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:34.032626 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba71c8d-d175-40dc-a184-d0d9559a541c service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:34.099879 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba71c8d-d175-40dc-a184-d0d9559a541c service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:34.105303 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30f98b-370a-4410-913b-ec1da8400347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:34.106309 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30f98b-370a-4410-913b-ec1da8400347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:34.106698 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30f98b-370a-4410-913b-ec1da8400347 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:34.107068 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30f98b-370a-4410-913b-ec1da8400347 admin admin] PATH_INFO: `/v3/users/261d0e9a9d86430c99dfc4bc454d7f3e` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:34.108349 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30f98b-370a-4410-913b-ec1da8400347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=261d0e9a9d86430c99dfc4bc454d7f3e)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:34.110448 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30f98b-370a-4410-913b-ec1da8400347 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:34.157113 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-8c30f98b-370a-4410-913b-ec1da8400347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '261d0e9a9d86430c99dfc4bc454d7f3e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:34.168364 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-8c30f98b-370a-4410-913b-ec1da8400347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '261d0e9a9d86430c99dfc4bc454d7f3e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:34.174898 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-8c30f98b-370a-4410-913b-ec1da8400347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '261d0e9a9d86430c99dfc4bc454d7f3e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:34.183744 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-8c30f98b-370a-4410-913b-ec1da8400347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '261d0e9a9d86430c99dfc4bc454d7f3e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:34.184394 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-8c30f98b-370a-4410-913b-ec1da8400347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '261d0e9a9d86430c99dfc4bc454d7f3e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:34.191099 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1353/2712] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:34 2022] DELETE /identity/v3/users/261d0e9a9d86430c99dfc4bc454d7f3e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:34.195846 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2874c-607f-4b44-9606-07b5de935ff4 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:34.196376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2874c-607f-4b44-9606-07b5de935ff4 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:34.196376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2874c-607f-4b44-9606-07b5de935ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:34.214186 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-a8b2874c-607f-4b44-9606-07b5de935ff4 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:34.215367 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a8b2874c-607f-4b44-9606-07b5de935ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:34.275716 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1360/2713] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:34.286516 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30f98b-370a-4410-913b-ec1da8400347 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:34.287921 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-8c30f98b-370a-4410-913b-ec1da8400347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:34.343590 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30f98b-370a-4410-913b-ec1da8400347 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:34.347434 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6baa19d-6ce0-44f6-a804-c3dd85999add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:34.348072 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baa19d-6ce0-44f6-a804-c3dd85999add service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:34.348348 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baa19d-6ce0-44f6-a804-c3dd85999add service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:34.348619 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baa19d-6ce0-44f6-a804-c3dd85999add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:34.357684 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6baa19d-6ce0-44f6-a804-c3dd85999add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:34.359114 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6baa19d-6ce0-44f6-a804-c3dd85999add service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:34.369677 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1354/2714] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:57:34.706973 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2874c-607f-4b44-9606-07b5de935ff4 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:34.708450 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a8b2874c-607f-4b44-9606-07b5de935ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:34.725678 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2874c-607f-4b44-9606-07b5de935ff4 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:34.731788 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8ccd5-132f-4b7a-ab85-1da831ff6157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:34.735106 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8ccd5-132f-4b7a-ab85-1da831ff6157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:34.735471 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8ccd5-132f-4b7a-ab85-1da831ff6157 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:34.735754 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8ccd5-132f-4b7a-ab85-1da831ff6157 admin admin] PATH_INFO: `/v3/projects/0dac8f71ce1b4a278d7da745f138c433` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:34.737126 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8ccd5-132f-4b7a-ab85-1da831ff6157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dac8f71ce1b4a278d7da745f138c433)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:34.739062 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8ccd5-132f-4b7a-ab85-1da831ff6157 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:34.786137 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-bfb8ccd5-132f-4b7a-ab85-1da831ff6157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dac8f71ce1b4a278d7da745f138c433', 'request_id': 'req-bfb8ccd5-132f-4b7a-ab85-1da831ff6157'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:34.791495 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-bfb8ccd5-132f-4b7a-ab85-1da831ff6157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dac8f71ce1b4a278d7da745f138c433', 'request_id': 'req-bfb8ccd5-132f-4b7a-ab85-1da831ff6157'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:34.800403 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-bfb8ccd5-132f-4b7a-ab85-1da831ff6157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dac8f71ce1b4a278d7da745f138c433', 'request_id': 'req-bfb8ccd5-132f-4b7a-ab85-1da831ff6157'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:34.812032 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-bfb8ccd5-132f-4b7a-ab85-1da831ff6157 admin admin] The token cache is being invalidate because project 0dac8f71ce1b4a278d7da745f138c433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:34.812318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-bfb8ccd5-132f-4b7a-ab85-1da831ff6157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:34.813067 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-bfb8ccd5-132f-4b7a-ab85-1da831ff6157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:34.814730 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1361/2715] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:34 2022] DELETE /identity/v3/projects/0dac8f71ce1b4a278d7da745f138c433 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:34.818921 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6baa19d-6ce0-44f6-a804-c3dd85999add service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:34.830622 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6baa19d-6ce0-44f6-a804-c3dd85999add service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:34.887426 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082dce8-6171-4692-97f2-760279c580bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:34.888291 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082dce8-6171-4692-97f2-760279c580bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:34.888568 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082dce8-6171-4692-97f2-760279c580bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:34.888839 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082dce8-6171-4692-97f2-760279c580bc admin admin] PATH_INFO: `/v3/users/bab07c44d17f4ac5a5a26ab5d6625cb4` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:34.890117 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082dce8-6171-4692-97f2-760279c580bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bab07c44d17f4ac5a5a26ab5d6625cb4)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:34.892117 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082dce8-6171-4692-97f2-760279c580bc admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:34.939000 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1082dce8-6171-4692-97f2-760279c580bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bab07c44d17f4ac5a5a26ab5d6625cb4'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:34.951437 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1082dce8-6171-4692-97f2-760279c580bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bab07c44d17f4ac5a5a26ab5d6625cb4'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:34.958389 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1082dce8-6171-4692-97f2-760279c580bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bab07c44d17f4ac5a5a26ab5d6625cb4'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:34.967170 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1082dce8-6171-4692-97f2-760279c580bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bab07c44d17f4ac5a5a26ab5d6625cb4'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:34.967809 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-1082dce8-6171-4692-97f2-760279c580bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bab07c44d17f4ac5a5a26ab5d6625cb4'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:34.973874 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1355/2716] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:34 2022] DELETE /identity/v3/users/bab07c44d17f4ac5a5a26ab5d6625cb4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:35.289271 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8ccd5-132f-4b7a-ab85-1da831ff6157 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:35.291588 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-bfb8ccd5-132f-4b7a-ab85-1da831ff6157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:35.306809 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8ccd5-132f-4b7a-ab85-1da831ff6157 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:35.366040 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29deda-bc90-4533-91f4-d8898339c8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:35.366909 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29deda-bc90-4533-91f4-d8898339c8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:35.367186 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29deda-bc90-4533-91f4-d8898339c8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:35.367455 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29deda-bc90-4533-91f4-d8898339c8ec admin admin] PATH_INFO: `/v3/projects/76aa91e37b4245c3a6afb8059516ffaf` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:35.368674 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29deda-bc90-4533-91f4-d8898339c8ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=76aa91e37b4245c3a6afb8059516ffaf)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:35.370635 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29deda-bc90-4533-91f4-d8898339c8ec admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:35.417549 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4f29deda-bc90-4533-91f4-d8898339c8ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76aa91e37b4245c3a6afb8059516ffaf', 'request_id': 'req-4f29deda-bc90-4533-91f4-d8898339c8ec'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:35.423063 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4f29deda-bc90-4533-91f4-d8898339c8ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76aa91e37b4245c3a6afb8059516ffaf', 'request_id': 'req-4f29deda-bc90-4533-91f4-d8898339c8ec'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:35.431450 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4f29deda-bc90-4533-91f4-d8898339c8ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76aa91e37b4245c3a6afb8059516ffaf', 'request_id': 'req-4f29deda-bc90-4533-91f4-d8898339c8ec'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:35.443610 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4f29deda-bc90-4533-91f4-d8898339c8ec admin admin] The token cache is being invalidate because project 76aa91e37b4245c3a6afb8059516ffaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:35.443924 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4f29deda-bc90-4533-91f4-d8898339c8ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:35.444642 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4f29deda-bc90-4533-91f4-d8898339c8ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:35.446450 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1362/2717] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:35 2022] DELETE /identity/v3/projects/76aa91e37b4245c3a6afb8059516ffaf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:35.452426 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9e8f3-17a3-4b06-9241-f00bb6158e20 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:35.452963 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9e8f3-17a3-4b06-9241-f00bb6158e20 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:35.453075 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9e8f3-17a3-4b06-9241-f00bb6158e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:35.473195 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-1ee9e8f3-17a3-4b06-9241-f00bb6158e20 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:35.474395 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-1ee9e8f3-17a3-4b06-9241-f00bb6158e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:35.533412 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1356/2718] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:35.545834 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f080a-4d4b-4a82-a533-a8036831e1bf None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:35.546218 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f080a-4d4b-4a82-a533-a8036831e1bf None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:35.546593 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f080a-4d4b-4a82-a533-a8036831e1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:35.566032 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-2b0f080a-4d4b-4a82-a533-a8036831e1bf None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:35.567216 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-2b0f080a-4d4b-4a82-a533-a8036831e1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:35.576647 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1363/2719] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:35.581056 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9e8f3-17a3-4b06-9241-f00bb6158e20 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:35.591068 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9e8f3-17a3-4b06-9241-f00bb6158e20 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:35.596892 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadc935-985c-41d7-8f2d-4e2888ee12bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:35.597545 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadc935-985c-41d7-8f2d-4e2888ee12bf admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:35.597822 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadc935-985c-41d7-8f2d-4e2888ee12bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:35.598093 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadc935-985c-41d7-8f2d-4e2888ee12bf admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:35.598812 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadc935-985c-41d7-8f2d-4e2888ee12bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:57:35.599116 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadc935-985c-41d7-8f2d-4e2888ee12bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:35.600741 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadc935-985c-41d7-8f2d-4e2888ee12bf admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:35.612646 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1357/2720] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:57:35.616935 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f080a-4d4b-4a82-a533-a8036831e1bf None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:35.626511 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f080a-4d4b-4a82-a533-a8036831e1bf None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:35.632059 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449d9ae-dc3f-4cb1-931f-c0fc76e930b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:35.632698 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449d9ae-dc3f-4cb1-931f-c0fc76e930b4 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:35.633009 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449d9ae-dc3f-4cb1-931f-c0fc76e930b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:35.633283 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449d9ae-dc3f-4cb1-931f-c0fc76e930b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:35.634014 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449d9ae-dc3f-4cb1-931f-c0fc76e930b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:35.635933 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449d9ae-dc3f-4cb1-931f-c0fc76e930b4 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:35.664518 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1364/2721] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:57:35 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:35.668757 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadc935-985c-41d7-8f2d-4e2888ee12bf admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:35.678511 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadc935-985c-41d7-8f2d-4e2888ee12bf admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:35.735723 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42fd8f-4fe3-45bc-9193-0b3612659fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:35.736054 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42fd8f-4fe3-45bc-9193-0b3612659fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:35.736330 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42fd8f-4fe3-45bc-9193-0b3612659fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:35.736601 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42fd8f-4fe3-45bc-9193-0b3612659fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:35.737364 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42fd8f-4fe3-45bc-9193-0b3612659fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:35.739288 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42fd8f-4fe3-45bc-9193-0b3612659fe6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:35.761603 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1358/2722] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:57:35 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:35.766040 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449d9ae-dc3f-4cb1-931f-c0fc76e930b4 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:35.777081 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449d9ae-dc3f-4cb1-931f-c0fc76e930b4 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:35.782296 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddd791-d719-4445-a418-89e92fb1b978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:35.782978 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddd791-d719-4445-a418-89e92fb1b978 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:35.783258 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddd791-d719-4445-a418-89e92fb1b978 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:35.783524 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddd791-d719-4445-a418-89e92fb1b978 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:35.784332 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddd791-d719-4445-a418-89e92fb1b978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:35.786929 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddd791-d719-4445-a418-89e92fb1b978 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:35.799963 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1365/2723] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:35.806060 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42fd8f-4fe3-45bc-9193-0b3612659fe6 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:35.822090 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42fd8f-4fe3-45bc-9193-0b3612659fe6 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:35.830136 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d69b51-7f09-4a14-a889-a975d75510a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:35.830730 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d69b51-7f09-4a14-a889-a975d75510a6 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:35.831010 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d69b51-7f09-4a14-a889-a975d75510a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:35.831283 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d69b51-7f09-4a14-a889-a975d75510a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:35.832019 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d69b51-7f09-4a14-a889-a975d75510a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:35.833668 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d69b51-7f09-4a14-a889-a975d75510a6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:35.844639 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1359/2724] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:35.849067 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddd791-d719-4445-a418-89e92fb1b978 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:35.859748 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddd791-d719-4445-a418-89e92fb1b978 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:35.866176 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a03deb-adeb-48f1-8263-6a1f3bfca775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:35.867057 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a03deb-adeb-48f1-8263-6a1f3bfca775 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:35.867342 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a03deb-adeb-48f1-8263-6a1f3bfca775 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:35.867617 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a03deb-adeb-48f1-8263-6a1f3bfca775 admin admin] PATH_INFO: `/v3/projects/e2ff5508ae7543a5b058b10e97976808/users/5a86ad7cd5114526bc56efd53551c464/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:35.883599 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a03deb-adeb-48f1-8263-6a1f3bfca775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ff5508ae7543a5b058b10e97976808, user_id=5a86ad7cd5114526bc56efd53551c464, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:35.886298 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a03deb-adeb-48f1-8263-6a1f3bfca775 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:35.903193 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1366/2725] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:35 2022] PUT /identity/v3/projects/e2ff5508ae7543a5b058b10e97976808/users/5a86ad7cd5114526bc56efd53551c464/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:35.913616 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c65c25-d395-4031-a90d-e2f68379f9be None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:35.913896 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c65c25-d395-4031-a90d-e2f68379f9be None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:35.914180 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c65c25-d395-4031-a90d-e2f68379f9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:35.941290 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-75c65c25-d395-4031-a90d-e2f68379f9be None None] MFA Rules not processed for user `5a86ad7cd5114526bc56efd53551c464`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:35.942496 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-75c65c25-d395-4031-a90d-e2f68379f9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:36.007602 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1360/2726] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:57:36.012278 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a03deb-adeb-48f1-8263-6a1f3bfca775 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:36.080125 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a03deb-adeb-48f1-8263-6a1f3bfca775 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:36.089994 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9df96-335a-4827-b4dd-507d7d26ff17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:36.090794 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9df96-335a-4827-b4dd-507d7d26ff17 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:36.091147 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9df96-335a-4827-b4dd-507d7d26ff17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:36.091489 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9df96-335a-4827-b4dd-507d7d26ff17 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:36.092594 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9df96-335a-4827-b4dd-507d7d26ff17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:36.095580 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9df96-335a-4827-b4dd-507d7d26ff17 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:36.128081 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1367/2727] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:57:36 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:36.132427 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c65c25-d395-4031-a90d-e2f68379f9be None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:36.143526 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c65c25-d395-4031-a90d-e2f68379f9be None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:36.197744 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229708b2-8c17-46b0-882d-3f13a551ef28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:36.198421 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229708b2-8c17-46b0-882d-3f13a551ef28 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:36.198704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229708b2-8c17-46b0-882d-3f13a551ef28 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:36.198978 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229708b2-8c17-46b0-882d-3f13a551ef28 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:36.199682 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229708b2-8c17-46b0-882d-3f13a551ef28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:36.201646 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229708b2-8c17-46b0-882d-3f13a551ef28 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:36.223701 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1361/2728] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:57:36 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:36.227809 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9df96-335a-4827-b4dd-507d7d26ff17 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:36.238227 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9df96-335a-4827-b4dd-507d7d26ff17 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:36.243165 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f33a53-66cd-42da-ad27-b2741fe2728b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:36.243826 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f33a53-66cd-42da-ad27-b2741fe2728b admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:36.244113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f33a53-66cd-42da-ad27-b2741fe2728b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:36.244390 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f33a53-66cd-42da-ad27-b2741fe2728b admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:36.245168 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f33a53-66cd-42da-ad27-b2741fe2728b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:36.246779 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f33a53-66cd-42da-ad27-b2741fe2728b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:36.257633 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1368/2729] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:36.262256 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229708b2-8c17-46b0-882d-3f13a551ef28 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:36.273237 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229708b2-8c17-46b0-882d-3f13a551ef28 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:36.278592 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136eed2-1529-418e-a9ed-7952c8c5af09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:36.279561 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136eed2-1529-418e-a9ed-7952c8c5af09 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:36.279908 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136eed2-1529-418e-a9ed-7952c8c5af09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:36.280190 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136eed2-1529-418e-a9ed-7952c8c5af09 admin admin] PATH_INFO: `/v3/projects/26c5cee81a7d4ac7bd66c97c89d04ecc/users/5c789ba36271421f82e4164c137b3a92/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:36.296613 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136eed2-1529-418e-a9ed-7952c8c5af09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c5cee81a7d4ac7bd66c97c89d04ecc, user_id=5c789ba36271421f82e4164c137b3a92, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:36.298411 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136eed2-1529-418e-a9ed-7952c8c5af09 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:36.312786 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1362/2730] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:36 2022] PUT /identity/v3/projects/26c5cee81a7d4ac7bd66c97c89d04ecc/users/5c789ba36271421f82e4164c137b3a92/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:36.316998 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f33a53-66cd-42da-ad27-b2741fe2728b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:36.327514 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f33a53-66cd-42da-ad27-b2741fe2728b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:36.391544 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8879b71-7908-42da-b2e9-3ec1bc45bb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:36.392273 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8879b71-7908-42da-b2e9-3ec1bc45bb10 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:36.392767 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8879b71-7908-42da-b2e9-3ec1bc45bb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:36.393043 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8879b71-7908-42da-b2e9-3ec1bc45bb10 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:36.393784 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8879b71-7908-42da-b2e9-3ec1bc45bb10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:36.395378 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8879b71-7908-42da-b2e9-3ec1bc45bb10 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:36.406226 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1369/2731] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:36.412528 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136eed2-1529-418e-a9ed-7952c8c5af09 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:36.422780 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136eed2-1529-418e-a9ed-7952c8c5af09 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:36.427804 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9b198-3c54-4074-82f9-29f763a2ae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:36.428638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9b198-3c54-4074-82f9-29f763a2ae50 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:36.428969 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9b198-3c54-4074-82f9-29f763a2ae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:36.429246 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9b198-3c54-4074-82f9-29f763a2ae50 admin admin] PATH_INFO: `/v3/projects/26c5cee81a7d4ac7bd66c97c89d04ecc/users/5c789ba36271421f82e4164c137b3a92/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:36.432479 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9b198-3c54-4074-82f9-29f763a2ae50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c5cee81a7d4ac7bd66c97c89d04ecc, user_id=5c789ba36271421f82e4164c137b3a92, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:36.435166 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9b198-3c54-4074-82f9-29f763a2ae50 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:36.448760 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1363/2732] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:36 2022] PUT /identity/v3/projects/26c5cee81a7d4ac7bd66c97c89d04ecc/users/5c789ba36271421f82e4164c137b3a92/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:36.460407 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54d134-5d5c-4187-b520-5850adc47c90 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:36.460703 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54d134-5d5c-4187-b520-5850adc47c90 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:36.461015 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54d134-5d5c-4187-b520-5850adc47c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:36.493758 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-7c54d134-5d5c-4187-b520-5850adc47c90 None None] MFA Rules not processed for user `5c789ba36271421f82e4164c137b3a92`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:36.495237 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-7c54d134-5d5c-4187-b520-5850adc47c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:36.567619 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1370/2733] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:36 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:36.578017 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9b198-3c54-4074-82f9-29f763a2ae50 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:36.579907 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-91b9b198-3c54-4074-82f9-29f763a2ae50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:36.637316 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9b198-3c54-4074-82f9-29f763a2ae50 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:36.641502 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ca9be-7a4c-4a6b-8142-da9751e30a2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:36.642181 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ca9be-7a4c-4a6b-8142-da9751e30a2f service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:36.642473 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ca9be-7a4c-4a6b-8142-da9751e30a2f service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:36.642747 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ca9be-7a4c-4a6b-8142-da9751e30a2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:36.653128 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ca9be-7a4c-4a6b-8142-da9751e30a2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:36.654656 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ca9be-7a4c-4a6b-8142-da9751e30a2f service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:36.663989 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1364/2734] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:36 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:36.753387 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54d134-5d5c-4187-b520-5850adc47c90 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:36.762905 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54d134-5d5c-4187-b520-5850adc47c90 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:36.766772 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f980753-4352-49c0-b80f-3d12c6475b5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:36.767428 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f980753-4352-49c0-b80f-3d12c6475b5f service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:36.767709 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f980753-4352-49c0-b80f-3d12c6475b5f service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:36.767983 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f980753-4352-49c0-b80f-3d12c6475b5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:36.825395 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f980753-4352-49c0-b80f-3d12c6475b5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:36.826826 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f980753-4352-49c0-b80f-3d12c6475b5f service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:36.835788 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1371/2735] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:41.636358 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ca9be-7a4c-4a6b-8142-da9751e30a2f service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:41.707890 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ca9be-7a4c-4a6b-8142-da9751e30a2f service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:41.712785 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dacdf0-8141-464e-834d-21214627df57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:41.713712 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dacdf0-8141-464e-834d-21214627df57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:41.714044 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dacdf0-8141-464e-834d-21214627df57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:41.714263 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dacdf0-8141-464e-834d-21214627df57 admin admin] PATH_INFO: `/v3/users/5a86ad7cd5114526bc56efd53551c464` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:41.715456 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dacdf0-8141-464e-834d-21214627df57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a86ad7cd5114526bc56efd53551c464)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:41.717458 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dacdf0-8141-464e-834d-21214627df57 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:41.769422 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-64dacdf0-8141-464e-834d-21214627df57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a86ad7cd5114526bc56efd53551c464'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:41.779421 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-64dacdf0-8141-464e-834d-21214627df57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a86ad7cd5114526bc56efd53551c464'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:41.786022 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-64dacdf0-8141-464e-834d-21214627df57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a86ad7cd5114526bc56efd53551c464'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:41.794391 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-64dacdf0-8141-464e-834d-21214627df57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a86ad7cd5114526bc56efd53551c464'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:41.795014 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-64dacdf0-8141-464e-834d-21214627df57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a86ad7cd5114526bc56efd53551c464'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:41.801449 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1365/2736] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:41 2022] DELETE /identity/v3/users/5a86ad7cd5114526bc56efd53551c464 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:41.806072 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b40d7-cc79-4541-b63b-0b75282f7153 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:41.806533 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b40d7-cc79-4541-b63b-0b75282f7153 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:41.806623 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b40d7-cc79-4541-b63b-0b75282f7153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:41.823648 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-ef1b40d7-cc79-4541-b63b-0b75282f7153 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:41.824897 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-ef1b40d7-cc79-4541-b63b-0b75282f7153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:41.882620 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1372/2737] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:41.892681 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dacdf0-8141-464e-834d-21214627df57 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:41.894287 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-64dacdf0-8141-464e-834d-21214627df57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:41.958263 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dacdf0-8141-464e-834d-21214627df57 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:41.962362 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9223a3-8e84-4129-acc7-c2009154552a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:41.963017 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9223a3-8e84-4129-acc7-c2009154552a service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:41.963318 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9223a3-8e84-4129-acc7-c2009154552a service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:41.963589 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9223a3-8e84-4129-acc7-c2009154552a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:41.973076 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9223a3-8e84-4129-acc7-c2009154552a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:41.974547 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9223a3-8e84-4129-acc7-c2009154552a service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:41.987934 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1366/2738] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:42.417139 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b40d7-cc79-4541-b63b-0b75282f7153 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:42.418597 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-ef1b40d7-cc79-4541-b63b-0b75282f7153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:42.430620 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b40d7-cc79-4541-b63b-0b75282f7153 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:42.435179 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699bf63-01d2-4b86-80df-eaea3c8035a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:42.436273 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699bf63-01d2-4b86-80df-eaea3c8035a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:42.436722 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699bf63-01d2-4b86-80df-eaea3c8035a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:42.437193 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699bf63-01d2-4b86-80df-eaea3c8035a3 admin admin] PATH_INFO: `/v3/projects/e2ff5508ae7543a5b058b10e97976808` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:42.438597 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699bf63-01d2-4b86-80df-eaea3c8035a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ff5508ae7543a5b058b10e97976808)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:42.441365 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699bf63-01d2-4b86-80df-eaea3c8035a3 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:42.517027 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8699bf63-01d2-4b86-80df-eaea3c8035a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ff5508ae7543a5b058b10e97976808', 'request_id': 'req-8699bf63-01d2-4b86-80df-eaea3c8035a3'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:42.523670 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8699bf63-01d2-4b86-80df-eaea3c8035a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ff5508ae7543a5b058b10e97976808', 'request_id': 'req-8699bf63-01d2-4b86-80df-eaea3c8035a3'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:42.533153 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8699bf63-01d2-4b86-80df-eaea3c8035a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ff5508ae7543a5b058b10e97976808', 'request_id': 'req-8699bf63-01d2-4b86-80df-eaea3c8035a3'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:42.552089 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8699bf63-01d2-4b86-80df-eaea3c8035a3 admin admin] The token cache is being invalidate because project e2ff5508ae7543a5b058b10e97976808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:42.552528 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8699bf63-01d2-4b86-80df-eaea3c8035a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:42.553290 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8699bf63-01d2-4b86-80df-eaea3c8035a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:42.555018 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1373/2739] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:42 2022] DELETE /identity/v3/projects/e2ff5508ae7543a5b058b10e97976808 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:42.559169 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9223a3-8e84-4129-acc7-c2009154552a service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:42.570635 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9223a3-8e84-4129-acc7-c2009154552a service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:42.626157 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dec7f-7f06-4459-9526-1e83a2c657c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:42.627059 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dec7f-7f06-4459-9526-1e83a2c657c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:42.627337 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dec7f-7f06-4459-9526-1e83a2c657c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:42.627602 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dec7f-7f06-4459-9526-1e83a2c657c8 admin admin] PATH_INFO: `/v3/users/5c789ba36271421f82e4164c137b3a92` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:42.628878 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dec7f-7f06-4459-9526-1e83a2c657c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c789ba36271421f82e4164c137b3a92)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:42.630965 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dec7f-7f06-4459-9526-1e83a2c657c8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:42.676881 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4e4dec7f-7f06-4459-9526-1e83a2c657c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c789ba36271421f82e4164c137b3a92'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:42.688058 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4e4dec7f-7f06-4459-9526-1e83a2c657c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c789ba36271421f82e4164c137b3a92'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:42.696530 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4e4dec7f-7f06-4459-9526-1e83a2c657c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c789ba36271421f82e4164c137b3a92'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:42.707976 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4e4dec7f-7f06-4459-9526-1e83a2c657c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c789ba36271421f82e4164c137b3a92'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:42.708753 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4e4dec7f-7f06-4459-9526-1e83a2c657c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c789ba36271421f82e4164c137b3a92'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:42.717752 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1367/2740] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:42 2022] DELETE /identity/v3/users/5c789ba36271421f82e4164c137b3a92 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:43.045457 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699bf63-01d2-4b86-80df-eaea3c8035a3 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:43.047212 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-8699bf63-01d2-4b86-80df-eaea3c8035a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:43.066879 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699bf63-01d2-4b86-80df-eaea3c8035a3 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:43.127235 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9903700-14a2-4562-ab17-14c8b14c0b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:43.128109 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9903700-14a2-4562-ab17-14c8b14c0b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:43.128393 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9903700-14a2-4562-ab17-14c8b14c0b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:43.128704 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9903700-14a2-4562-ab17-14c8b14c0b61 admin admin] PATH_INFO: `/v3/projects/26c5cee81a7d4ac7bd66c97c89d04ecc` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:43.129953 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9903700-14a2-4562-ab17-14c8b14c0b61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26c5cee81a7d4ac7bd66c97c89d04ecc)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:43.131868 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9903700-14a2-4562-ab17-14c8b14c0b61 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:43.180052 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d9903700-14a2-4562-ab17-14c8b14c0b61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26c5cee81a7d4ac7bd66c97c89d04ecc', 'request_id': 'req-d9903700-14a2-4562-ab17-14c8b14c0b61'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:43.185234 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d9903700-14a2-4562-ab17-14c8b14c0b61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26c5cee81a7d4ac7bd66c97c89d04ecc', 'request_id': 'req-d9903700-14a2-4562-ab17-14c8b14c0b61'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:43.193804 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d9903700-14a2-4562-ab17-14c8b14c0b61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26c5cee81a7d4ac7bd66c97c89d04ecc', 'request_id': 'req-d9903700-14a2-4562-ab17-14c8b14c0b61'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:43.206739 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d9903700-14a2-4562-ab17-14c8b14c0b61 admin admin] The token cache is being invalidate because project 26c5cee81a7d4ac7bd66c97c89d04ecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:43.207021 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d9903700-14a2-4562-ab17-14c8b14c0b61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:43.207677 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d9903700-14a2-4562-ab17-14c8b14c0b61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:43.209525 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1374/2741] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:43 2022] DELETE /identity/v3/projects/26c5cee81a7d4ac7bd66c97c89d04ecc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:43.214903 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb0bd6-5581-4242-b954-24f74e1a8c0f None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:43.215199 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb0bd6-5581-4242-b954-24f74e1a8c0f None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:43.215484 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb0bd6-5581-4242-b954-24f74e1a8c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:43.236111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-c5eb0bd6-5581-4242-b954-24f74e1a8c0f None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:43.236842 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-c5eb0bd6-5581-4242-b954-24f74e1a8c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:43.309742 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1368/2742] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:43.312101 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d82c94-f868-4d9d-ab7a-7c43dfe0fc31 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:43.312456 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d82c94-f868-4d9d-ab7a-7c43dfe0fc31 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:43.312797 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d82c94-f868-4d9d-ab7a-7c43dfe0fc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:43.334855 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-01d82c94-f868-4d9d-ab7a-7c43dfe0fc31 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:43.335019 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-01d82c94-f868-4d9d-ab7a-7c43dfe0fc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:43.345785 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1375/2743] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:43.350112 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb0bd6-5581-4242-b954-24f74e1a8c0f None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:43.359982 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb0bd6-5581-4242-b954-24f74e1a8c0f None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:43.365123 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5b7f9-e3e2-417a-a984-bd851141b7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:43.366018 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5b7f9-e3e2-417a-a984-bd851141b7da admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:43.366251 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5b7f9-e3e2-417a-a984-bd851141b7da admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:43.366595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5b7f9-e3e2-417a-a984-bd851141b7da admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:43.367429 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5b7f9-e3e2-417a-a984-bd851141b7da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:57:43.367782 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5b7f9-e3e2-417a-a984-bd851141b7da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:43.369522 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5b7f9-e3e2-417a-a984-bd851141b7da admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:43.381798 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1369/2744] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:57:43.387387 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d82c94-f868-4d9d-ab7a-7c43dfe0fc31 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:43.397540 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d82c94-f868-4d9d-ab7a-7c43dfe0fc31 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:43.412203 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c8112-2d14-4e3c-b676-51f0e02c42ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:43.412902 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c8112-2d14-4e3c-b676-51f0e02c42ea admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:43.413188 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c8112-2d14-4e3c-b676-51f0e02c42ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:43.413458 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c8112-2d14-4e3c-b676-51f0e02c42ea admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:43.414184 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c8112-2d14-4e3c-b676-51f0e02c42ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:43.416086 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c8112-2d14-4e3c-b676-51f0e02c42ea admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:43.443175 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1376/2745] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:57:43 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:57:43.447102 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5b7f9-e3e2-417a-a984-bd851141b7da admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:43.457098 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5b7f9-e3e2-417a-a984-bd851141b7da admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:43.511640 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea32fa-159c-4505-ab44-cb6a544fc3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:43.512647 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea32fa-159c-4505-ab44-cb6a544fc3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:43.512955 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea32fa-159c-4505-ab44-cb6a544fc3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:43.513238 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea32fa-159c-4505-ab44-cb6a544fc3b2 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:43.513956 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea32fa-159c-4505-ab44-cb6a544fc3b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:43.515951 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea32fa-159c-4505-ab44-cb6a544fc3b2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:43.538030 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1370/2746] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:57:43 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:43.542115 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c8112-2d14-4e3c-b676-51f0e02c42ea admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:43.553038 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c8112-2d14-4e3c-b676-51f0e02c42ea admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:43.566633 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d7bdc-7a1c-4932-896b-16479db41489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:43.567538 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d7bdc-7a1c-4932-896b-16479db41489 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:43.568002 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d7bdc-7a1c-4932-896b-16479db41489 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:43.568268 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d7bdc-7a1c-4932-896b-16479db41489 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:43.569149 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d7bdc-7a1c-4932-896b-16479db41489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:43.570905 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d7bdc-7a1c-4932-896b-16479db41489 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:43.583382 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1377/2747] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:43.587444 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea32fa-159c-4505-ab44-cb6a544fc3b2 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:43.599538 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea32fa-159c-4505-ab44-cb6a544fc3b2 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:43.604374 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f4d39-6335-4269-b5ee-ef998bc38670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:43.605091 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f4d39-6335-4269-b5ee-ef998bc38670 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:43.605373 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f4d39-6335-4269-b5ee-ef998bc38670 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:43.605647 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f4d39-6335-4269-b5ee-ef998bc38670 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:43.606531 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f4d39-6335-4269-b5ee-ef998bc38670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:43.608438 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f4d39-6335-4269-b5ee-ef998bc38670 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:43.625108 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1371/2748] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:43.626388 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d7bdc-7a1c-4932-896b-16479db41489 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:43.639896 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d7bdc-7a1c-4932-896b-16479db41489 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:43.645338 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37ca28-6599-425b-94d6-cefebf4ceb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:43.646253 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37ca28-6599-425b-94d6-cefebf4ceb13 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:43.646521 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37ca28-6599-425b-94d6-cefebf4ceb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:43.646975 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37ca28-6599-425b-94d6-cefebf4ceb13 admin admin] PATH_INFO: `/v3/projects/40691b398b29451588ca9114a14502b5/users/746f61e3eb844389b266162dcf8df759/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:43.662933 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37ca28-6599-425b-94d6-cefebf4ceb13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40691b398b29451588ca9114a14502b5, user_id=746f61e3eb844389b266162dcf8df759, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:43.666224 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37ca28-6599-425b-94d6-cefebf4ceb13 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:43.681651 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1378/2749] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:43 2022] PUT /identity/v3/projects/40691b398b29451588ca9114a14502b5/users/746f61e3eb844389b266162dcf8df759/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:43.694861 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0275c8e-5351-47e0-a5a8-a731a47644de None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:43.695417 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0275c8e-5351-47e0-a5a8-a731a47644de None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:43.695535 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0275c8e-5351-47e0-a5a8-a731a47644de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:43.729469 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-f0275c8e-5351-47e0-a5a8-a731a47644de None None] MFA Rules not processed for user `746f61e3eb844389b266162dcf8df759`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:43.730917 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-f0275c8e-5351-47e0-a5a8-a731a47644de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:43.809824 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1372/2750] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:43.814077 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37ca28-6599-425b-94d6-cefebf4ceb13 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:43.878935 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37ca28-6599-425b-94d6-cefebf4ceb13 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:43.883975 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3d12b-a547-4797-a53c-3d0eb02e7654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:43.885071 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3d12b-a547-4797-a53c-3d0eb02e7654 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:43.885071 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3d12b-a547-4797-a53c-3d0eb02e7654 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:43.885405 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3d12b-a547-4797-a53c-3d0eb02e7654 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:43.885909 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3d12b-a547-4797-a53c-3d0eb02e7654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:43.887851 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3d12b-a547-4797-a53c-3d0eb02e7654 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:43.917713 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1379/2751] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:57:43 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:43.921885 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0275c8e-5351-47e0-a5a8-a731a47644de None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:43.934014 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0275c8e-5351-47e0-a5a8-a731a47644de None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:44.000324 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65632b28-be17-4150-bbc1-a331a2536e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:44.001059 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65632b28-be17-4150-bbc1-a331a2536e70 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:44.001383 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65632b28-be17-4150-bbc1-a331a2536e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:44.001767 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65632b28-be17-4150-bbc1-a331a2536e70 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:44.002489 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65632b28-be17-4150-bbc1-a331a2536e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:44.005282 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65632b28-be17-4150-bbc1-a331a2536e70 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:44.047884 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1373/2752] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:57:43 2022] POST /identity/v3/users => generated 297 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:57:44.051825 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3d12b-a547-4797-a53c-3d0eb02e7654 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:44.063669 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3d12b-a547-4797-a53c-3d0eb02e7654 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:44.064097 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65632b28-be17-4150-bbc1-a331a2536e70 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:44.066125 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-65632b28-be17-4150-bbc1-a331a2536e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:44.068651 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5bc39-7b20-4a53-b843-4d53ac403c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:44.069355 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5bc39-7b20-4a53-b843-4d53ac403c26 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:44.069635 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5bc39-7b20-4a53-b843-4d53ac403c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:44.069911 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5bc39-7b20-4a53-b843-4d53ac403c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:44.070654 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5bc39-7b20-4a53-b843-4d53ac403c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:44.072449 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5bc39-7b20-4a53-b843-4d53ac403c26 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:44.085245 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1380/2753] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:44.090412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5bc39-7b20-4a53-b843-4d53ac403c26 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:44.101971 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5bc39-7b20-4a53-b843-4d53ac403c26 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:44.107564 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19f2ee-f5ae-4378-8a81-15cd95b7692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:44.108843 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19f2ee-f5ae-4378-8a81-15cd95b7692e admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:44.109369 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19f2ee-f5ae-4378-8a81-15cd95b7692e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:44.109747 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19f2ee-f5ae-4378-8a81-15cd95b7692e admin admin] PATH_INFO: `/v3/projects/f4df423829e7480091d211737c2a0468/users/5ebb05a0549e47b5863da50734415245/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:44.125608 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19f2ee-f5ae-4378-8a81-15cd95b7692e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4df423829e7480091d211737c2a0468, user_id=5ebb05a0549e47b5863da50734415245, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:44.128705 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19f2ee-f5ae-4378-8a81-15cd95b7692e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:44.134893 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65632b28-be17-4150-bbc1-a331a2536e70 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:44.138877 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390a59b-92f1-4d21-9767-3825a097d1a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:44.139606 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390a59b-92f1-4d21-9767-3825a097d1a9 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:44.139916 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390a59b-92f1-4d21-9767-3825a097d1a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:44.140475 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390a59b-92f1-4d21-9767-3825a097d1a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:44.142129 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-3390a59b-92f1-4d21-9767-3825a097d1a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:44.148255 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1381/2754] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:44 2022] PUT /identity/v3/projects/f4df423829e7480091d211737c2a0468/users/5ebb05a0549e47b5863da50734415245/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:57:44.149925 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19f2ee-f5ae-4378-8a81-15cd95b7692e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:44.158111 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390a59b-92f1-4d21-9767-3825a097d1a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:44.159676 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390a59b-92f1-4d21-9767-3825a097d1a9 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:44.170595 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1374/2755] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:57:44.213483 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19f2ee-f5ae-4378-8a81-15cd95b7692e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:44.218792 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26169b3-c823-48ec-944f-50aea424084d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:44.219465 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26169b3-c823-48ec-944f-50aea424084d admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:44.219744 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26169b3-c823-48ec-944f-50aea424084d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:44.220068 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26169b3-c823-48ec-944f-50aea424084d admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:44.220805 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26169b3-c823-48ec-944f-50aea424084d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:44.222438 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26169b3-c823-48ec-944f-50aea424084d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:44.233097 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1382/2756] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:57:44.238044 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390a59b-92f1-4d21-9767-3825a097d1a9 service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:44.247318 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390a59b-92f1-4d21-9767-3825a097d1a9 service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:44.253198 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd9560-02df-445f-a583-0d98a6cd9c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:44.254328 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd9560-02df-445f-a583-0d98a6cd9c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:44.254615 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd9560-02df-445f-a583-0d98a6cd9c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:44.254891 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd9560-02df-445f-a583-0d98a6cd9c81 admin admin] PATH_INFO: `/v3/projects/f4df423829e7480091d211737c2a0468/users/5ebb05a0549e47b5863da50734415245/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:44.257140 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd9560-02df-445f-a583-0d98a6cd9c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4df423829e7480091d211737c2a0468, user_id=5ebb05a0549e47b5863da50734415245, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:44.259953 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd9560-02df-445f-a583-0d98a6cd9c81 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:44.284804 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1375/2757] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:44 2022] PUT /identity/v3/projects/f4df423829e7480091d211737c2a0468/users/5ebb05a0549e47b5863da50734415245/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:44.286444 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339959e0-3582-4ca9-a4a2-4b15f2c13e71 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:44.286735 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339959e0-3582-4ca9-a4a2-4b15f2c13e71 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:44.287015 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339959e0-3582-4ca9-a4a2-4b15f2c13e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:44.316199 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-339959e0-3582-4ca9-a4a2-4b15f2c13e71 None None] MFA Rules not processed for user `5ebb05a0549e47b5863da50734415245`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:44.317343 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-339959e0-3582-4ca9-a4a2-4b15f2c13e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:44.338864 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd9560-02df-445f-a583-0d98a6cd9c81 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:44.340621 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-a7bd9560-02df-445f-a583-0d98a6cd9c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:44.398222 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1383/2758] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:57:44.405904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339959e0-3582-4ca9-a4a2-4b15f2c13e71 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:44.407695 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-339959e0-3582-4ca9-a4a2-4b15f2c13e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:44.419165 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd9560-02df-445f-a583-0d98a6cd9c81 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:44.423943 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee2310-963e-4bc6-8da8-a1457058c5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:44.424924 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee2310-963e-4bc6-8da8-a1457058c5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:44.425273 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee2310-963e-4bc6-8da8-a1457058c5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:44.425914 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee2310-963e-4bc6-8da8-a1457058c5d4 admin admin] PATH_INFO: `/v3/users/24c0532cc09746ddbf32ec96c16eec30` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:44.426885 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee2310-963e-4bc6-8da8-a1457058c5d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c0532cc09746ddbf32ec96c16eec30)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:44.428962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee2310-963e-4bc6-8da8-a1457058c5d4 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:44.467211 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339959e0-3582-4ca9-a4a2-4b15f2c13e71 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:44.471202 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a234e-33e1-4b13-92b8-22f3db5dde13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:44.471857 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a234e-33e1-4b13-92b8-22f3db5dde13 service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:44.472162 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a234e-33e1-4b13-92b8-22f3db5dde13 service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:44.472825 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a234e-33e1-4b13-92b8-22f3db5dde13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:44.480259 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-2fee2310-963e-4bc6-8da8-a1457058c5d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c0532cc09746ddbf32ec96c16eec30'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:44.482222 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a234e-33e1-4b13-92b8-22f3db5dde13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:44.483681 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a234e-33e1-4b13-92b8-22f3db5dde13 service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:44.493481 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1384/2759] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:57:44.493686 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-2fee2310-963e-4bc6-8da8-a1457058c5d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c0532cc09746ddbf32ec96c16eec30'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:44.505611 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-2fee2310-963e-4bc6-8da8-a1457058c5d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c0532cc09746ddbf32ec96c16eec30'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:44.515294 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-2fee2310-963e-4bc6-8da8-a1457058c5d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c0532cc09746ddbf32ec96c16eec30'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:44.515913 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-2fee2310-963e-4bc6-8da8-a1457058c5d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c0532cc09746ddbf32ec96c16eec30'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:44.523737 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1376/2760] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:44 2022] DELETE /identity/v3/users/24c0532cc09746ddbf32ec96c16eec30 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:57:44.730769 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a234e-33e1-4b13-92b8-22f3db5dde13 service cinder] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:44.748132 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a234e-33e1-4b13-92b8-22f3db5dde13 service cinder] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:44.822561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb5e2f-0df6-4077-9717-50c81b317137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:44.823606 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb5e2f-0df6-4077-9717-50c81b317137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:44.823959 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb5e2f-0df6-4077-9717-50c81b317137 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:44.824233 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb5e2f-0df6-4077-9717-50c81b317137 admin admin] PATH_INFO: `/v3/projects/f6932b1dd58742b091dde781ec5a8126` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:44.825505 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb5e2f-0df6-4077-9717-50c81b317137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6932b1dd58742b091dde781ec5a8126)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:44.827567 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb5e2f-0df6-4077-9717-50c81b317137 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:44.885443 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-26eb5e2f-0df6-4077-9717-50c81b317137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6932b1dd58742b091dde781ec5a8126', 'request_id': 'req-26eb5e2f-0df6-4077-9717-50c81b317137'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:44.890846 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-26eb5e2f-0df6-4077-9717-50c81b317137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6932b1dd58742b091dde781ec5a8126', 'request_id': 'req-26eb5e2f-0df6-4077-9717-50c81b317137'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:44.901860 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee2310-963e-4bc6-8da8-a1457058c5d4 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:44.902424 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-26eb5e2f-0df6-4077-9717-50c81b317137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6932b1dd58742b091dde781ec5a8126', 'request_id': 'req-26eb5e2f-0df6-4077-9717-50c81b317137'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:44.903262 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-2fee2310-963e-4bc6-8da8-a1457058c5d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:44.915711 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-26eb5e2f-0df6-4077-9717-50c81b317137 admin admin] The token cache is being invalidate because project f6932b1dd58742b091dde781ec5a8126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:44.916177 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-26eb5e2f-0df6-4077-9717-50c81b317137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:44.916972 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-26eb5e2f-0df6-4077-9717-50c81b317137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:44.918851 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1385/2761] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:44 2022] DELETE /identity/v3/projects/f6932b1dd58742b091dde781ec5a8126 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:44.921823 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee2310-963e-4bc6-8da8-a1457058c5d4 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:44.922774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb5e2f-0df6-4077-9717-50c81b317137 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:44.924641 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-26eb5e2f-0df6-4077-9717-50c81b317137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:44.991120 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f5c2a-355c-4de1-9d88-e5e07cd481e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:44.992297 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f5c2a-355c-4de1-9d88-e5e07cd481e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:44.992675 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f5c2a-355c-4de1-9d88-e5e07cd481e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:44.992984 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f5c2a-355c-4de1-9d88-e5e07cd481e8 admin admin] PATH_INFO: `/v3/users/746f61e3eb844389b266162dcf8df759` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:44.994191 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f5c2a-355c-4de1-9d88-e5e07cd481e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=746f61e3eb844389b266162dcf8df759)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:44.996443 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f5c2a-355c-4de1-9d88-e5e07cd481e8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:45.012144 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb5e2f-0df6-4077-9717-50c81b317137 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:45.016747 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06bd19-d89f-445c-9eb1-ae0ec934feac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:45.017828 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06bd19-d89f-445c-9eb1-ae0ec934feac admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:45.018133 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06bd19-d89f-445c-9eb1-ae0ec934feac admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:45.018404 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06bd19-d89f-445c-9eb1-ae0ec934feac admin admin] PATH_INFO: `/v3/users/352974ac496f4d9685593c66a1bd5981` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:45.019631 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06bd19-d89f-445c-9eb1-ae0ec934feac admin admin] RBAC: Authorizing `identity:delete_user(user_id=352974ac496f4d9685593c66a1bd5981)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:45.022222 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06bd19-d89f-445c-9eb1-ae0ec934feac admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:45.053434 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-818f5c2a-355c-4de1-9d88-e5e07cd481e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '746f61e3eb844389b266162dcf8df759'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:45.066784 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-818f5c2a-355c-4de1-9d88-e5e07cd481e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '746f61e3eb844389b266162dcf8df759'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:45.073803 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-818f5c2a-355c-4de1-9d88-e5e07cd481e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '746f61e3eb844389b266162dcf8df759'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:45.077537 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8e06bd19-d89f-445c-9eb1-ae0ec934feac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352974ac496f4d9685593c66a1bd5981'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:45.078545 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8e06bd19-d89f-445c-9eb1-ae0ec934feac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352974ac496f4d9685593c66a1bd5981'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:45.079263 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8e06bd19-d89f-445c-9eb1-ae0ec934feac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352974ac496f4d9685593c66a1bd5981'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:45.083098 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-818f5c2a-355c-4de1-9d88-e5e07cd481e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '746f61e3eb844389b266162dcf8df759'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:45.083776 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-818f5c2a-355c-4de1-9d88-e5e07cd481e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '746f61e3eb844389b266162dcf8df759'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:45.090551 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1377/2762] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:44 2022] DELETE /identity/v3/users/746f61e3eb844389b266162dcf8df759 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:57:45.091947 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8e06bd19-d89f-445c-9eb1-ae0ec934feac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352974ac496f4d9685593c66a1bd5981'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:45.095153 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3cfaf-e3ce-4e41-ba32-3c482356c6bb None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:45.096576 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3cfaf-e3ce-4e41-ba32-3c482356c6bb None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:45.096576 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3cfaf-e3ce-4e41-ba32-3c482356c6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:45.099652 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8e06bd19-d89f-445c-9eb1-ae0ec934feac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352974ac496f4d9685593c66a1bd5981'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:45.113566 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1386/2763] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:44 2022] DELETE /identity/v3/users/352974ac496f4d9685593c66a1bd5981 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:45.115960 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-70c3cfaf-e3ce-4e41-ba32-3c482356c6bb None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:45.117272 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-70c3cfaf-e3ce-4e41-ba32-3c482356c6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:45.185000 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1378/2764] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:45.194024 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06bd19-d89f-445c-9eb1-ae0ec934feac admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:45.195487 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-8e06bd19-d89f-445c-9eb1-ae0ec934feac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:45.268778 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06bd19-d89f-445c-9eb1-ae0ec934feac admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:45.273888 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca09540-2586-4693-8eba-cc3194f3070d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:45.275647 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca09540-2586-4693-8eba-cc3194f3070d service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:45.276294 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca09540-2586-4693-8eba-cc3194f3070d service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:45.276803 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca09540-2586-4693-8eba-cc3194f3070d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:45.291955 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca09540-2586-4693-8eba-cc3194f3070d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:45.293731 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca09540-2586-4693-8eba-cc3194f3070d service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:45.306625 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1387/2765] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:45.364053 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3cfaf-e3ce-4e41-ba32-3c482356c6bb None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:45.365506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-70c3cfaf-e3ce-4e41-ba32-3c482356c6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:45.392169 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3cfaf-e3ce-4e41-ba32-3c482356c6bb None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:45.399660 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0951302-10da-47e7-9831-5ef4237d54d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:45.401313 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0951302-10da-47e7-9831-5ef4237d54d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:45.401804 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0951302-10da-47e7-9831-5ef4237d54d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:45.402171 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0951302-10da-47e7-9831-5ef4237d54d4 admin admin] PATH_INFO: `/v3/projects/2b417b53da774378a3bb1afffdf2bee5` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:45.404733 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0951302-10da-47e7-9831-5ef4237d54d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b417b53da774378a3bb1afffdf2bee5)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:45.407702 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0951302-10da-47e7-9831-5ef4237d54d4 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:45.464007 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d0951302-10da-47e7-9831-5ef4237d54d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b417b53da774378a3bb1afffdf2bee5', 'request_id': 'req-d0951302-10da-47e7-9831-5ef4237d54d4'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:45.470171 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d0951302-10da-47e7-9831-5ef4237d54d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b417b53da774378a3bb1afffdf2bee5', 'request_id': 'req-d0951302-10da-47e7-9831-5ef4237d54d4'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:45.487034 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d0951302-10da-47e7-9831-5ef4237d54d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b417b53da774378a3bb1afffdf2bee5', 'request_id': 'req-d0951302-10da-47e7-9831-5ef4237d54d4'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:45.500028 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d0951302-10da-47e7-9831-5ef4237d54d4 admin admin] The token cache is being invalidate because project 2b417b53da774378a3bb1afffdf2bee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:45.500304 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d0951302-10da-47e7-9831-5ef4237d54d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:45.501047 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d0951302-10da-47e7-9831-5ef4237d54d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:45.502694 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1379/2766] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:45 2022] DELETE /identity/v3/projects/2b417b53da774378a3bb1afffdf2bee5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:45.514119 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c891eb2-c6e7-4d04-8388-4e1c5987a26e None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:45.514445 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c891eb2-c6e7-4d04-8388-4e1c5987a26e None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:45.514691 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c891eb2-c6e7-4d04-8388-4e1c5987a26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:45.538873 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-0c891eb2-c6e7-4d04-8388-4e1c5987a26e None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:45.540373 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-0c891eb2-c6e7-4d04-8388-4e1c5987a26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:45.610178 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1388/2767] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:45.622121 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a93d1-b373-4a32-a0c2-e115544b924a None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:45.622624 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a93d1-b373-4a32-a0c2-e115544b924a None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:45.622835 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a93d1-b373-4a32-a0c2-e115544b924a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:45.643091 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b22a93d1-b373-4a32-a0c2-e115544b924a None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:45.644317 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b22a93d1-b373-4a32-a0c2-e115544b924a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:45.653270 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1380/2768] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:45.657725 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c891eb2-c6e7-4d04-8388-4e1c5987a26e None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:45.667635 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c891eb2-c6e7-4d04-8388-4e1c5987a26e None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:45.673856 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe67e3-0e74-4300-848a-165bbb4451ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:45.674562 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe67e3-0e74-4300-848a-165bbb4451ef admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:45.674951 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe67e3-0e74-4300-848a-165bbb4451ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:45.675421 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe67e3-0e74-4300-848a-165bbb4451ef admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:45.676173 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe67e3-0e74-4300-848a-165bbb4451ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:57:45.676494 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe67e3-0e74-4300-848a-165bbb4451ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:45.678149 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe67e3-0e74-4300-848a-165bbb4451ef admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:45.694679 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1389/2769] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:57:45.695860 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a93d1-b373-4a32-a0c2-e115544b924a None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:45.706655 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a93d1-b373-4a32-a0c2-e115544b924a None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:45.711723 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460adf3-1e78-4747-bcb6-bdea22f5f9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:45.712441 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460adf3-1e78-4747-bcb6-bdea22f5f9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:45.712721 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460adf3-1e78-4747-bcb6-bdea22f5f9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:45.713065 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460adf3-1e78-4747-bcb6-bdea22f5f9c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:45.713794 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460adf3-1e78-4747-bcb6-bdea22f5f9c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:45.715942 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460adf3-1e78-4747-bcb6-bdea22f5f9c8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:45.748808 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1381/2770] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:57:45 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:45.753108 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe67e3-0e74-4300-848a-165bbb4451ef admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:45.765341 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe67e3-0e74-4300-848a-165bbb4451ef admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:45.828190 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411a256-d499-4eb3-92c8-20cc29844327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:45.828961 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411a256-d499-4eb3-92c8-20cc29844327 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:45.829166 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411a256-d499-4eb3-92c8-20cc29844327 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:45.829491 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411a256-d499-4eb3-92c8-20cc29844327 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:45.830202 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411a256-d499-4eb3-92c8-20cc29844327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:45.832136 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411a256-d499-4eb3-92c8-20cc29844327 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:45.856503 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1390/2771] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:57:45 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:45.860281 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460adf3-1e78-4747-bcb6-bdea22f5f9c8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:45.871591 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460adf3-1e78-4747-bcb6-bdea22f5f9c8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:45.876897 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d362f8e-646d-426b-bb51-a8c271d08358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:45.877604 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d362f8e-646d-426b-bb51-a8c271d08358 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:45.877892 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d362f8e-646d-426b-bb51-a8c271d08358 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:45.878168 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d362f8e-646d-426b-bb51-a8c271d08358 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:45.878990 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d362f8e-646d-426b-bb51-a8c271d08358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:45.880604 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d362f8e-646d-426b-bb51-a8c271d08358 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:45.892685 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1382/2772] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:57:45.897200 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411a256-d499-4eb3-92c8-20cc29844327 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:45.909084 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411a256-d499-4eb3-92c8-20cc29844327 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:45.914623 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039636c1-bc14-4b92-8ce4-e6f831091f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:45.915376 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039636c1-bc14-4b92-8ce4-e6f831091f38 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:45.915740 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039636c1-bc14-4b92-8ce4-e6f831091f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:45.916079 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039636c1-bc14-4b92-8ce4-e6f831091f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:45.916921 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039636c1-bc14-4b92-8ce4-e6f831091f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:45.918615 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039636c1-bc14-4b92-8ce4-e6f831091f38 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:45.932987 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1391/2773] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:45.934176 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d362f8e-646d-426b-bb51-a8c271d08358 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:45.944383 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d362f8e-646d-426b-bb51-a8c271d08358 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:45.950169 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390f18d-b6d6-441c-a977-d13f38b9ccfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:45.951184 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390f18d-b6d6-441c-a977-d13f38b9ccfa admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:45.951557 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390f18d-b6d6-441c-a977-d13f38b9ccfa admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:45.952538 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390f18d-b6d6-441c-a977-d13f38b9ccfa admin admin] PATH_INFO: `/v3/projects/477996de193f470e93832b8ea2ec9bf8/users/dab13d690b3849888906a6234d2b2207/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:45.969508 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390f18d-b6d6-441c-a977-d13f38b9ccfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=477996de193f470e93832b8ea2ec9bf8, user_id=dab13d690b3849888906a6234d2b2207, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:45.972487 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390f18d-b6d6-441c-a977-d13f38b9ccfa admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:45.989323 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1383/2774] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:45 2022] PUT /identity/v3/projects/477996de193f470e93832b8ea2ec9bf8/users/dab13d690b3849888906a6234d2b2207/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:57:45.999687 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b4303-48a0-4ec3-a1a8-2eec4df44cde None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:46.000308 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b4303-48a0-4ec3-a1a8-2eec4df44cde None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:46.000308 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b4303-48a0-4ec3-a1a8-2eec4df44cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:46.031628 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-2d6b4303-48a0-4ec3-a1a8-2eec4df44cde None None] MFA Rules not processed for user `dab13d690b3849888906a6234d2b2207`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:46.033128 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-2d6b4303-48a0-4ec3-a1a8-2eec4df44cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:46.096065 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1392/2775] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:57:46.108566 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390f18d-b6d6-441c-a977-d13f38b9ccfa admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:46.111246 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-e390f18d-b6d6-441c-a977-d13f38b9ccfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:46.167246 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390f18d-b6d6-441c-a977-d13f38b9ccfa admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:46.171577 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5aad3-74d0-49ae-ad65-285bd2038057 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15232a1930bc43e8bb5aa7310a709056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:46.172224 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5aad3-74d0-49ae-ad65-285bd2038057 service glance] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:46.172506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5aad3-74d0-49ae-ad65-285bd2038057 service glance] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:46.172780 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5aad3-74d0-49ae-ad65-285bd2038057 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:46.181427 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5aad3-74d0-49ae-ad65-285bd2038057 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:46.182868 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5aad3-74d0-49ae-ad65-285bd2038057 service glance] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:46.192034 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1384/2776] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:46 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:46.239161 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b4303-48a0-4ec3-a1a8-2eec4df44cde None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:46.241081 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-2d6b4303-48a0-4ec3-a1a8-2eec4df44cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:46.334895 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b4303-48a0-4ec3-a1a8-2eec4df44cde None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:46.340677 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910b9a3-b33f-4b42-9b85-a1445df05983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:46.342007 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910b9a3-b33f-4b42-9b85-a1445df05983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:46.342007 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910b9a3-b33f-4b42-9b85-a1445df05983 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:46.342423 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910b9a3-b33f-4b42-9b85-a1445df05983 admin admin] PATH_INFO: `/v3/projects/40691b398b29451588ca9114a14502b5` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:46.343732 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910b9a3-b33f-4b42-9b85-a1445df05983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40691b398b29451588ca9114a14502b5)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:46.346288 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910b9a3-b33f-4b42-9b85-a1445df05983 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:46.415545 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f910b9a3-b33f-4b42-9b85-a1445df05983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40691b398b29451588ca9114a14502b5', 'request_id': 'req-f910b9a3-b33f-4b42-9b85-a1445df05983'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:46.422362 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f910b9a3-b33f-4b42-9b85-a1445df05983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40691b398b29451588ca9114a14502b5', 'request_id': 'req-f910b9a3-b33f-4b42-9b85-a1445df05983'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:46.436616 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f910b9a3-b33f-4b42-9b85-a1445df05983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40691b398b29451588ca9114a14502b5', 'request_id': 'req-f910b9a3-b33f-4b42-9b85-a1445df05983'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:46.454873 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f910b9a3-b33f-4b42-9b85-a1445df05983 admin admin] The token cache is being invalidate because project 40691b398b29451588ca9114a14502b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:46.455350 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f910b9a3-b33f-4b42-9b85-a1445df05983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:46.456314 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f910b9a3-b33f-4b42-9b85-a1445df05983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:46.463607 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5aad3-74d0-49ae-ad65-285bd2038057 service glance] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:46.474248 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1393/2777] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:46 2022] DELETE /identity/v3/projects/40691b398b29451588ca9114a14502b5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:46.481870 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5aad3-74d0-49ae-ad65-285bd2038057 service glance] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:46.561726 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d6993-62b5-4508-b653-370363029e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:46.562737 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d6993-62b5-4508-b653-370363029e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:46.563405 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d6993-62b5-4508-b653-370363029e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:46.563837 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d6993-62b5-4508-b653-370363029e34 admin admin] PATH_INFO: `/v3/users/5ebb05a0549e47b5863da50734415245` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:46.566056 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d6993-62b5-4508-b653-370363029e34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ebb05a0549e47b5863da50734415245)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:46.568680 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d6993-62b5-4508-b653-370363029e34 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:46.631458 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-928d6993-62b5-4508-b653-370363029e34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ebb05a0549e47b5863da50734415245'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:46.645398 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-928d6993-62b5-4508-b653-370363029e34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ebb05a0549e47b5863da50734415245'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:46.656369 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-928d6993-62b5-4508-b653-370363029e34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ebb05a0549e47b5863da50734415245'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:46.671521 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-928d6993-62b5-4508-b653-370363029e34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ebb05a0549e47b5863da50734415245'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:46.672470 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-928d6993-62b5-4508-b653-370363029e34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ebb05a0549e47b5863da50734415245'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:46.683094 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1385/2778] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:46 2022] DELETE /identity/v3/users/5ebb05a0549e47b5863da50734415245 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:47.001318 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910b9a3-b33f-4b42-9b85-a1445df05983 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:47.004200 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f910b9a3-b33f-4b42-9b85-a1445df05983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:47.041631 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910b9a3-b33f-4b42-9b85-a1445df05983 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:47.111196 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d4a54-3fcd-41d4-8272-a5d7ee9176bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:47.112142 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d4a54-3fcd-41d4-8272-a5d7ee9176bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:47.112423 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d4a54-3fcd-41d4-8272-a5d7ee9176bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:47.112695 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d4a54-3fcd-41d4-8272-a5d7ee9176bb admin admin] PATH_INFO: `/v3/projects/f4df423829e7480091d211737c2a0468` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:47.114144 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d4a54-3fcd-41d4-8272-a5d7ee9176bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4df423829e7480091d211737c2a0468)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:47.116069 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d4a54-3fcd-41d4-8272-a5d7ee9176bb admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:47.167010 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-692d4a54-3fcd-41d4-8272-a5d7ee9176bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4df423829e7480091d211737c2a0468', 'request_id': 'req-692d4a54-3fcd-41d4-8272-a5d7ee9176bb'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:47.173536 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-692d4a54-3fcd-41d4-8272-a5d7ee9176bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4df423829e7480091d211737c2a0468', 'request_id': 'req-692d4a54-3fcd-41d4-8272-a5d7ee9176bb'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:47.182215 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-692d4a54-3fcd-41d4-8272-a5d7ee9176bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4df423829e7480091d211737c2a0468', 'request_id': 'req-692d4a54-3fcd-41d4-8272-a5d7ee9176bb'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:47.200814 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-692d4a54-3fcd-41d4-8272-a5d7ee9176bb admin admin] The token cache is being invalidate because project f4df423829e7480091d211737c2a0468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:47.201451 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-692d4a54-3fcd-41d4-8272-a5d7ee9176bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:47.203246 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-692d4a54-3fcd-41d4-8272-a5d7ee9176bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:47.205329 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1394/2779] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:46 2022] DELETE /identity/v3/projects/f4df423829e7480091d211737c2a0468 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:47.211152 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f89761-ad26-42ce-bae5-f7bfefa40295 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:47.211736 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f89761-ad26-42ce-bae5-f7bfefa40295 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:47.211736 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f89761-ad26-42ce-bae5-f7bfefa40295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:47.231428 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-26f89761-ad26-42ce-bae5-f7bfefa40295 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:47.232642 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-26f89761-ad26-42ce-bae5-f7bfefa40295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:47.312540 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1386/2780] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:47.320892 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79a537-bb6b-4de8-8ce4-c94d08a2df7d None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:47.321357 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79a537-bb6b-4de8-8ce4-c94d08a2df7d None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:47.321639 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79a537-bb6b-4de8-8ce4-c94d08a2df7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:47.352026 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-fd79a537-bb6b-4de8-8ce4-c94d08a2df7d None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:47.353609 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-fd79a537-bb6b-4de8-8ce4-c94d08a2df7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:47.365721 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1395/2781] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:47.371242 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f89761-ad26-42ce-bae5-f7bfefa40295 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:47.382003 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f89761-ad26-42ce-bae5-f7bfefa40295 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:47.387711 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a95e8-b9fa-4ee9-b86c-b10e6f06ffc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:47.388655 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a95e8-b9fa-4ee9-b86c-b10e6f06ffc7 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:47.388978 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a95e8-b9fa-4ee9-b86c-b10e6f06ffc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:47.389284 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a95e8-b9fa-4ee9-b86c-b10e6f06ffc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:47.390046 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a95e8-b9fa-4ee9-b86c-b10e6f06ffc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:57:47.390382 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a95e8-b9fa-4ee9-b86c-b10e6f06ffc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:47.392201 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a95e8-b9fa-4ee9-b86c-b10e6f06ffc7 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:47.420021 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1387/2782] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:57:47.421199 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79a537-bb6b-4de8-8ce4-c94d08a2df7d None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:47.431014 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79a537-bb6b-4de8-8ce4-c94d08a2df7d None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:47.437184 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d930f1c-a0af-46a0-97f1-ed078d0f632e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:47.437864 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d930f1c-a0af-46a0-97f1-ed078d0f632e admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:47.438151 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d930f1c-a0af-46a0-97f1-ed078d0f632e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:47.438420 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d930f1c-a0af-46a0-97f1-ed078d0f632e admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:47.439236 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d930f1c-a0af-46a0-97f1-ed078d0f632e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:47.441334 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d930f1c-a0af-46a0-97f1-ed078d0f632e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:47.474150 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1396/2783] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:57:47 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:47.478757 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a95e8-b9fa-4ee9-b86c-b10e6f06ffc7 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:47.490849 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a95e8-b9fa-4ee9-b86c-b10e6f06ffc7 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:47.570981 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e05135-a339-4449-b7c4-935817aa0977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:47.571790 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e05135-a339-4449-b7c4-935817aa0977 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:47.572059 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e05135-a339-4449-b7c4-935817aa0977 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:47.572418 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e05135-a339-4449-b7c4-935817aa0977 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:47.573157 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e05135-a339-4449-b7c4-935817aa0977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:47.575369 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e05135-a339-4449-b7c4-935817aa0977 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:47.601721 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1388/2784] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:57:47 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:47.605894 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d930f1c-a0af-46a0-97f1-ed078d0f632e admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:47.619797 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d930f1c-a0af-46a0-97f1-ed078d0f632e admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:47.625424 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecd801-d811-4247-bed6-f22a8741ef7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:47.626103 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecd801-d811-4247-bed6-f22a8741ef7c admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:47.626385 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecd801-d811-4247-bed6-f22a8741ef7c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:47.626659 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecd801-d811-4247-bed6-f22a8741ef7c admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:47.627508 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecd801-d811-4247-bed6-f22a8741ef7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:47.629329 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecd801-d811-4247-bed6-f22a8741ef7c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:47.640440 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1397/2785] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:47.644456 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e05135-a339-4449-b7c4-935817aa0977 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:47.656374 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e05135-a339-4449-b7c4-935817aa0977 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:47.661832 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608793e-3f60-4a59-9fc5-c8ff27e807c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:47.662524 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608793e-3f60-4a59-9fc5-c8ff27e807c7 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:47.662803 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608793e-3f60-4a59-9fc5-c8ff27e807c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:47.663076 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608793e-3f60-4a59-9fc5-c8ff27e807c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:47.663920 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608793e-3f60-4a59-9fc5-c8ff27e807c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:47.665586 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608793e-3f60-4a59-9fc5-c8ff27e807c7 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:47.679211 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1389/2786] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:47.680357 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecd801-d811-4247-bed6-f22a8741ef7c admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:47.690398 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecd801-d811-4247-bed6-f22a8741ef7c admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:47.695165 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575d780-8baf-478d-b6c6-3868194a216b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:47.696056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575d780-8baf-478d-b6c6-3868194a216b admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:47.696335 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575d780-8baf-478d-b6c6-3868194a216b admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:47.696606 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575d780-8baf-478d-b6c6-3868194a216b admin admin] PATH_INFO: `/v3/projects/140bb6d3591345d2893f00d4c1995b25/users/0491681aaa1e464db0d2626cd7b595bb/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:47.711036 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8575d780-8baf-478d-b6c6-3868194a216b admin admin] RBAC: Authorizing `identity:create_grant(project_id=140bb6d3591345d2893f00d4c1995b25, user_id=0491681aaa1e464db0d2626cd7b595bb, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:47.714155 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8575d780-8baf-478d-b6c6-3868194a216b admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:47.733304 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1398/2787] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:47 2022] PUT /identity/v3/projects/140bb6d3591345d2893f00d4c1995b25/users/0491681aaa1e464db0d2626cd7b595bb/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:47.741160 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ef375-b597-4234-82aa-5ae7e056cb8c None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:47.741976 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ef375-b597-4234-82aa-5ae7e056cb8c None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:47.741976 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ef375-b597-4234-82aa-5ae7e056cb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:47.787760 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-eb4ef375-b597-4234-82aa-5ae7e056cb8c None None] MFA Rules not processed for user `0491681aaa1e464db0d2626cd7b595bb`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:47.789472 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-eb4ef375-b597-4234-82aa-5ae7e056cb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:47.894677 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1390/2788] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:57:47.898649 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575d780-8baf-478d-b6c6-3868194a216b admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:48.003456 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575d780-8baf-478d-b6c6-3868194a216b admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:48.009844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d54da-2c0e-4e6f-8a97-6d5dd2f9f383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:48.010604 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d54da-2c0e-4e6f-8a97-6d5dd2f9f383 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:48.010932 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d54da-2c0e-4e6f-8a97-6d5dd2f9f383 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:48.013319 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d54da-2c0e-4e6f-8a97-6d5dd2f9f383 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:48.013319 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d54da-2c0e-4e6f-8a97-6d5dd2f9f383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:48.014202 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d54da-2c0e-4e6f-8a97-6d5dd2f9f383 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:48.048137 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1399/2789] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:57:47 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:48.052184 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ef375-b597-4234-82aa-5ae7e056cb8c None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:48.064719 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ef375-b597-4234-82aa-5ae7e056cb8c None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:48.147142 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739274b7-7957-404b-8e38-6c7fe2b597f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:48.148363 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739274b7-7957-404b-8e38-6c7fe2b597f3 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:48.148820 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739274b7-7957-404b-8e38-6c7fe2b597f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:48.149495 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739274b7-7957-404b-8e38-6c7fe2b597f3 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:48.150211 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739274b7-7957-404b-8e38-6c7fe2b597f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:48.152145 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739274b7-7957-404b-8e38-6c7fe2b597f3 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:48.180274 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1391/2790] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:57:48 2022] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:48.181496 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d54da-2c0e-4e6f-8a97-6d5dd2f9f383 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:48.192959 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d54da-2c0e-4e6f-8a97-6d5dd2f9f383 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:48.197917 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f6b33-e808-48aa-a9ed-df92f183804a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:48.198611 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f6b33-e808-48aa-a9ed-df92f183804a admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:48.199240 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f6b33-e808-48aa-a9ed-df92f183804a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:48.199750 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f6b33-e808-48aa-a9ed-df92f183804a admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:48.200729 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f6b33-e808-48aa-a9ed-df92f183804a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:48.202783 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f6b33-e808-48aa-a9ed-df92f183804a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:48.214570 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1400/2791] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:48.220531 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739274b7-7957-404b-8e38-6c7fe2b597f3 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:48.231567 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739274b7-7957-404b-8e38-6c7fe2b597f3 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:48.236208 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1e3d4-22d6-4e02-8d11-17c1fa600de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:48.237177 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1e3d4-22d6-4e02-8d11-17c1fa600de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:48.237455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1e3d4-22d6-4e02-8d11-17c1fa600de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:48.237725 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1e3d4-22d6-4e02-8d11-17c1fa600de0 admin admin] PATH_INFO: `/v3/projects/a6633a02e66c4630aa2b5bb820982e0f/users/82411e33cf814892840bda6eac11e3f6/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:48.252047 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1e3d4-22d6-4e02-8d11-17c1fa600de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6633a02e66c4630aa2b5bb820982e0f, user_id=82411e33cf814892840bda6eac11e3f6, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:48.254725 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1e3d4-22d6-4e02-8d11-17c1fa600de0 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:48.271190 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1392/2792] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:48 2022] PUT /identity/v3/projects/a6633a02e66c4630aa2b5bb820982e0f/users/82411e33cf814892840bda6eac11e3f6/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:57:48.276451 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f6b33-e808-48aa-a9ed-df92f183804a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:48.288648 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f6b33-e808-48aa-a9ed-df92f183804a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:48.343338 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a8601-23b6-4fba-8e0a-80d6ebe4b672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:48.344003 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a8601-23b6-4fba-8e0a-80d6ebe4b672 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:48.344294 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a8601-23b6-4fba-8e0a-80d6ebe4b672 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:48.344561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a8601-23b6-4fba-8e0a-80d6ebe4b672 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:48.345383 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a8601-23b6-4fba-8e0a-80d6ebe4b672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:48.346975 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a8601-23b6-4fba-8e0a-80d6ebe4b672 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:48.361876 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1401/2793] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:48.366287 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1e3d4-22d6-4e02-8d11-17c1fa600de0 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:48.378273 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1e3d4-22d6-4e02-8d11-17c1fa600de0 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:48.383592 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa570ca-da42-467f-88d9-4049d24cae8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:48.384494 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa570ca-da42-467f-88d9-4049d24cae8d admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:48.384782 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa570ca-da42-467f-88d9-4049d24cae8d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:48.385112 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa570ca-da42-467f-88d9-4049d24cae8d admin admin] PATH_INFO: `/v3/projects/a6633a02e66c4630aa2b5bb820982e0f/users/82411e33cf814892840bda6eac11e3f6/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:48.387132 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa570ca-da42-467f-88d9-4049d24cae8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6633a02e66c4630aa2b5bb820982e0f, user_id=82411e33cf814892840bda6eac11e3f6, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:48.390340 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa570ca-da42-467f-88d9-4049d24cae8d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:48.402948 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1393/2794] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:48 2022] PUT /identity/v3/projects/a6633a02e66c4630aa2b5bb820982e0f/users/82411e33cf814892840bda6eac11e3f6/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:48.413081 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b61d6-1024-4353-ac81-0f809c30a8e7 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:48.413597 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b61d6-1024-4353-ac81-0f809c30a8e7 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:48.414490 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b61d6-1024-4353-ac81-0f809c30a8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:48.446164 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-3f2b61d6-1024-4353-ac81-0f809c30a8e7 None None] MFA Rules not processed for user `82411e33cf814892840bda6eac11e3f6`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:48.447779 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-3f2b61d6-1024-4353-ac81-0f809c30a8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:48.534767 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1402/2795] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:48.541126 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa570ca-da42-467f-88d9-4049d24cae8d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:48.543953 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-cfa570ca-da42-467f-88d9-4049d24cae8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:48.598881 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa570ca-da42-467f-88d9-4049d24cae8d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:48.602539 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2516ef7-fd6e-4a6f-a819-7a7ee3f70003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:48.603187 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2516ef7-fd6e-4a6f-a819-7a7ee3f70003 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:48.603469 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2516ef7-fd6e-4a6f-a819-7a7ee3f70003 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:48.603745 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2516ef7-fd6e-4a6f-a819-7a7ee3f70003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:48.613556 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2516ef7-fd6e-4a6f-a819-7a7ee3f70003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:48.615237 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2516ef7-fd6e-4a6f-a819-7a7ee3f70003 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:48.626776 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1394/2796] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:48.697439 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b61d6-1024-4353-ac81-0f809c30a8e7 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:48.710305 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b61d6-1024-4353-ac81-0f809c30a8e7 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:48.715531 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cfcfa-2618-433f-acee-292665dc0bae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:48.716210 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cfcfa-2618-433f-acee-292665dc0bae service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:48.716491 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cfcfa-2618-433f-acee-292665dc0bae service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:48.716765 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cfcfa-2618-433f-acee-292665dc0bae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:48.775349 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cfcfa-2618-433f-acee-292665dc0bae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:48.777104 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cfcfa-2618-433f-acee-292665dc0bae service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:48.788460 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1403/2797] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:49.057956 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2516ef7-fd6e-4a6f-a819-7a7ee3f70003 service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:49.133486 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2516ef7-fd6e-4a6f-a819-7a7ee3f70003 service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:49.138957 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183e5c0-013f-4462-8529-73454e4bf159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:49.139850 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183e5c0-013f-4462-8529-73454e4bf159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:49.140128 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183e5c0-013f-4462-8529-73454e4bf159 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:49.140580 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183e5c0-013f-4462-8529-73454e4bf159 admin admin] PATH_INFO: `/v3/users/0491681aaa1e464db0d2626cd7b595bb` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:49.142242 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183e5c0-013f-4462-8529-73454e4bf159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0491681aaa1e464db0d2626cd7b595bb)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:49.144342 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183e5c0-013f-4462-8529-73454e4bf159 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:49.198955 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-5183e5c0-013f-4462-8529-73454e4bf159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0491681aaa1e464db0d2626cd7b595bb'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:49.211856 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-5183e5c0-013f-4462-8529-73454e4bf159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0491681aaa1e464db0d2626cd7b595bb'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:49.218679 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-5183e5c0-013f-4462-8529-73454e4bf159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0491681aaa1e464db0d2626cd7b595bb'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:49.228859 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-5183e5c0-013f-4462-8529-73454e4bf159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0491681aaa1e464db0d2626cd7b595bb'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:49.230301 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-5183e5c0-013f-4462-8529-73454e4bf159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0491681aaa1e464db0d2626cd7b595bb'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:49.238175 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1395/2798] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:49 2022] DELETE /identity/v3/users/0491681aaa1e464db0d2626cd7b595bb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:49.243096 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edecc8c-3e86-4c64-ae52-6fd436f6d2cf None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:49.243638 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edecc8c-3e86-4c64-ae52-6fd436f6d2cf None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:49.244482 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edecc8c-3e86-4c64-ae52-6fd436f6d2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:49.265714 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-2edecc8c-3e86-4c64-ae52-6fd436f6d2cf None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:49.267859 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-2edecc8c-3e86-4c64-ae52-6fd436f6d2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:49.339669 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1404/2799] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:49.350995 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183e5c0-013f-4462-8529-73454e4bf159 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:49.352423 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-5183e5c0-013f-4462-8529-73454e4bf159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:49.417045 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183e5c0-013f-4462-8529-73454e4bf159 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:49.421200 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b66482-d4ec-49ea-a23d-de8984818207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:49.421859 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b66482-d4ec-49ea-a23d-de8984818207 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:49.422136 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b66482-d4ec-49ea-a23d-de8984818207 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:49.422405 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b66482-d4ec-49ea-a23d-de8984818207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:49.432217 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b66482-d4ec-49ea-a23d-de8984818207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:49.433695 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b66482-d4ec-49ea-a23d-de8984818207 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:49.443353 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1396/2800] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:50.026601 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edecc8c-3e86-4c64-ae52-6fd436f6d2cf None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:50.028170 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-2edecc8c-3e86-4c64-ae52-6fd436f6d2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:50.050299 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edecc8c-3e86-4c64-ae52-6fd436f6d2cf None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:50.058578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbf244-9ab3-4f1c-bed0-507c3cdf822c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:50.059675 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbf244-9ab3-4f1c-bed0-507c3cdf822c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:50.060016 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbf244-9ab3-4f1c-bed0-507c3cdf822c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:50.060409 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbf244-9ab3-4f1c-bed0-507c3cdf822c admin admin] PATH_INFO: `/v3/projects/140bb6d3591345d2893f00d4c1995b25` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:50.061799 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbf244-9ab3-4f1c-bed0-507c3cdf822c admin admin] RBAC: Authorizing `identity:delete_project(project_id=140bb6d3591345d2893f00d4c1995b25)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:50.064780 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbf244-9ab3-4f1c-bed0-507c3cdf822c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:50.123589 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8fdbf244-9ab3-4f1c-bed0-507c3cdf822c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '140bb6d3591345d2893f00d4c1995b25', 'request_id': 'req-8fdbf244-9ab3-4f1c-bed0-507c3cdf822c'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:50.129094 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8fdbf244-9ab3-4f1c-bed0-507c3cdf822c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '140bb6d3591345d2893f00d4c1995b25', 'request_id': 'req-8fdbf244-9ab3-4f1c-bed0-507c3cdf822c'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:50.139483 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8fdbf244-9ab3-4f1c-bed0-507c3cdf822c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '140bb6d3591345d2893f00d4c1995b25', 'request_id': 'req-8fdbf244-9ab3-4f1c-bed0-507c3cdf822c'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:50.152715 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8fdbf244-9ab3-4f1c-bed0-507c3cdf822c admin admin] The token cache is being invalidate because project 140bb6d3591345d2893f00d4c1995b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:50.153036 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8fdbf244-9ab3-4f1c-bed0-507c3cdf822c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:50.153693 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-8fdbf244-9ab3-4f1c-bed0-507c3cdf822c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:50.155556 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1405/2801] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:50 2022] DELETE /identity/v3/projects/140bb6d3591345d2893f00d4c1995b25 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:50.159517 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b66482-d4ec-49ea-a23d-de8984818207 service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:50.169530 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b66482-d4ec-49ea-a23d-de8984818207 service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:50.236717 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878e746-32f6-4886-8245-02acfc8ec166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:50.237641 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878e746-32f6-4886-8245-02acfc8ec166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:50.237991 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878e746-32f6-4886-8245-02acfc8ec166 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:50.238327 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878e746-32f6-4886-8245-02acfc8ec166 admin admin] PATH_INFO: `/v3/users/82411e33cf814892840bda6eac11e3f6` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:50.239662 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878e746-32f6-4886-8245-02acfc8ec166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82411e33cf814892840bda6eac11e3f6)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:50.242360 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878e746-32f6-4886-8245-02acfc8ec166 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:50.306789 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d878e746-32f6-4886-8245-02acfc8ec166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82411e33cf814892840bda6eac11e3f6'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:50.324373 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d878e746-32f6-4886-8245-02acfc8ec166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82411e33cf814892840bda6eac11e3f6'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:50.331225 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d878e746-32f6-4886-8245-02acfc8ec166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82411e33cf814892840bda6eac11e3f6'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:50.341106 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d878e746-32f6-4886-8245-02acfc8ec166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82411e33cf814892840bda6eac11e3f6'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:50.341746 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-d878e746-32f6-4886-8245-02acfc8ec166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82411e33cf814892840bda6eac11e3f6'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:50.355850 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1397/2802] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:50 2022] DELETE /identity/v3/users/82411e33cf814892840bda6eac11e3f6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:50.647224 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbf244-9ab3-4f1c-bed0-507c3cdf822c admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:50.649850 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-8fdbf244-9ab3-4f1c-bed0-507c3cdf822c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:50.672365 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbf244-9ab3-4f1c-bed0-507c3cdf822c admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:50.764665 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a05965-2ff3-49c3-b0a6-7127f4eae8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:50.765726 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a05965-2ff3-49c3-b0a6-7127f4eae8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:50.766070 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a05965-2ff3-49c3-b0a6-7127f4eae8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:50.766406 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a05965-2ff3-49c3-b0a6-7127f4eae8e7 admin admin] PATH_INFO: `/v3/projects/a6633a02e66c4630aa2b5bb820982e0f` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:50.768190 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a05965-2ff3-49c3-b0a6-7127f4eae8e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6633a02e66c4630aa2b5bb820982e0f)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:50.770317 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a05965-2ff3-49c3-b0a6-7127f4eae8e7 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:50.828931 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b9a05965-2ff3-49c3-b0a6-7127f4eae8e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6633a02e66c4630aa2b5bb820982e0f', 'request_id': 'req-b9a05965-2ff3-49c3-b0a6-7127f4eae8e7'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:50.834452 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b9a05965-2ff3-49c3-b0a6-7127f4eae8e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6633a02e66c4630aa2b5bb820982e0f', 'request_id': 'req-b9a05965-2ff3-49c3-b0a6-7127f4eae8e7'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:50.843662 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b9a05965-2ff3-49c3-b0a6-7127f4eae8e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6633a02e66c4630aa2b5bb820982e0f', 'request_id': 'req-b9a05965-2ff3-49c3-b0a6-7127f4eae8e7'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:50.855894 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b9a05965-2ff3-49c3-b0a6-7127f4eae8e7 admin admin] The token cache is being invalidate because project a6633a02e66c4630aa2b5bb820982e0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:50.856467 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b9a05965-2ff3-49c3-b0a6-7127f4eae8e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:50.857543 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-b9a05965-2ff3-49c3-b0a6-7127f4eae8e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:50.859334 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1406/2803] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:50 2022] DELETE /identity/v3/projects/a6633a02e66c4630aa2b5bb820982e0f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:50.865414 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490fdef-0a4d-4ccc-bbf5-fbac939e8eb6 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:50.865706 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490fdef-0a4d-4ccc-bbf5-fbac939e8eb6 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:50.865985 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490fdef-0a4d-4ccc-bbf5-fbac939e8eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:51.016976 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b490fdef-0a4d-4ccc-bbf5-fbac939e8eb6 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:51.018124 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b490fdef-0a4d-4ccc-bbf5-fbac939e8eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:51.097294 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1398/2804] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:51.105143 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47407b3-93c2-466a-a913-514c5d886f63 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:51.105770 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47407b3-93c2-466a-a913-514c5d886f63 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:51.106639 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47407b3-93c2-466a-a913-514c5d886f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:51.130292 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-c47407b3-93c2-466a-a913-514c5d886f63 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:51.131872 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-c47407b3-93c2-466a-a913-514c5d886f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:51.144676 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1407/2805] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:51.148843 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490fdef-0a4d-4ccc-bbf5-fbac939e8eb6 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:51.161445 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490fdef-0a4d-4ccc-bbf5-fbac939e8eb6 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:51.166675 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872974c-47e3-4082-b66c-2d50293e7f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:51.167371 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872974c-47e3-4082-b66c-2d50293e7f85 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:51.167651 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872974c-47e3-4082-b66c-2d50293e7f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:51.167950 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872974c-47e3-4082-b66c-2d50293e7f85 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:51.168722 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872974c-47e3-4082-b66c-2d50293e7f85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:57:51.169064 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872974c-47e3-4082-b66c-2d50293e7f85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:51.170667 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872974c-47e3-4082-b66c-2d50293e7f85 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:51.184264 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1399/2806] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:57:51.189517 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47407b3-93c2-466a-a913-514c5d886f63 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:51.198738 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47407b3-93c2-466a-a913-514c5d886f63 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:51.203433 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c78cc-9f8e-452f-b1ba-9756bb10eeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:51.204957 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c78cc-9f8e-452f-b1ba-9756bb10eeb9 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:51.205250 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c78cc-9f8e-452f-b1ba-9756bb10eeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:51.205590 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c78cc-9f8e-452f-b1ba-9756bb10eeb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:51.206335 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c78cc-9f8e-452f-b1ba-9756bb10eeb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:51.208274 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c78cc-9f8e-452f-b1ba-9756bb10eeb9 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:51.247268 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1408/2807] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:57:51 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:57:51.248625 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872974c-47e3-4082-b66c-2d50293e7f85 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:51.262241 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872974c-47e3-4082-b66c-2d50293e7f85 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:51.342841 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ca46a-64e5-4158-8f40-4fd56b1408d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:51.347500 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ca46a-64e5-4158-8f40-4fd56b1408d7 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:51.347895 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ca46a-64e5-4158-8f40-4fd56b1408d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:51.348221 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ca46a-64e5-4158-8f40-4fd56b1408d7 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:51.349052 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ca46a-64e5-4158-8f40-4fd56b1408d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:51.351094 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ca46a-64e5-4158-8f40-4fd56b1408d7 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:51.377472 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1400/2808] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:57:51 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:51.381534 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c78cc-9f8e-452f-b1ba-9756bb10eeb9 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:51.391844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c78cc-9f8e-452f-b1ba-9756bb10eeb9 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:51.396829 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30069dc-8803-4f05-b914-cc18b896300f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:51.397529 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30069dc-8803-4f05-b914-cc18b896300f admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:51.397820 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30069dc-8803-4f05-b914-cc18b896300f admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:51.398097 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30069dc-8803-4f05-b914-cc18b896300f admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:51.399017 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30069dc-8803-4f05-b914-cc18b896300f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:51.401090 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30069dc-8803-4f05-b914-cc18b896300f admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:51.425015 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1409/2809] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:57:51.428754 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ca46a-64e5-4158-8f40-4fd56b1408d7 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:51.440097 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ca46a-64e5-4158-8f40-4fd56b1408d7 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:51.444919 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2f287-8e14-415d-bba8-f9bf7b1d5368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:51.445861 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2f287-8e14-415d-bba8-f9bf7b1d5368 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:51.446311 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2f287-8e14-415d-bba8-f9bf7b1d5368 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:51.446764 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2f287-8e14-415d-bba8-f9bf7b1d5368 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:51.447880 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2f287-8e14-415d-bba8-f9bf7b1d5368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:51.450075 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2f287-8e14-415d-bba8-f9bf7b1d5368 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:51.465648 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1401/2810] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:51.466502 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30069dc-8803-4f05-b914-cc18b896300f admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:51.479465 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30069dc-8803-4f05-b914-cc18b896300f admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:51.484759 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c85fb-8128-426d-a4f2-6a9cdcb891e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:51.485788 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c85fb-8128-426d-a4f2-6a9cdcb891e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:51.486071 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c85fb-8128-426d-a4f2-6a9cdcb891e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:51.486356 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c85fb-8128-426d-a4f2-6a9cdcb891e1 admin admin] PATH_INFO: `/v3/projects/88782deb60d649168dc423aa8eab0351/users/91aa41e73cf6491fb4637c2041a5cc43/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:51.502969 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c85fb-8128-426d-a4f2-6a9cdcb891e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88782deb60d649168dc423aa8eab0351, user_id=91aa41e73cf6491fb4637c2041a5cc43, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:51.505904 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c85fb-8128-426d-a4f2-6a9cdcb891e1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:51.523844 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1410/2811] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:51 2022] PUT /identity/v3/projects/88782deb60d649168dc423aa8eab0351/users/91aa41e73cf6491fb4637c2041a5cc43/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:51.536374 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3a06f-0266-421a-a258-7eae7fc7b564 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:51.536374 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3a06f-0266-421a-a258-7eae7fc7b564 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:51.536593 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3a06f-0266-421a-a258-7eae7fc7b564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:51.565395 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-33f3a06f-0266-421a-a258-7eae7fc7b564 None None] MFA Rules not processed for user `91aa41e73cf6491fb4637c2041a5cc43`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:51.567029 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-33f3a06f-0266-421a-a258-7eae7fc7b564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:51.669670 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1402/2812] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:51.677217 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c85fb-8128-426d-a4f2-6a9cdcb891e1 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:51.747626 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c85fb-8128-426d-a4f2-6a9cdcb891e1 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:51.752802 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb16fa-b0ca-43d9-8c53-ea67df042572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:51.753484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb16fa-b0ca-43d9-8c53-ea67df042572 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:51.753758 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb16fa-b0ca-43d9-8c53-ea67df042572 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:51.754028 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb16fa-b0ca-43d9-8c53-ea67df042572 admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:51.754732 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb16fa-b0ca-43d9-8c53-ea67df042572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:51.756630 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb16fa-b0ca-43d9-8c53-ea67df042572 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:51.785739 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1411/2813] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:57:51 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:57:51.787572 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3a06f-0266-421a-a258-7eae7fc7b564 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:51.798718 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3a06f-0266-421a-a258-7eae7fc7b564 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:51.836459 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb16fa-b0ca-43d9-8c53-ea67df042572 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:51.839459 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a3bb16fa-b0ca-43d9-8c53-ea67df042572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:51.865751 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a279595-ce1a-426c-8337-7249a1b80746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:51.866483 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a279595-ce1a-426c-8337-7249a1b80746 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:51.866768 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a279595-ce1a-426c-8337-7249a1b80746 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:51.867391 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a279595-ce1a-426c-8337-7249a1b80746 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:51.868185 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a279595-ce1a-426c-8337-7249a1b80746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:51.870146 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a279595-ce1a-426c-8337-7249a1b80746 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:51.893291 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1403/2814] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:57:51 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:57:51.897630 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a279595-ce1a-426c-8337-7249a1b80746 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:51.905899 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb16fa-b0ca-43d9-8c53-ea67df042572 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:51.907561 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a279595-ce1a-426c-8337-7249a1b80746 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:51.911467 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8466b8-7be0-4c2c-b87e-a897311446de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:51.912490 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8466b8-7be0-4c2c-b87e-a897311446de admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:51.912605 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40bf38-890a-4072-b5ca-e983af0ecad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:51.912765 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8466b8-7be0-4c2c-b87e-a897311446de admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:51.913223 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40bf38-890a-4072-b5ca-e983af0ecad6 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:51.913504 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40bf38-890a-4072-b5ca-e983af0ecad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:51.913904 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40bf38-890a-4072-b5ca-e983af0ecad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:51.914079 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8466b8-7be0-4c2c-b87e-a897311446de admin admin] PATH_INFO: `/v3/users/4636015d590c40fca1f4c9996a871b57` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:51.914606 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40bf38-890a-4072-b5ca-e983af0ecad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:51.915331 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8466b8-7be0-4c2c-b87e-a897311446de admin admin] RBAC: Authorizing `identity:delete_user(user_id=4636015d590c40fca1f4c9996a871b57)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:51.916371 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40bf38-890a-4072-b5ca-e983af0ecad6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:51.917520 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8466b8-7be0-4c2c-b87e-a897311446de admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:51.927129 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1404/2815] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 17:57:51.931195 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40bf38-890a-4072-b5ca-e983af0ecad6 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:51.940634 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40bf38-890a-4072-b5ca-e983af0ecad6 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:51.945502 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b1c15-4e65-4da9-aafc-15f09a9d6dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:51.946373 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b1c15-4e65-4da9-aafc-15f09a9d6dae admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:51.946653 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b1c15-4e65-4da9-aafc-15f09a9d6dae admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:51.946929 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b1c15-4e65-4da9-aafc-15f09a9d6dae admin admin] PATH_INFO: `/v3/projects/3c12115a3f354ebd8fff82672318f73c/users/c4221c98c313497c8f34139841e7829a/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:51.961443 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b1c15-4e65-4da9-aafc-15f09a9d6dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c12115a3f354ebd8fff82672318f73c, user_id=c4221c98c313497c8f34139841e7829a, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:51.963918 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-9f8466b8-7be0-4c2c-b87e-a897311446de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4636015d590c40fca1f4c9996a871b57'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:51.964213 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b1c15-4e65-4da9-aafc-15f09a9d6dae admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:51.964683 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-9f8466b8-7be0-4c2c-b87e-a897311446de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4636015d590c40fca1f4c9996a871b57'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:51.965397 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-9f8466b8-7be0-4c2c-b87e-a897311446de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4636015d590c40fca1f4c9996a871b57'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:51.977590 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-9f8466b8-7be0-4c2c-b87e-a897311446de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4636015d590c40fca1f4c9996a871b57'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:51.978831 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1405/2816] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:51 2022] PUT /identity/v3/projects/3c12115a3f354ebd8fff82672318f73c/users/c4221c98c313497c8f34139841e7829a/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:57:51.983838 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b1c15-4e65-4da9-aafc-15f09a9d6dae admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:51.984788 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-9f8466b8-7be0-4c2c-b87e-a897311446de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4636015d590c40fca1f4c9996a871b57'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:51.985675 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-984b1c15-4e65-4da9-aafc-15f09a9d6dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:52.000273 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1412/2817] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:51 2022] DELETE /identity/v3/users/4636015d590c40fca1f4c9996a871b57 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:52.053784 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b1c15-4e65-4da9-aafc-15f09a9d6dae admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:52.113499 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f6947-44c3-442b-acd7-462e947b611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:52.114183 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f6947-44c3-442b-acd7-462e947b611d admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:52.114460 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f6947-44c3-442b-acd7-462e947b611d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:52.114730 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f6947-44c3-442b-acd7-462e947b611d admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:52.115478 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f6947-44c3-442b-acd7-462e947b611d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:52.117076 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f6947-44c3-442b-acd7-462e947b611d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:52.127711 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1406/2818] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:57:52.131771 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8466b8-7be0-4c2c-b87e-a897311446de admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:52.141909 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8466b8-7be0-4c2c-b87e-a897311446de admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:52.146491 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd315e-a72b-4a89-91d0-0af33611de05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:52.147383 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd315e-a72b-4a89-91d0-0af33611de05 admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:52.147659 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd315e-a72b-4a89-91d0-0af33611de05 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:52.147931 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd315e-a72b-4a89-91d0-0af33611de05 admin admin] PATH_INFO: `/v3/projects/3c12115a3f354ebd8fff82672318f73c/users/c4221c98c313497c8f34139841e7829a/roles/3c05bedf79e04eb38d2ae66736030bfe` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:52.150265 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd315e-a72b-4a89-91d0-0af33611de05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c12115a3f354ebd8fff82672318f73c, user_id=c4221c98c313497c8f34139841e7829a, role_id=3c05bedf79e04eb38d2ae66736030bfe)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:52.152907 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd315e-a72b-4a89-91d0-0af33611de05 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:52.164654 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1413/2819] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:57:52 2022] PUT /identity/v3/projects/3c12115a3f354ebd8fff82672318f73c/users/c4221c98c313497c8f34139841e7829a/roles/3c05bedf79e04eb38d2ae66736030bfe => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:57:52.175966 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676f41a-8e7a-43ab-ba92-6a70d42bc061 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:52.176283 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676f41a-8e7a-43ab-ba92-6a70d42bc061 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:52.176563 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676f41a-8e7a-43ab-ba92-6a70d42bc061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:52.182062 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd315e-a72b-4a89-91d0-0af33611de05 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:52.183738 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-8efd315e-a72b-4a89-91d0-0af33611de05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:52.203814 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-c676f41a-8e7a-43ab-ba92-6a70d42bc061 None None] MFA Rules not processed for user `c4221c98c313497c8f34139841e7829a`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:57:52.205115 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-c676f41a-8e7a-43ab-ba92-6a70d42bc061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:52.249794 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd315e-a72b-4a89-91d0-0af33611de05 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:52.255671 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f71f94-1b4f-4f3d-a41e-31967676d4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:52.259595 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f71f94-1b4f-4f3d-a41e-31967676d4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:52.259595 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f71f94-1b4f-4f3d-a41e-31967676d4af admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:52.259595 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f71f94-1b4f-4f3d-a41e-31967676d4af admin admin] PATH_INFO: `/v3/projects/ad60695fc58746f490b20a5b2459b6ae` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:52.260966 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f71f94-1b4f-4f3d-a41e-31967676d4af admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad60695fc58746f490b20a5b2459b6ae)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:52.264276 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f71f94-1b4f-4f3d-a41e-31967676d4af admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:52.280535 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1407/2820] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:57:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:57:52.289923 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676f41a-8e7a-43ab-ba92-6a70d42bc061 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:52.291476 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-c676f41a-8e7a-43ab-ba92-6a70d42bc061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:52.315474 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f2f71f94-1b4f-4f3d-a41e-31967676d4af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad60695fc58746f490b20a5b2459b6ae', 'request_id': 'req-f2f71f94-1b4f-4f3d-a41e-31967676d4af'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:52.320617 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f2f71f94-1b4f-4f3d-a41e-31967676d4af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad60695fc58746f490b20a5b2459b6ae', 'request_id': 'req-f2f71f94-1b4f-4f3d-a41e-31967676d4af'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:52.330961 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f2f71f94-1b4f-4f3d-a41e-31967676d4af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad60695fc58746f490b20a5b2459b6ae', 'request_id': 'req-f2f71f94-1b4f-4f3d-a41e-31967676d4af'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:52.342286 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f2f71f94-1b4f-4f3d-a41e-31967676d4af admin admin] The token cache is being invalidate because project ad60695fc58746f490b20a5b2459b6ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:52.342732 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f2f71f94-1b4f-4f3d-a41e-31967676d4af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:52.343249 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-f2f71f94-1b4f-4f3d-a41e-31967676d4af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:52.344899 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1414/2821] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:52 2022] DELETE /identity/v3/projects/ad60695fc58746f490b20a5b2459b6ae => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:57:52.350057 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f71f94-1b4f-4f3d-a41e-31967676d4af admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:52.351357 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f2f71f94-1b4f-4f3d-a41e-31967676d4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:52.353677 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676f41a-8e7a-43ab-ba92-6a70d42bc061 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:52.401957 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933e792-6996-4752-bf13-3dbf3f48c870 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:52.402581 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933e792-6996-4752-bf13-3dbf3f48c870 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:52.402898 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933e792-6996-4752-bf13-3dbf3f48c870 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:52.403133 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933e792-6996-4752-bf13-3dbf3f48c870 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:52.405031 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-d933e792-6996-4752-bf13-3dbf3f48c870 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:52.414750 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f71f94-1b4f-4f3d-a41e-31967676d4af admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:52.423847 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4e92b-3fa1-4055-8797-f60f3dec33d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:52.424941 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4e92b-3fa1-4055-8797-f60f3dec33d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:52.425210 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4e92b-3fa1-4055-8797-f60f3dec33d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:52.431474 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4e92b-3fa1-4055-8797-f60f3dec33d1 admin admin] PATH_INFO: `/v3/users/ebf206ebb2a74e46912f1cf3d17e66b9` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:52.432368 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4e92b-3fa1-4055-8797-f60f3dec33d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf206ebb2a74e46912f1cf3d17e66b9)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:52.434499 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4e92b-3fa1-4055-8797-f60f3dec33d1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:52.471254 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933e792-6996-4752-bf13-3dbf3f48c870 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:52.473293 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933e792-6996-4752-bf13-3dbf3f48c870 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:52.483079 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1408/2822] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:57:52.486750 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a7f4e92b-3fa1-4055-8797-f60f3dec33d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf206ebb2a74e46912f1cf3d17e66b9'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:52.487496 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a7f4e92b-3fa1-4055-8797-f60f3dec33d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf206ebb2a74e46912f1cf3d17e66b9'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:52.488839 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a7f4e92b-3fa1-4055-8797-f60f3dec33d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf206ebb2a74e46912f1cf3d17e66b9'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:52.500658 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a7f4e92b-3fa1-4055-8797-f60f3dec33d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf206ebb2a74e46912f1cf3d17e66b9'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:52.507963 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-a7f4e92b-3fa1-4055-8797-f60f3dec33d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf206ebb2a74e46912f1cf3d17e66b9'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:52.527101 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1415/2823] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:57:52 2022] DELETE /identity/v3/users/ebf206ebb2a74e46912f1cf3d17e66b9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:52.706074 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933e792-6996-4752-bf13-3dbf3f48c870 service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:52.719037 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933e792-6996-4752-bf13-3dbf3f48c870 service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:52.783772 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2ddf0-fb1f-4320-8745-90670a04ceee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:52.784639 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ddf0-fb1f-4320-8745-90670a04ceee admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:52.784956 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ddf0-fb1f-4320-8745-90670a04ceee admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:52.785231 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ddf0-fb1f-4320-8745-90670a04ceee admin admin] PATH_INFO: `/v3/projects/0f01566868b6441cb0d828035ccc4613` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:52.786400 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2ddf0-fb1f-4320-8745-90670a04ceee admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f01566868b6441cb0d828035ccc4613)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:52.788292 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2ddf0-fb1f-4320-8745-90670a04ceee admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:52.846517 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-cfe2ddf0-fb1f-4320-8745-90670a04ceee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f01566868b6441cb0d828035ccc4613', 'request_id': 'req-cfe2ddf0-fb1f-4320-8745-90670a04ceee'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:52.858603 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-cfe2ddf0-fb1f-4320-8745-90670a04ceee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f01566868b6441cb0d828035ccc4613', 'request_id': 'req-cfe2ddf0-fb1f-4320-8745-90670a04ceee'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:52.869735 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-cfe2ddf0-fb1f-4320-8745-90670a04ceee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f01566868b6441cb0d828035ccc4613', 'request_id': 'req-cfe2ddf0-fb1f-4320-8745-90670a04ceee'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:52.880119 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-cfe2ddf0-fb1f-4320-8745-90670a04ceee admin admin] The token cache is being invalidate because project 0f01566868b6441cb0d828035ccc4613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:57:52.880483 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-cfe2ddf0-fb1f-4320-8745-90670a04ceee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:52.881306 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-cfe2ddf0-fb1f-4320-8745-90670a04ceee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:57:52.883045 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1409/2824] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:57:52 2022] DELETE /identity/v3/projects/0f01566868b6441cb0d828035ccc4613 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:57:56.681066 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4e92b-3fa1-4055-8797-f60f3dec33d1 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:57:56.682546 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a7f4e92b-3fa1-4055-8797-f60f3dec33d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:56.743484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4e92b-3fa1-4055-8797-f60f3dec33d1 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:57:56.795366 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bf705-033c-4163-8fe8-abc65875468b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:57:56.796035 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bf705-033c-4163-8fe8-abc65875468b service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:57:56.796321 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bf705-033c-4163-8fe8-abc65875468b service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:57:56.796601 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bf705-033c-4163-8fe8-abc65875468b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:57:56.798814 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-6f2bf705-033c-4163-8fe8-abc65875468b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:57:56.863418 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bf705-033c-4163-8fe8-abc65875468b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:57:56.864835 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bf705-033c-4163-8fe8-abc65875468b service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:57:56.874723 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1416/2825] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:57:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:58:01.724103 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2ddf0-fb1f-4320-8745-90670a04ceee admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:01.725879 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-cfe2ddf0-fb1f-4320-8745-90670a04ceee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:01.791872 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2ddf0-fb1f-4320-8745-90670a04ceee admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:01.797295 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a04b5-d380-491a-a1b5-6800e0310d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:01.798178 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a04b5-d380-491a-a1b5-6800e0310d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:01.798455 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a04b5-d380-491a-a1b5-6800e0310d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:01.798723 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a04b5-d380-491a-a1b5-6800e0310d9d admin admin] PATH_INFO: `/v3/users/91aa41e73cf6491fb4637c2041a5cc43` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:01.800009 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a04b5-d380-491a-a1b5-6800e0310d9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=91aa41e73cf6491fb4637c2041a5cc43)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:01.802598 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a04b5-d380-491a-a1b5-6800e0310d9d admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:01.850357 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-980a04b5-d380-491a-a1b5-6800e0310d9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91aa41e73cf6491fb4637c2041a5cc43'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:01.862965 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-980a04b5-d380-491a-a1b5-6800e0310d9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91aa41e73cf6491fb4637c2041a5cc43'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:01.870407 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-980a04b5-d380-491a-a1b5-6800e0310d9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91aa41e73cf6491fb4637c2041a5cc43'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:01.878727 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-980a04b5-d380-491a-a1b5-6800e0310d9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91aa41e73cf6491fb4637c2041a5cc43'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:01.879483 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-980a04b5-d380-491a-a1b5-6800e0310d9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91aa41e73cf6491fb4637c2041a5cc43'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:01.886465 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1410/2826] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:58:01 2022] DELETE /identity/v3/users/91aa41e73cf6491fb4637c2041a5cc43 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:58:01.890999 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1479a-dc61-4569-971f-9f1df94b573b None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:01.891496 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1479a-dc61-4569-971f-9f1df94b573b None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:01.891496 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1479a-dc61-4569-971f-9f1df94b573b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:01.909149 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-c3b1479a-dc61-4569-971f-9f1df94b573b None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:58:01.910294 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-c3b1479a-dc61-4569-971f-9f1df94b573b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:01.967463 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1417/2827] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:58:01.977845 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a04b5-d380-491a-a1b5-6800e0310d9d admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:01.979269 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-980a04b5-d380-491a-a1b5-6800e0310d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:02.047239 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a04b5-d380-491a-a1b5-6800e0310d9d admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:02.053057 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5aec70-fd5d-4ac6-8a9b-dd53cf2414a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:02.053723 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5aec70-fd5d-4ac6-8a9b-dd53cf2414a8 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:02.053996 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5aec70-fd5d-4ac6-8a9b-dd53cf2414a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:02.054269 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5aec70-fd5d-4ac6-8a9b-dd53cf2414a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:02.063594 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5aec70-fd5d-4ac6-8a9b-dd53cf2414a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:02.065062 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5aec70-fd5d-4ac6-8a9b-dd53cf2414a8 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:02.074414 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1411/2828] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:58:02.351729 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1479a-dc61-4569-971f-9f1df94b573b None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:02.353346 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-c3b1479a-dc61-4569-971f-9f1df94b573b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:02.366001 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1479a-dc61-4569-971f-9f1df94b573b None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:02.370620 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68be26-eded-467c-8dbf-bba5ac3a534c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:02.371491 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68be26-eded-467c-8dbf-bba5ac3a534c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:02.371768 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68be26-eded-467c-8dbf-bba5ac3a534c admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:02.372043 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68be26-eded-467c-8dbf-bba5ac3a534c admin admin] PATH_INFO: `/v3/projects/88782deb60d649168dc423aa8eab0351` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:02.373374 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68be26-eded-467c-8dbf-bba5ac3a534c admin admin] RBAC: Authorizing `identity:delete_project(project_id=88782deb60d649168dc423aa8eab0351)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:02.375294 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68be26-eded-467c-8dbf-bba5ac3a534c admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:02.423039 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4e68be26-eded-467c-8dbf-bba5ac3a534c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88782deb60d649168dc423aa8eab0351', 'request_id': 'req-4e68be26-eded-467c-8dbf-bba5ac3a534c'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:02.428323 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4e68be26-eded-467c-8dbf-bba5ac3a534c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88782deb60d649168dc423aa8eab0351', 'request_id': 'req-4e68be26-eded-467c-8dbf-bba5ac3a534c'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:02.437194 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4e68be26-eded-467c-8dbf-bba5ac3a534c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88782deb60d649168dc423aa8eab0351', 'request_id': 'req-4e68be26-eded-467c-8dbf-bba5ac3a534c'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:02.448557 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4e68be26-eded-467c-8dbf-bba5ac3a534c admin admin] The token cache is being invalidate because project 88782deb60d649168dc423aa8eab0351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:58:02.448843 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4e68be26-eded-467c-8dbf-bba5ac3a534c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:02.449554 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-4e68be26-eded-467c-8dbf-bba5ac3a534c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:02.451169 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1418/2829] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:58:02 2022] DELETE /identity/v3/projects/88782deb60d649168dc423aa8eab0351 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:58:02.455298 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5aec70-fd5d-4ac6-8a9b-dd53cf2414a8 service neutron] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:02.465315 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5aec70-fd5d-4ac6-8a9b-dd53cf2414a8 service neutron] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:02.520339 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bdd84-302b-45e3-a090-787eaf684d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:02.521240 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bdd84-302b-45e3-a090-787eaf684d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:02.521515 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bdd84-302b-45e3-a090-787eaf684d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:02.521783 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bdd84-302b-45e3-a090-787eaf684d95 admin admin] PATH_INFO: `/v3/users/c4221c98c313497c8f34139841e7829a` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:02.523079 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bdd84-302b-45e3-a090-787eaf684d95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4221c98c313497c8f34139841e7829a)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:02.525375 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bdd84-302b-45e3-a090-787eaf684d95 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:02.576088 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e34bdd84-302b-45e3-a090-787eaf684d95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4221c98c313497c8f34139841e7829a'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:02.587561 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e34bdd84-302b-45e3-a090-787eaf684d95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4221c98c313497c8f34139841e7829a'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:02.594290 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e34bdd84-302b-45e3-a090-787eaf684d95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4221c98c313497c8f34139841e7829a'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:02.604363 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e34bdd84-302b-45e3-a090-787eaf684d95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4221c98c313497c8f34139841e7829a'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:02.605123 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e34bdd84-302b-45e3-a090-787eaf684d95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4221c98c313497c8f34139841e7829a'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:02.611413 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1412/2830] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:58:02 2022] DELETE /identity/v3/users/c4221c98c313497c8f34139841e7829a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:58:02.891349 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68be26-eded-467c-8dbf-bba5ac3a534c admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:02.893026 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-4e68be26-eded-467c-8dbf-bba5ac3a534c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:02.910436 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68be26-eded-467c-8dbf-bba5ac3a534c admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:02.968531 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56a8a2-d7bb-4b34-be57-e31e8dea7980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:02.969394 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56a8a2-d7bb-4b34-be57-e31e8dea7980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:02.969667 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56a8a2-d7bb-4b34-be57-e31e8dea7980 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:02.969942 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56a8a2-d7bb-4b34-be57-e31e8dea7980 admin admin] PATH_INFO: `/v3/projects/3c12115a3f354ebd8fff82672318f73c` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:02.971180 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56a8a2-d7bb-4b34-be57-e31e8dea7980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c12115a3f354ebd8fff82672318f73c)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:02.973113 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56a8a2-d7bb-4b34-be57-e31e8dea7980 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:03.018755 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6a56a8a2-d7bb-4b34-be57-e31e8dea7980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c12115a3f354ebd8fff82672318f73c', 'request_id': 'req-6a56a8a2-d7bb-4b34-be57-e31e8dea7980'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:03.023856 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6a56a8a2-d7bb-4b34-be57-e31e8dea7980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c12115a3f354ebd8fff82672318f73c', 'request_id': 'req-6a56a8a2-d7bb-4b34-be57-e31e8dea7980'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:03.033012 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6a56a8a2-d7bb-4b34-be57-e31e8dea7980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c12115a3f354ebd8fff82672318f73c', 'request_id': 'req-6a56a8a2-d7bb-4b34-be57-e31e8dea7980'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:03.044089 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6a56a8a2-d7bb-4b34-be57-e31e8dea7980 admin admin] The token cache is being invalidate because project 3c12115a3f354ebd8fff82672318f73c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:58:03.044367 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6a56a8a2-d7bb-4b34-be57-e31e8dea7980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:03.045068 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-6a56a8a2-d7bb-4b34-be57-e31e8dea7980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:03.046678 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1419/2831] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:58:02 2022] DELETE /identity/v3/projects/3c12115a3f354ebd8fff82672318f73c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:58:03.055624 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ec217-6382-4d00-a125-3423addf9ce5 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:03.056153 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ec217-6382-4d00-a125-3423addf9ce5 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:03.056153 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ec217-6382-4d00-a125-3423addf9ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:03.074472 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-ba0ec217-6382-4d00-a125-3423addf9ce5 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:58:03.075638 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-ba0ec217-6382-4d00-a125-3423addf9ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:03.134700 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1413/2832] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:58:03.144387 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacac575-5732-46d0-8303-11752e4d4ca9 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:03.144664 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacac575-5732-46d0-8303-11752e4d4ca9 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:03.144963 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacac575-5732-46d0-8303-11752e4d4ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:03.163896 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-dacac575-5732-46d0-8303-11752e4d4ca9 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:58:03.165108 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-dacac575-5732-46d0-8303-11752e4d4ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:03.175025 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1420/2833] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:58:03.179621 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ec217-6382-4d00-a125-3423addf9ce5 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:03.190276 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ec217-6382-4d00-a125-3423addf9ce5 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:03.196056 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ff62c-5ba6-4924-bc0a-b8d2c29798f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:03.196877 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ff62c-5ba6-4924-bc0a-b8d2c29798f3 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:03.197176 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ff62c-5ba6-4924-bc0a-b8d2c29798f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:03.197451 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ff62c-5ba6-4924-bc0a-b8d2c29798f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:03.198272 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ff62c-5ba6-4924-bc0a-b8d2c29798f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:58:03.198581 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ff62c-5ba6-4924-bc0a-b8d2c29798f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:03.200198 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ff62c-5ba6-4924-bc0a-b8d2c29798f3 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:03.212161 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1414/2834] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 17:58:03.216614 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacac575-5732-46d0-8303-11752e4d4ca9 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:03.226693 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacac575-5732-46d0-8303-11752e4d4ca9 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:03.232074 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20c7e4-0aae-4d99-9d94-072be5c77a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:03.232745 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20c7e4-0aae-4d99-9d94-072be5c77a5a admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:03.233065 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20c7e4-0aae-4d99-9d94-072be5c77a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:03.233335 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20c7e4-0aae-4d99-9d94-072be5c77a5a admin admin] PATH_INFO: `/v3/projects` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:03.234031 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20c7e4-0aae-4d99-9d94-072be5c77a5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:03.235949 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20c7e4-0aae-4d99-9d94-072be5c77a5a admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:03.267751 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1421/2835] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:58:03 2022] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:58:03.271914 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ff62c-5ba6-4924-bc0a-b8d2c29798f3 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:03.282019 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ff62c-5ba6-4924-bc0a-b8d2c29798f3 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:03.343153 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502275fa-042e-4d4f-bb09-20b267b2fcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:03.343818 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502275fa-042e-4d4f-bb09-20b267b2fcd2 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:03.344120 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502275fa-042e-4d4f-bb09-20b267b2fcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:03.344387 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502275fa-042e-4d4f-bb09-20b267b2fcd2 admin admin] PATH_INFO: `/v3/users` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:03.345138 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502275fa-042e-4d4f-bb09-20b267b2fcd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:03.347063 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502275fa-042e-4d4f-bb09-20b267b2fcd2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:03.372478 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1415/2836] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:58:03 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 17:58:03.376886 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20c7e4-0aae-4d99-9d94-072be5c77a5a admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:03.387632 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20c7e4-0aae-4d99-9d94-072be5c77a5a admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:03.392524 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141d885-cfb4-4266-94d0-e8ced86c5950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:03.393222 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141d885-cfb4-4266-94d0-e8ced86c5950 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:03.393501 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141d885-cfb4-4266-94d0-e8ced86c5950 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:03.393777 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141d885-cfb4-4266-94d0-e8ced86c5950 admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:03.394519 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141d885-cfb4-4266-94d0-e8ced86c5950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:03.396182 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141d885-cfb4-4266-94d0-e8ced86c5950 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:03.407392 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1422/2837] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:58:03.411690 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502275fa-042e-4d4f-bb09-20b267b2fcd2 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:03.421989 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502275fa-042e-4d4f-bb09-20b267b2fcd2 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:03.427048 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d16ac2-4f6c-4d48-8304-d7338c4e3c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:03.427849 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d16ac2-4f6c-4d48-8304-d7338c4e3c03 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:03.428134 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d16ac2-4f6c-4d48-8304-d7338c4e3c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:03.428412 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d16ac2-4f6c-4d48-8304-d7338c4e3c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:03.429214 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d16ac2-4f6c-4d48-8304-d7338c4e3c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:03.430857 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d16ac2-4f6c-4d48-8304-d7338c4e3c03 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:03.441161 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1416/2838] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:58:03.445530 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141d885-cfb4-4266-94d0-e8ced86c5950 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:03.455344 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141d885-cfb4-4266-94d0-e8ced86c5950 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:03.460191 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db744bf-14b9-45e3-849d-591cea1a02db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:03.461126 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db744bf-14b9-45e3-849d-591cea1a02db admin admin] REQUEST_METHOD: `PUT` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:03.461408 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db744bf-14b9-45e3-849d-591cea1a02db admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:03.461685 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db744bf-14b9-45e3-849d-591cea1a02db admin admin] PATH_INFO: `/v3/projects/437b6de96dad4ec89ccdbf18e275d120/users/a5b6790f2fe246c1ad5511083168de3e/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:03.476239 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db744bf-14b9-45e3-849d-591cea1a02db admin admin] RBAC: Authorizing `identity:create_grant(project_id=437b6de96dad4ec89ccdbf18e275d120, user_id=a5b6790f2fe246c1ad5511083168de3e, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:03.479013 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db744bf-14b9-45e3-849d-591cea1a02db admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:03.496663 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1423/2839] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:58:03 2022] PUT /identity/v3/projects/437b6de96dad4ec89ccdbf18e275d120/users/a5b6790f2fe246c1ad5511083168de3e/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:58:03.508324 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c937a7-7d18-4bd7-a259-bdc2d220700b None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:03.508596 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c937a7-7d18-4bd7-a259-bdc2d220700b None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:03.508925 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c937a7-7d18-4bd7-a259-bdc2d220700b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:03.535524 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-45c937a7-7d18-4bd7-a259-bdc2d220700b None None] MFA Rules not processed for user `a5b6790f2fe246c1ad5511083168de3e`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:58:03.536709 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-45c937a7-7d18-4bd7-a259-bdc2d220700b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:03.597738 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1417/2840] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:58:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:58:03.608500 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db744bf-14b9-45e3-849d-591cea1a02db admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:03.610675 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-1db744bf-14b9-45e3-849d-591cea1a02db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:03.669934 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db744bf-14b9-45e3-849d-591cea1a02db admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:03.674241 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787964c2-908c-48f5-9ad6-d2ace117257d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:03.674871 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787964c2-908c-48f5-9ad6-d2ace117257d service cinder] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:03.675150 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787964c2-908c-48f5-9ad6-d2ace117257d service cinder] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:03.675429 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787964c2-908c-48f5-9ad6-d2ace117257d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:03.683977 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787964c2-908c-48f5-9ad6-d2ace117257d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:03.685448 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787964c2-908c-48f5-9ad6-d2ace117257d service cinder] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:03.694041 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1424/2841] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:58:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:58:14.176212 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c937a7-7d18-4bd7-a259-bdc2d220700b None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:14.177889 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-45c937a7-7d18-4bd7-a259-bdc2d220700b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:14.247382 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c937a7-7d18-4bd7-a259-bdc2d220700b None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:14.252830 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fc51b-5f2b-42c1-b32b-7e5ed9827f95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3b8e620cfd42fe993c73dc83a246be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:14.253506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fc51b-5f2b-42c1-b32b-7e5ed9827f95 service placement] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:14.253782 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fc51b-5f2b-42c1-b32b-7e5ed9827f95 service placement] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:14.254053 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fc51b-5f2b-42c1-b32b-7e5ed9827f95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:14.255844 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-0e3fc51b-5f2b-42c1-b32b-7e5ed9827f95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:14.268693 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fc51b-5f2b-42c1-b32b-7e5ed9827f95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:14.270654 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fc51b-5f2b-42c1-b32b-7e5ed9827f95 service placement] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:14.280909 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1418/2842] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:58:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:58:14.905800 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787964c2-908c-48f5-9ad6-d2ace117257d service cinder] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:14.979305 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787964c2-908c-48f5-9ad6-d2ace117257d service cinder] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:14.984520 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8678d-e14f-4077-b86f-080459dda370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:14.985421 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8678d-e14f-4077-b86f-080459dda370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:14.985708 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8678d-e14f-4077-b86f-080459dda370 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:14.985980 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8678d-e14f-4077-b86f-080459dda370 admin admin] PATH_INFO: `/v3/users/a5b6790f2fe246c1ad5511083168de3e` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:14.987281 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8678d-e14f-4077-b86f-080459dda370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5b6790f2fe246c1ad5511083168de3e)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:14.989343 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8678d-e14f-4077-b86f-080459dda370 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:15.046942 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-0fe8678d-e14f-4077-b86f-080459dda370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5b6790f2fe246c1ad5511083168de3e'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:15.047607 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-0fe8678d-e14f-4077-b86f-080459dda370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5b6790f2fe246c1ad5511083168de3e'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:15.048484 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-0fe8678d-e14f-4077-b86f-080459dda370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5b6790f2fe246c1ad5511083168de3e'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:15.060259 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-0fe8678d-e14f-4077-b86f-080459dda370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5b6790f2fe246c1ad5511083168de3e'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:15.067169 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-0fe8678d-e14f-4077-b86f-080459dda370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5b6790f2fe246c1ad5511083168de3e'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:15.081887 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1425/2843] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:58:14 2022] DELETE /identity/v3/users/a5b6790f2fe246c1ad5511083168de3e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:58:15.086677 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794062ec-a451-4b2a-856a-83b48c74ef03 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:15.086957 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794062ec-a451-4b2a-856a-83b48c74ef03 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:15.087227 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794062ec-a451-4b2a-856a-83b48c74ef03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:15.104780 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-794062ec-a451-4b2a-856a-83b48c74ef03 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:58:15.105977 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-794062ec-a451-4b2a-856a-83b48c74ef03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:15.163125 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1419/2844] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:58:15.175778 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8678d-e14f-4077-b86f-080459dda370 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:15.177308 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-0fe8678d-e14f-4077-b86f-080459dda370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:15.240585 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8678d-e14f-4077-b86f-080459dda370 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:15.244627 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504b710-610b-4353-aed2-5891b9160e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:15.245313 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504b710-610b-4353-aed2-5891b9160e89 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:15.245708 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504b710-610b-4353-aed2-5891b9160e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:15.245968 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504b710-610b-4353-aed2-5891b9160e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:15.255447 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504b710-610b-4353-aed2-5891b9160e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:15.257031 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504b710-610b-4353-aed2-5891b9160e89 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:15.267932 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1426/2845] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:58:15.537532 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794062ec-a451-4b2a-856a-83b48c74ef03 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:15.539102 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-794062ec-a451-4b2a-856a-83b48c74ef03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:15.550991 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794062ec-a451-4b2a-856a-83b48c74ef03 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:15.555650 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b56007-10c6-44fb-9075-b097e403e50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:15.556518 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b56007-10c6-44fb-9075-b097e403e50e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:15.556797 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b56007-10c6-44fb-9075-b097e403e50e admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:15.557110 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b56007-10c6-44fb-9075-b097e403e50e admin admin] PATH_INFO: `/v3/projects/437b6de96dad4ec89ccdbf18e275d120` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:15.558298 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b56007-10c6-44fb-9075-b097e403e50e admin admin] RBAC: Authorizing `identity:delete_project(project_id=437b6de96dad4ec89ccdbf18e275d120)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:15.560197 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b56007-10c6-44fb-9075-b097e403e50e admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:15.607567 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e4b56007-10c6-44fb-9075-b097e403e50e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '437b6de96dad4ec89ccdbf18e275d120', 'request_id': 'req-e4b56007-10c6-44fb-9075-b097e403e50e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:15.613697 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e4b56007-10c6-44fb-9075-b097e403e50e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '437b6de96dad4ec89ccdbf18e275d120', 'request_id': 'req-e4b56007-10c6-44fb-9075-b097e403e50e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:15.622684 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e4b56007-10c6-44fb-9075-b097e403e50e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '437b6de96dad4ec89ccdbf18e275d120', 'request_id': 'req-e4b56007-10c6-44fb-9075-b097e403e50e'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:15.632702 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e4b56007-10c6-44fb-9075-b097e403e50e admin admin] The token cache is being invalidate because project 437b6de96dad4ec89ccdbf18e275d120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:58:15.633018 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e4b56007-10c6-44fb-9075-b097e403e50e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:15.633659 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-e4b56007-10c6-44fb-9075-b097e403e50e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:15.635213 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1420/2846] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:58:15 2022] DELETE /identity/v3/projects/437b6de96dad4ec89ccdbf18e275d120 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 17:58:19.710892 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504b710-610b-4353-aed2-5891b9160e89 service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:19.712403 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-4504b710-610b-4353-aed2-5891b9160e89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:19.725683 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504b710-610b-4353-aed2-5891b9160e89 service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:19.785091 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32416244-4291-4757-8103-e5f2c97d4457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:19.785998 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32416244-4291-4757-8103-e5f2c97d4457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:19.786278 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32416244-4291-4757-8103-e5f2c97d4457 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:19.786561 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32416244-4291-4757-8103-e5f2c97d4457 admin admin] PATH_INFO: `/v3/users/dab13d690b3849888906a6234d2b2207` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:19.787826 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32416244-4291-4757-8103-e5f2c97d4457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab13d690b3849888906a6234d2b2207)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:19.790072 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32416244-4291-4757-8103-e5f2c97d4457 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:19.843248 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-32416244-4291-4757-8103-e5f2c97d4457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab13d690b3849888906a6234d2b2207'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:19.843985 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-32416244-4291-4757-8103-e5f2c97d4457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab13d690b3849888906a6234d2b2207'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:19.844611 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-32416244-4291-4757-8103-e5f2c97d4457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab13d690b3849888906a6234d2b2207'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:19.856456 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-32416244-4291-4757-8103-e5f2c97d4457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab13d690b3849888906a6234d2b2207'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:19.863446 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-32416244-4291-4757-8103-e5f2c97d4457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab13d690b3849888906a6234d2b2207'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:19.878878 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1427/2847] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:58:19 2022] DELETE /identity/v3/users/dab13d690b3849888906a6234d2b2207 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:58:19.883369 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155846fb-d74f-45cd-a255-ee9a618d2940 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:19.883863 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155846fb-d74f-45cd-a255-ee9a618d2940 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:19.883987 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155846fb-d74f-45cd-a255-ee9a618d2940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:19.901772 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-155846fb-d74f-45cd-a255-ee9a618d2940 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:58:19.902962 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-155846fb-d74f-45cd-a255-ee9a618d2940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:19.961359 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1421/2848] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 17:58:19.972639 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32416244-4291-4757-8103-e5f2c97d4457 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:19.974106 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-32416244-4291-4757-8103-e5f2c97d4457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:20.030081 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32416244-4291-4757-8103-e5f2c97d4457 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:20.033984 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e18573-ebcc-49e8-9cb5-de8c305ab6f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:20.034623 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e18573-ebcc-49e8-9cb5-de8c305ab6f5 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:20.034903 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e18573-ebcc-49e8-9cb5-de8c305ab6f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:20.035177 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e18573-ebcc-49e8-9cb5-de8c305ab6f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:20.044233 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e18573-ebcc-49e8-9cb5-de8c305ab6f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:20.045693 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e18573-ebcc-49e8-9cb5-de8c305ab6f5 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:20.055210 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1428/2849] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:58:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 17:58:20.335234 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155846fb-d74f-45cd-a255-ee9a618d2940 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:20.336772 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-155846fb-d74f-45cd-a255-ee9a618d2940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:20.349074 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155846fb-d74f-45cd-a255-ee9a618d2940 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:20.354545 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916950f-0c5c-47e2-b4e9-c4adb9d2f726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:20.355430 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916950f-0c5c-47e2-b4e9-c4adb9d2f726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:20.355725 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916950f-0c5c-47e2-b4e9-c4adb9d2f726 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:20.356019 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916950f-0c5c-47e2-b4e9-c4adb9d2f726 admin admin] PATH_INFO: `/v3/projects/477996de193f470e93832b8ea2ec9bf8` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:20.357325 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916950f-0c5c-47e2-b4e9-c4adb9d2f726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=477996de193f470e93832b8ea2ec9bf8)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:20.359239 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916950f-0c5c-47e2-b4e9-c4adb9d2f726 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:20.407325 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-8916950f-0c5c-47e2-b4e9-c4adb9d2f726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '477996de193f470e93832b8ea2ec9bf8', 'request_id': 'req-8916950f-0c5c-47e2-b4e9-c4adb9d2f726'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:20.413499 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-8916950f-0c5c-47e2-b4e9-c4adb9d2f726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '477996de193f470e93832b8ea2ec9bf8', 'request_id': 'req-8916950f-0c5c-47e2-b4e9-c4adb9d2f726'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:20.422905 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-8916950f-0c5c-47e2-b4e9-c4adb9d2f726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '477996de193f470e93832b8ea2ec9bf8', 'request_id': 'req-8916950f-0c5c-47e2-b4e9-c4adb9d2f726'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:20.433336 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-8916950f-0c5c-47e2-b4e9-c4adb9d2f726 admin admin] The token cache is being invalidate because project 477996de193f470e93832b8ea2ec9bf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:58:20.433617 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-8916950f-0c5c-47e2-b4e9-c4adb9d2f726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:20.434302 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-8916950f-0c5c-47e2-b4e9-c4adb9d2f726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:20.435893 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1422/2850] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:58:20 2022] DELETE /identity/v3/projects/477996de193f470e93832b8ea2ec9bf8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:58:20.441602 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b4bb1-c9d2-4653-b644-b22b2d2e73d7 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:20.441880 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b4bb1-c9d2-4653-b644-b22b2d2e73d7 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:20.442161 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b4bb1-c9d2-4653-b644-b22b2d2e73d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:20.460726 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-ca4b4bb1-c9d2-4653-b644-b22b2d2e73d7 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:58:20.461939 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-ca4b4bb1-c9d2-4653-b644-b22b2d2e73d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:20.523758 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1429/2851] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:58:20.532102 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48b376-fc3f-424e-9f91-55dd4fd85106 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:20.532422 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48b376-fc3f-424e-9f91-55dd4fd85106 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:20.532701 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48b376-fc3f-424e-9f91-55dd4fd85106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:20.551387 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-0f48b376-fc3f-424e-9f91-55dd4fd85106 None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:58:20.552561 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-0f48b376-fc3f-424e-9f91-55dd4fd85106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:20.560969 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1423/2852] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:58:20.565260 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b4bb1-c9d2-4653-b644-b22b2d2e73d7 None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:20.575503 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b4bb1-c9d2-4653-b644-b22b2d2e73d7 None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:20.580631 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e103ed-d2db-4774-86db-e8f168c48769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:20.581302 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e103ed-d2db-4774-86db-e8f168c48769 admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:20.581577 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e103ed-d2db-4774-86db-e8f168c48769 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:20.581850 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e103ed-d2db-4774-86db-e8f168c48769 admin admin] PATH_INFO: `/v3/domains` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:20.582578 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e103ed-d2db-4774-86db-e8f168c48769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 17:58:20.582879 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e103ed-d2db-4774-86db-e8f168c48769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:20.584460 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e103ed-d2db-4774-86db-e8f168c48769 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:20.596825 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1430/2853] 10.222.0.31 () {58 vars in 1152 bytes} [Mon Jan 10 17:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 17:58:20.601222 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48b376-fc3f-424e-9f91-55dd4fd85106 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:20.610539 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48b376-fc3f-424e-9f91-55dd4fd85106 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:20.616605 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83692671-1681-4615-8655-ded3736e35d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:20.617290 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83692671-1681-4615-8655-ded3736e35d1 admin admin] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:20.617570 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83692671-1681-4615-8655-ded3736e35d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:20.617971 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83692671-1681-4615-8655-ded3736e35d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:20.618684 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83692671-1681-4615-8655-ded3736e35d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:20.620683 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83692671-1681-4615-8655-ded3736e35d1 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:20.649617 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1424/2854] 10.222.0.31 () {60 vars in 1152 bytes} [Mon Jan 10 17:58:20 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:58:20.653808 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e103ed-d2db-4774-86db-e8f168c48769 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:20.664091 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e103ed-d2db-4774-86db-e8f168c48769 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:20.723046 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cb453-48e1-44be-8fb7-b1ad331aa5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:20.723713 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cb453-48e1-44be-8fb7-b1ad331aa5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:20.723988 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cb453-48e1-44be-8fb7-b1ad331aa5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:20.724264 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cb453-48e1-44be-8fb7-b1ad331aa5e1 admin admin] PATH_INFO: `/v3/users` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:20.725009 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cb453-48e1-44be-8fb7-b1ad331aa5e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:20.727017 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cb453-48e1-44be-8fb7-b1ad331aa5e1 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:20.748933 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1431/2855] 10.222.0.31 () {60 vars in 1143 bytes} [Mon Jan 10 17:58:20 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 17:58:20.753137 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83692671-1681-4615-8655-ded3736e35d1 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:20.763604 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83692671-1681-4615-8655-ded3736e35d1 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:20.768430 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21caa235-2522-47f1-99bc-9f8974d3b3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:20.769129 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21caa235-2522-47f1-99bc-9f8974d3b3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:20.769408 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21caa235-2522-47f1-99bc-9f8974d3b3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:20.769681 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21caa235-2522-47f1-99bc-9f8974d3b3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:20.770447 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21caa235-2522-47f1-99bc-9f8974d3b3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:20.772044 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21caa235-2522-47f1-99bc-9f8974d3b3e6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:20.782662 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1425/2856] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:58:20.786532 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cb453-48e1-44be-8fb7-b1ad331aa5e1 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:20.796565 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cb453-48e1-44be-8fb7-b1ad331aa5e1 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:20.802545 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1ddf5-3fe7-4b56-8c6e-8da3154d953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:20.803204 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1ddf5-3fe7-4b56-8c6e-8da3154d953e admin admin] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:20.803482 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1ddf5-3fe7-4b56-8c6e-8da3154d953e admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:20.803753 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1ddf5-3fe7-4b56-8c6e-8da3154d953e admin admin] PATH_INFO: `/v3/roles` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:20.804485 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1ddf5-3fe7-4b56-8c6e-8da3154d953e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:20.806116 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1ddf5-3fe7-4b56-8c6e-8da3154d953e admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:20.816404 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1432/2857] 10.222.0.31 () {58 vars in 1121 bytes} [Mon Jan 10 17:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 17:58:20.820363 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21caa235-2522-47f1-99bc-9f8974d3b3e6 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:20.830518 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21caa235-2522-47f1-99bc-9f8974d3b3e6 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:20.835520 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf77aae-24dc-47d1-a0ec-83866137cfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:20.836390 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf77aae-24dc-47d1-a0ec-83866137cfc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:20.836668 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf77aae-24dc-47d1-a0ec-83866137cfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:20.836976 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf77aae-24dc-47d1-a0ec-83866137cfc6 admin admin] PATH_INFO: `/v3/projects/fb36e7d31b6b45eba9a363741aea4328/users/2b8a1c21628a48f2aa68c9e57cffc2a0/roles/3c8f0c77d36b49608a0e17cfcff15691` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:20.853176 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf77aae-24dc-47d1-a0ec-83866137cfc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb36e7d31b6b45eba9a363741aea4328, user_id=2b8a1c21628a48f2aa68c9e57cffc2a0, role_id=3c8f0c77d36b49608a0e17cfcff15691)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:20.855789 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf77aae-24dc-47d1-a0ec-83866137cfc6 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:20.873191 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1426/2858] 10.222.0.31 () {60 vars in 1482 bytes} [Mon Jan 10 17:58:20 2022] PUT /identity/v3/projects/fb36e7d31b6b45eba9a363741aea4328/users/2b8a1c21628a48f2aa68c9e57cffc2a0/roles/3c8f0c77d36b49608a0e17cfcff15691 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:58:20.883514 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7e45f-dc91-4a2f-89e3-58adb050d505 None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:20.883801 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7e45f-dc91-4a2f-89e3-58adb050d505 None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:20.884077 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7e45f-dc91-4a2f-89e3-58adb050d505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:20.911613 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-80e7e45f-dc91-4a2f-89e3-58adb050d505 None None] MFA Rules not processed for user `2b8a1c21628a48f2aa68c9e57cffc2a0`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:58:20.912825 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-80e7e45f-dc91-4a2f-89e3-58adb050d505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:20.983869 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1433/2859] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:58:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:58:20.993912 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf77aae-24dc-47d1-a0ec-83866137cfc6 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:20.996041 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-ebf77aae-24dc-47d1-a0ec-83866137cfc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:21.056764 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf77aae-24dc-47d1-a0ec-83866137cfc6 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:21.060631 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97938c85-e51d-4e1c-bcb8-340d8541be80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:21.061314 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97938c85-e51d-4e1c-bcb8-340d8541be80 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:21.061601 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97938c85-e51d-4e1c-bcb8-340d8541be80 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:21.061877 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97938c85-e51d-4e1c-bcb8-340d8541be80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:21.070968 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97938c85-e51d-4e1c-bcb8-340d8541be80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:21.072404 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97938c85-e51d-4e1c-bcb8-340d8541be80 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:21.081481 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1427/2860] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:58:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:58:22.434262 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64067d4-7ab9-461c-8877-e660badae0fa None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:22.434833 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64067d4-7ab9-461c-8877-e660badae0fa None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:22.434953 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64067d4-7ab9-461c-8877-e660badae0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:22.454196 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-f64067d4-7ab9-461c-8877-e660badae0fa None None] MFA Rules not processed for user `2b8a1c21628a48f2aa68c9e57cffc2a0`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:58:22.455361 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f64067d4-7ab9-461c-8877-e660badae0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:22.463713 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1434/2861] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:58:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:58:36.253332 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2939e-7cbd-4384-85f3-9b1a45a968eb None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:36.253797 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2939e-7cbd-4384-85f3-9b1a45a968eb None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:36.253891 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2939e-7cbd-4384-85f3-9b1a45a968eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:36.272844 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-05d2939e-7cbd-4384-85f3-9b1a45a968eb None None] MFA Rules not processed for user `3b3dbe4735a54de1825abc28ecf00b84`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:58:36.274070 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-05d2939e-7cbd-4384-85f3-9b1a45a968eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:36.326342 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1428/2862] 10.222.0.31 () {58 vars in 1009 bytes} [Mon Jan 10 17:58:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:58:36.369752 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64067d4-7ab9-461c-8877-e660badae0fa None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:36.371270 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-f64067d4-7ab9-461c-8877-e660badae0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:36.447419 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64067d4-7ab9-461c-8877-e660badae0fa None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:36.452960 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c4ee7-ff3a-42f1-9ab1-c4dfeb95e852 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257a86ce85b4b4386cde32c8ed4b39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:36.453597 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c4ee7-ff3a-42f1-9ab1-c4dfeb95e852 service swift] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:36.453881 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c4ee7-ff3a-42f1-9ab1-c4dfeb95e852 service swift] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:36.454156 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c4ee7-ff3a-42f1-9ab1-c4dfeb95e852 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:36.462461 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c4ee7-ff3a-42f1-9ab1-c4dfeb95e852 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:36.464077 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c4ee7-ff3a-42f1-9ab1-c4dfeb95e852 service swift] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:36.472036 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1435/2863] 10.222.0.31 () {60 vars in 1384 bytes} [Mon Jan 10 17:58:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:58:36.982843 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47678aa-9a7f-4bfd-a9ea-87bc70abad7e None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:36.983154 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47678aa-9a7f-4bfd-a9ea-87bc70abad7e None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:36.983432 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47678aa-9a7f-4bfd-a9ea-87bc70abad7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:37.001183 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-c47678aa-9a7f-4bfd-a9ea-87bc70abad7e None None] MFA Rules not processed for user `3b3dbe4735a54de1825abc28ecf00b84`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:58:37.002365 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-c47678aa-9a7f-4bfd-a9ea-87bc70abad7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:37.010374 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1429/2864] 10.222.0.31 () {58 vars in 967 bytes} [Mon Jan 10 17:58:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:58:37.022663 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c4ee7-ff3a-42f1-9ab1-c4dfeb95e852 service swift] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:37.033639 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c4ee7-ff3a-42f1-9ab1-c4dfeb95e852 service swift] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:37.038894 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb66b3-f60a-4ebb-8904-9b9766f3b239 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257a86ce85b4b4386cde32c8ed4b39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:37.039522 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb66b3-f60a-4ebb-8904-9b9766f3b239 service swift] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:37.039804 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb66b3-f60a-4ebb-8904-9b9766f3b239 service swift] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:37.040080 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb66b3-f60a-4ebb-8904-9b9766f3b239 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:37.048106 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb66b3-f60a-4ebb-8904-9b9766f3b239 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:37.049744 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb66b3-f60a-4ebb-8904-9b9766f3b239 service swift] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:37.057783 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1436/2865] 10.222.0.31 () {60 vars in 1384 bytes} [Mon Jan 10 17:58:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 17:58:37.256671 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f04e9-004e-4b74-b441-20cfb1e732b2 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:37.257142 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f04e9-004e-4b74-b441-20cfb1e732b2 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:37.257284 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f04e9-004e-4b74-b441-20cfb1e732b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:37.276049 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-b74f04e9-004e-4b74-b441-20cfb1e732b2 None None] MFA Rules not processed for user `3b3dbe4735a54de1825abc28ecf00b84`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:58:37.277280 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b74f04e9-004e-4b74-b441-20cfb1e732b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:37.285655 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1430/2866] 10.222.0.31 () {58 vars in 1009 bytes} [Mon Jan 10 17:58:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:58:37.297881 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb66b3-f60a-4ebb-8904-9b9766f3b239 service swift] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:37.308814 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb66b3-f60a-4ebb-8904-9b9766f3b239 service swift] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:37.314515 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f303bf-2eb4-475d-8ca6-6bc51251b16d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257a86ce85b4b4386cde32c8ed4b39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:37.315149 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f303bf-2eb4-475d-8ca6-6bc51251b16d service swift] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:37.315429 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f303bf-2eb4-475d-8ca6-6bc51251b16d service swift] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:37.315703 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f303bf-2eb4-475d-8ca6-6bc51251b16d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:37.324190 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f303bf-2eb4-475d-8ca6-6bc51251b16d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:37.325805 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f303bf-2eb4-475d-8ca6-6bc51251b16d service swift] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:37.333857 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1437/2867] 10.222.0.31 () {60 vars in 1384 bytes} [Mon Jan 10 17:58:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:58:37.662274 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144347e9-3817-4087-967c-3722e0158457 None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:37.662560 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144347e9-3817-4087-967c-3722e0158457 None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:37.662833 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144347e9-3817-4087-967c-3722e0158457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:37.681839 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-144347e9-3817-4087-967c-3722e0158457 None None] MFA Rules not processed for user `3b3dbe4735a54de1825abc28ecf00b84`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:58:37.682990 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-144347e9-3817-4087-967c-3722e0158457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:37.690913 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1431/2868] 10.222.0.31 () {58 vars in 967 bytes} [Mon Jan 10 17:58:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:58:37.704022 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f303bf-2eb4-475d-8ca6-6bc51251b16d service swift] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:37.719906 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f303bf-2eb4-475d-8ca6-6bc51251b16d service swift] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:37.727016 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c00be-cc71-4ba4-9be7-5dbb4c3f804d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257a86ce85b4b4386cde32c8ed4b39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:37.727711 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c00be-cc71-4ba4-9be7-5dbb4c3f804d service swift] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:37.727990 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c00be-cc71-4ba4-9be7-5dbb4c3f804d service swift] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:37.728260 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c00be-cc71-4ba4-9be7-5dbb4c3f804d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:37.738568 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c00be-cc71-4ba4-9be7-5dbb4c3f804d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:37.740174 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c00be-cc71-4ba4-9be7-5dbb4c3f804d service swift] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:37.748565 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1438/2869] 10.222.0.31 () {60 vars in 1384 bytes} [Mon Jan 10 17:58:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:58:39.768800 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144347e9-3817-4087-967c-3722e0158457 None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:39.840822 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144347e9-3817-4087-967c-3722e0158457 None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:39.846007 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a80ce-ee6e-4bc8-9fab-58801cf25bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:39.846883 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a80ce-ee6e-4bc8-9fab-58801cf25bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:39.847168 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a80ce-ee6e-4bc8-9fab-58801cf25bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:39.847458 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a80ce-ee6e-4bc8-9fab-58801cf25bc2 admin admin] PATH_INFO: `/v3/users/2b8a1c21628a48f2aa68c9e57cffc2a0` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:39.848678 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a80ce-ee6e-4bc8-9fab-58801cf25bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8a1c21628a48f2aa68c9e57cffc2a0)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:39.850647 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a80ce-ee6e-4bc8-9fab-58801cf25bc2 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:39.901561 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-2e8a80ce-ee6e-4bc8-9fab-58801cf25bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8a1c21628a48f2aa68c9e57cffc2a0'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:39.912788 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-2e8a80ce-ee6e-4bc8-9fab-58801cf25bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8a1c21628a48f2aa68c9e57cffc2a0'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:39.919415 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-2e8a80ce-ee6e-4bc8-9fab-58801cf25bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8a1c21628a48f2aa68c9e57cffc2a0'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:39.928752 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-2e8a80ce-ee6e-4bc8-9fab-58801cf25bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8a1c21628a48f2aa68c9e57cffc2a0'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:39.929456 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-2e8a80ce-ee6e-4bc8-9fab-58801cf25bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8a1c21628a48f2aa68c9e57cffc2a0'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:39.935767 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1432/2870] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:58:39 2022] DELETE /identity/v3/users/2b8a1c21628a48f2aa68c9e57cffc2a0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:58:39.940747 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381e861-9971-4da6-9df2-ee2c223df63d None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:39.941332 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381e861-9971-4da6-9df2-ee2c223df63d None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:39.941429 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381e861-9971-4da6-9df2-ee2c223df63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:39.960004 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-b381e861-9971-4da6-9df2-ee2c223df63d None None] MFA Rules not processed for user `8900330194a64240acfd4144b4e26c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:58:39.961224 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b381e861-9971-4da6-9df2-ee2c223df63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:40.019534 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1439/2871] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:58:40.029796 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a80ce-ee6e-4bc8-9fab-58801cf25bc2 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:40.031459 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-2e8a80ce-ee6e-4bc8-9fab-58801cf25bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:40.089991 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a80ce-ee6e-4bc8-9fab-58801cf25bc2 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:40.094051 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa98e3b-ceb2-4320-a764-a9249afe7ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:40.094700 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa98e3b-ceb2-4320-a764-a9249afe7ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:40.094981 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa98e3b-ceb2-4320-a764-a9249afe7ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:40.095242 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa98e3b-ceb2-4320-a764-a9249afe7ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:40.104752 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa98e3b-ceb2-4320-a764-a9249afe7ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:40.106222 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa98e3b-ceb2-4320-a764-a9249afe7ab9 service neutron] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:40.115987 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1433/2872] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 17:58:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 17:58:40.298944 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381e861-9971-4da6-9df2-ee2c223df63d None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:40.300513 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b381e861-9971-4da6-9df2-ee2c223df63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:40.312823 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381e861-9971-4da6-9df2-ee2c223df63d None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:40.318250 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5c888-60a0-44d6-b681-05214f850fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:40.319195 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5c888-60a0-44d6-b681-05214f850fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:40.319552 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5c888-60a0-44d6-b681-05214f850fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:40.319822 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5c888-60a0-44d6-b681-05214f850fc3 admin admin] PATH_INFO: `/v3/projects/fb36e7d31b6b45eba9a363741aea4328` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:40.321248 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5c888-60a0-44d6-b681-05214f850fc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb36e7d31b6b45eba9a363741aea4328)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:40.323138 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5c888-60a0-44d6-b681-05214f850fc3 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:40.373968 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-62e5c888-60a0-44d6-b681-05214f850fc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb36e7d31b6b45eba9a363741aea4328', 'request_id': 'req-62e5c888-60a0-44d6-b681-05214f850fc3'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:40.379300 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-62e5c888-60a0-44d6-b681-05214f850fc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb36e7d31b6b45eba9a363741aea4328', 'request_id': 'req-62e5c888-60a0-44d6-b681-05214f850fc3'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:40.390008 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-62e5c888-60a0-44d6-b681-05214f850fc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb36e7d31b6b45eba9a363741aea4328', 'request_id': 'req-62e5c888-60a0-44d6-b681-05214f850fc3'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:40.401309 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-62e5c888-60a0-44d6-b681-05214f850fc3 admin admin] The token cache is being invalidate because project fb36e7d31b6b45eba9a363741aea4328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:58:40.401619 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-62e5c888-60a0-44d6-b681-05214f850fc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:40.402226 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-62e5c888-60a0-44d6-b681-05214f850fc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:58:40.403795 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1440/2873] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:58:40 2022] DELETE /identity/v3/projects/fb36e7d31b6b45eba9a363741aea4328 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:58:57.732881 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2efb25-9f76-4eec-96fd-2f8afb4f076f None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:57.733411 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2efb25-9f76-4eec-96fd-2f8afb4f076f None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:57.733517 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2efb25-9f76-4eec-96fd-2f8afb4f076f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:57.751856 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-2c2efb25-9f76-4eec-96fd-2f8afb4f076f None None] MFA Rules not processed for user `3b3dbe4735a54de1825abc28ecf00b84`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:58:57.753095 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-2c2efb25-9f76-4eec-96fd-2f8afb4f076f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:57.809094 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1434/2874] 10.222.0.31 () {58 vars in 967 bytes} [Mon Jan 10 17:58:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 17:58:57.821810 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5c888-60a0-44d6-b681-05214f850fc3 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:58:57.823355 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-62e5c888-60a0-44d6-b681-05214f850fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:58:57.901364 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5c888-60a0-44d6-b681-05214f850fc3 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:58:57.906993 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b29f5-7843-48f6-acfd-594e7d1ea065 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257a86ce85b4b4386cde32c8ed4b39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:58:57.907644 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b29f5-7843-48f6-acfd-594e7d1ea065 service swift] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:58:57.907930 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b29f5-7843-48f6-acfd-594e7d1ea065 service swift] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:58:57.908202 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b29f5-7843-48f6-acfd-594e7d1ea065 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:58:57.916424 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b29f5-7843-48f6-acfd-594e7d1ea065 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:58:57.918043 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b29f5-7843-48f6-acfd-594e7d1ea065 service swift] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:58:57.926138 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1441/2875] 10.222.0.31 () {60 vars in 1384 bytes} [Mon Jan 10 17:58:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 17:59:04.515083 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2efb25-9f76-4eec-96fd-2f8afb4f076f None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:59:04.516620 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-2c2efb25-9f76-4eec-96fd-2f8afb4f076f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:59:04.590279 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2efb25-9f76-4eec-96fd-2f8afb4f076f None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:59:04.594981 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da89dca-cdc0-4a8a-b7ba-931f4f322fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:59:04.595883 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da89dca-cdc0-4a8a-b7ba-931f4f322fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:59:04.596162 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da89dca-cdc0-4a8a-b7ba-931f4f322fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:59:04.596434 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da89dca-cdc0-4a8a-b7ba-931f4f322fa3 admin admin] PATH_INFO: `/v3/users/c5ae7ce87dd0438d9bbbc4fb35cfbc5c` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:59:04.597673 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da89dca-cdc0-4a8a-b7ba-931f4f322fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5ae7ce87dd0438d9bbbc4fb35cfbc5c)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:59:04.599606 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da89dca-cdc0-4a8a-b7ba-931f4f322fa3 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:59:04.647672 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-8da89dca-cdc0-4a8a-b7ba-931f4f322fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5ae7ce87dd0438d9bbbc4fb35cfbc5c'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:59:04.659611 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-8da89dca-cdc0-4a8a-b7ba-931f4f322fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5ae7ce87dd0438d9bbbc4fb35cfbc5c'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:59:04.666539 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-8da89dca-cdc0-4a8a-b7ba-931f4f322fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5ae7ce87dd0438d9bbbc4fb35cfbc5c'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:59:04.676142 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-8da89dca-cdc0-4a8a-b7ba-931f4f322fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5ae7ce87dd0438d9bbbc4fb35cfbc5c'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:59:04.676749 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-8da89dca-cdc0-4a8a-b7ba-931f4f322fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5ae7ce87dd0438d9bbbc4fb35cfbc5c'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:59:04.682555 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1435/2876] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:59:04 2022] DELETE /identity/v3/users/c5ae7ce87dd0438d9bbbc4fb35cfbc5c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:59:04.862350 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b29f5-7843-48f6-acfd-594e7d1ea065 service swift] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:59:04.875906 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b29f5-7843-48f6-acfd-594e7d1ea065 service swift] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:59:04.935693 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d7d9b-ff73-49b9-9c32-b8e2de6eb6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:59:04.936558 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d7d9b-ff73-49b9-9c32-b8e2de6eb6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:59:04.936838 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d7d9b-ff73-49b9-9c32-b8e2de6eb6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:59:04.937136 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d7d9b-ff73-49b9-9c32-b8e2de6eb6d8 admin admin] PATH_INFO: `/v3/projects/177909419ff9413893866fd1a6a16a97` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:59:04.938362 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d7d9b-ff73-49b9-9c32-b8e2de6eb6d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=177909419ff9413893866fd1a6a16a97)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:59:04.940275 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d7d9b-ff73-49b9-9c32-b8e2de6eb6d8 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:59:04.987087 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-e67d7d9b-ff73-49b9-9c32-b8e2de6eb6d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177909419ff9413893866fd1a6a16a97', 'request_id': 'req-e67d7d9b-ff73-49b9-9c32-b8e2de6eb6d8'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:59:04.992291 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-e67d7d9b-ff73-49b9-9c32-b8e2de6eb6d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177909419ff9413893866fd1a6a16a97', 'request_id': 'req-e67d7d9b-ff73-49b9-9c32-b8e2de6eb6d8'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:59:05.001131 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-e67d7d9b-ff73-49b9-9c32-b8e2de6eb6d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177909419ff9413893866fd1a6a16a97', 'request_id': 'req-e67d7d9b-ff73-49b9-9c32-b8e2de6eb6d8'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:59:05.011605 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-e67d7d9b-ff73-49b9-9c32-b8e2de6eb6d8 admin admin] The token cache is being invalidate because project 177909419ff9413893866fd1a6a16a97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:59:05.011901 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-e67d7d9b-ff73-49b9-9c32-b8e2de6eb6d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:59:05.012559 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-e67d7d9b-ff73-49b9-9c32-b8e2de6eb6d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:59:05.014237 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1442/2877] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:59:04 2022] DELETE /identity/v3/projects/177909419ff9413893866fd1a6a16a97 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:59:05.018521 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da89dca-cdc0-4a8a-b7ba-931f4f322fa3 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:59:05.019954 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-8da89dca-cdc0-4a8a-b7ba-931f4f322fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:59:05.033836 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da89dca-cdc0-4a8a-b7ba-931f4f322fa3 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:59:05.091163 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a686f57-48d1-4d18-a3cb-674eab8f2a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:59:05.092133 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a686f57-48d1-4d18-a3cb-674eab8f2a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:59:05.092417 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a686f57-48d1-4d18-a3cb-674eab8f2a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:59:05.092685 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a686f57-48d1-4d18-a3cb-674eab8f2a41 admin admin] PATH_INFO: `/v3/users/155ae167b59c404ea37fc98bbc1d3686` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:59:05.093976 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a686f57-48d1-4d18-a3cb-674eab8f2a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=155ae167b59c404ea37fc98bbc1d3686)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:59:05.095902 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a686f57-48d1-4d18-a3cb-674eab8f2a41 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:59:05.143581 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-2a686f57-48d1-4d18-a3cb-674eab8f2a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '155ae167b59c404ea37fc98bbc1d3686'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:59:05.155671 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-2a686f57-48d1-4d18-a3cb-674eab8f2a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '155ae167b59c404ea37fc98bbc1d3686'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:59:05.162501 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-2a686f57-48d1-4d18-a3cb-674eab8f2a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '155ae167b59c404ea37fc98bbc1d3686'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:59:05.172176 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-2a686f57-48d1-4d18-a3cb-674eab8f2a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '155ae167b59c404ea37fc98bbc1d3686'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:59:05.172947 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-2a686f57-48d1-4d18-a3cb-674eab8f2a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '155ae167b59c404ea37fc98bbc1d3686'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:59:05.179506 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1436/2878] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 17:59:05 2022] DELETE /identity/v3/users/155ae167b59c404ea37fc98bbc1d3686 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:59:05.356554 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d7d9b-ff73-49b9-9c32-b8e2de6eb6d8 admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 17:59:05.358218 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-e67d7d9b-ff73-49b9-9c32-b8e2de6eb6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:59:05.374510 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d7d9b-ff73-49b9-9c32-b8e2de6eb6d8 admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 17:59:05.433202 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd180b-5e4b-4bde-9b03-5186b317ed76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 17:59:05.434064 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd180b-5e4b-4bde-9b03-5186b317ed76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:59:05.434347 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd180b-5e4b-4bde-9b03-5186b317ed76 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:59:05.434625 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd180b-5e4b-4bde-9b03-5186b317ed76 admin admin] PATH_INFO: `/v3/projects/0e9d9c7dd8a0405d8a151f37390075c6` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:59:05.435936 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd180b-5e4b-4bde-9b03-5186b317ed76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e9d9c7dd8a0405d8a151f37390075c6)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 17:59:05.437899 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd180b-5e4b-4bde-9b03-5186b317ed76 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 17:59:05.494774 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-25dd180b-5e4b-4bde-9b03-5186b317ed76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e9d9c7dd8a0405d8a151f37390075c6', 'request_id': 'req-25dd180b-5e4b-4bde-9b03-5186b317ed76'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:59:05.501196 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-25dd180b-5e4b-4bde-9b03-5186b317ed76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e9d9c7dd8a0405d8a151f37390075c6', 'request_id': 'req-25dd180b-5e4b-4bde-9b03-5186b317ed76'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:59:05.511088 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-25dd180b-5e4b-4bde-9b03-5186b317ed76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e9d9c7dd8a0405d8a151f37390075c6', 'request_id': 'req-25dd180b-5e4b-4bde-9b03-5186b317ed76'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:59:05.522847 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-25dd180b-5e4b-4bde-9b03-5186b317ed76 admin admin] The token cache is being invalidate because project 0e9d9c7dd8a0405d8a151f37390075c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 17:59:05.523073 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-25dd180b-5e4b-4bde-9b03-5186b317ed76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:59:05.523772 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-25dd180b-5e4b-4bde-9b03-5186b317ed76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 17:59:05.525764 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1443/2879] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 17:59:05 2022] DELETE /identity/v3/projects/0e9d9c7dd8a0405d8a151f37390075c6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 17:59:13.988829 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09662c-ca93-4388-8517-4e887f84aa8a None None] REQUEST_METHOD: `POST` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 17:59:13.989351 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09662c-ca93-4388-8517-4e887f84aa8a None None] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 17:59:13.989351 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09662c-ca93-4388-8517-4e887f84aa8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 17:59:14.007836 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.auth.core [None req-0c09662c-ca93-4388-8517-4e887f84aa8a None None] MFA Rules not processed for user `e620249a17b347e98b3fb78f1cbba2db`. Rule list: `[]` (Enabled: `True`). {{(pid=90762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 17:59:14.009085 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-0c09662c-ca93-4388-8517-4e887f84aa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 17:59:14.067857 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1437/2880] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 17:59:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 18:01:16.837969 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19992404-78e0-4a87-89b3-191a21706f9b None None] REQUEST_METHOD: `POST` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 18:01:16.838520 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19992404-78e0-4a87-89b3-191a21706f9b None None] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 18:01:16.838520 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19992404-78e0-4a87-89b3-191a21706f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 18:01:16.857432 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.auth.core [None req-19992404-78e0-4a87-89b3-191a21706f9b None None] MFA Rules not processed for user `e620249a17b347e98b3fb78f1cbba2db`. Rule list: `[]` (Enabled: `True`). {{(pid=90763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 18:01:16.858620 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-19992404-78e0-4a87-89b3-191a21706f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:01:16.866580 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1444/2881] 10.222.0.31 () {58 vars in 957 bytes} [Mon Jan 10 18:01:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 18:01:16.901134 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09662c-ca93-4388-8517-4e887f84aa8a None None] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 18:01:16.902751 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-0c09662c-ca93-4388-8517-4e887f84aa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:01:16.961930 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09662c-ca93-4388-8517-4e887f84aa8a None None] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 18:01:16.966580 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb64571-56ef-40ca-93a9-73167b632053 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955fd3e0d82f416c99001bdc7f129017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 18:01:16.967217 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb64571-56ef-40ca-93a9-73167b632053 service cinder] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 18:01:16.967496 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb64571-56ef-40ca-93a9-73167b632053 service cinder] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 18:01:16.967753 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb64571-56ef-40ca-93a9-73167b632053 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 18:01:16.969709 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-7fb64571-56ef-40ca-93a9-73167b632053 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:01:17.041659 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb64571-56ef-40ca-93a9-73167b632053 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 18:01:17.043042 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb64571-56ef-40ca-93a9-73167b632053 service cinder] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 18:01:17.054091 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1438/2882] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 18:01:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 18:01:17.343309 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19992404-78e0-4a87-89b3-191a21706f9b None None] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 18:01:17.345112 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-19992404-78e0-4a87-89b3-191a21706f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:01:17.408591 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19992404-78e0-4a87-89b3-191a21706f9b None None] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 18:01:17.412656 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd597e79-c8d0-405b-af09-ccb36dc525f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 18:01:17.413430 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd597e79-c8d0-405b-af09-ccb36dc525f2 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 18:01:17.413710 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd597e79-c8d0-405b-af09-ccb36dc525f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 18:01:17.413983 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd597e79-c8d0-405b-af09-ccb36dc525f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 18:01:17.415880 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-dd597e79-c8d0-405b-af09-ccb36dc525f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:01:17.427191 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd597e79-c8d0-405b-af09-ccb36dc525f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 18:01:17.428618 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd597e79-c8d0-405b-af09-ccb36dc525f2 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 18:01:17.437509 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1445/2883] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 18:01:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 18:01:17.885437 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb64571-56ef-40ca-93a9-73167b632053 service cinder] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 18:01:17.886863 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-7fb64571-56ef-40ca-93a9-73167b632053 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:01:17.896693 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd597e79-c8d0-405b-af09-ccb36dc525f2 service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 18:01:17.898686 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-dd597e79-c8d0-405b-af09-ccb36dc525f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:01:17.909153 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd597e79-c8d0-405b-af09-ccb36dc525f2 service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 18:01:17.913431 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788f2ab-d19d-4985-857d-612355d0d82f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 18:01:17.914078 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788f2ab-d19d-4985-857d-612355d0d82f service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 18:01:17.914351 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788f2ab-d19d-4985-857d-612355d0d82f service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 18:01:17.914621 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788f2ab-d19d-4985-857d-612355d0d82f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 18:01:17.916426 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-b788f2ab-d19d-4985-857d-612355d0d82f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:01:17.930858 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788f2ab-d19d-4985-857d-612355d0d82f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 18:01:17.932323 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788f2ab-d19d-4985-857d-612355d0d82f service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 18:01:17.943013 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1446/2884] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 18:01:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 18:01:17.955768 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb64571-56ef-40ca-93a9-73167b632053 service cinder] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 18:01:17.961197 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207016f-8e1f-4b37-b5b7-20d35953a74e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3b8e620cfd42fe993c73dc83a246be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 18:01:17.961859 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207016f-8e1f-4b37-b5b7-20d35953a74e service placement] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 18:01:17.962140 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207016f-8e1f-4b37-b5b7-20d35953a74e service placement] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 18:01:17.962412 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207016f-8e1f-4b37-b5b7-20d35953a74e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 18:01:17.964459 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-e207016f-8e1f-4b37-b5b7-20d35953a74e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:01:17.976170 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207016f-8e1f-4b37-b5b7-20d35953a74e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 18:01:17.977792 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207016f-8e1f-4b37-b5b7-20d35953a74e service placement] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 18:01:17.987724 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1439/2885] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 18:01:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 18:01:19.133428 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788f2ab-d19d-4985-857d-612355d0d82f service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 18:01:19.142193 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788f2ab-d19d-4985-857d-612355d0d82f service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 18:01:19.145899 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b88cb-0760-4100-88a9-6d428a19228c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 18:01:19.146550 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b88cb-0760-4100-88a9-6d428a19228c service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 18:01:19.146830 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b88cb-0760-4100-88a9-6d428a19228c service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 18:01:19.147110 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b88cb-0760-4100-88a9-6d428a19228c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 18:01:19.149524 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-7d1b88cb-0760-4100-88a9-6d428a19228c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:01:19.161766 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b88cb-0760-4100-88a9-6d428a19228c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 18:01:19.163519 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b88cb-0760-4100-88a9-6d428a19228c service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 18:01:19.172049 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1447/2886] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 18:01:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 18:01:20.732721 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207016f-8e1f-4b37-b5b7-20d35953a74e service placement] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 18:01:20.735260 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-e207016f-8e1f-4b37-b5b7-20d35953a74e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:01:20.755905 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207016f-8e1f-4b37-b5b7-20d35953a74e service placement] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 18:01:20.769052 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd706a44-4d7e-4cf1-b7e4-e54ece7e2f93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 18:01:20.769748 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd706a44-4d7e-4cf1-b7e4-e54ece7e2f93 service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 18:01:20.770027 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd706a44-4d7e-4cf1-b7e4-e54ece7e2f93 service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 18:01:20.770296 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd706a44-4d7e-4cf1-b7e4-e54ece7e2f93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 18:01:20.772229 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-cd706a44-4d7e-4cf1-b7e4-e54ece7e2f93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:01:20.787177 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd706a44-4d7e-4cf1-b7e4-e54ece7e2f93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 18:01:20.788876 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd706a44-4d7e-4cf1-b7e4-e54ece7e2f93 service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 18:01:20.806042 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1440/2887] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 18:01:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 18:01:29.542240 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b88cb-0760-4100-88a9-6d428a19228c service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 18:01:29.556520 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b88cb-0760-4100-88a9-6d428a19228c service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 18:01:29.563230 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28533bd3-1e15-471b-b063-0225c261eac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 18:01:29.564000 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28533bd3-1e15-471b-b063-0225c261eac1 service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 18:01:29.564284 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28533bd3-1e15-471b-b063-0225c261eac1 service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 18:01:29.564664 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28533bd3-1e15-471b-b063-0225c261eac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 18:01:29.566644 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-28533bd3-1e15-471b-b063-0225c261eac1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:01:29.577872 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28533bd3-1e15-471b-b063-0225c261eac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 18:01:29.579496 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28533bd3-1e15-471b-b063-0225c261eac1 service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 18:01:29.588443 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1448/2888] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 18:01:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 18:01:31.226902 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd706a44-4d7e-4cf1-b7e4-e54ece7e2f93 service nova] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 18:01:31.238648 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd706a44-4d7e-4cf1-b7e4-e54ece7e2f93 service nova] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 18:01:31.244683 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efed1f1-f142-49ae-9c41-646185fcb59e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 18:01:31.245392 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efed1f1-f142-49ae-9c41-646185fcb59e service nova] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 18:01:31.245675 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efed1f1-f142-49ae-9c41-646185fcb59e service nova] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 18:01:31.245974 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efed1f1-f142-49ae-9c41-646185fcb59e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 18:01:31.247920 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-0efed1f1-f142-49ae-9c41-646185fcb59e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:01:31.260445 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efed1f1-f142-49ae-9c41-646185fcb59e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 18:01:31.262070 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efed1f1-f142-49ae-9c41-646185fcb59e service nova] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 18:01:31.276004 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1441/2889] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 18:01:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 18:03:07.539011 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28533bd3-1e15-471b-b063-0225c261eac1 service nova] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 18:03:07.582397 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28533bd3-1e15-471b-b063-0225c261eac1 service nova] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 18:03:07.588412 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fdf02-3e3e-4d14-a1ce-87d79f3bd40a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877acd6448214ef893d119e3b1043402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 18:03:07.589123 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fdf02-3e3e-4d14-a1ce-87d79f3bd40a service nova] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 18:03:07.589410 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fdf02-3e3e-4d14-a1ce-87d79f3bd40a service nova] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 18:03:07.589688 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fdf02-3e3e-4d14-a1ce-87d79f3bd40a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 18:03:07.591504 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-496fdf02-3e3e-4d14-a1ce-87d79f3bd40a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:03:07.625579 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fdf02-3e3e-4d14-a1ce-87d79f3bd40a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 18:03:07.627274 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fdf02-3e3e-4d14-a1ce-87d79f3bd40a service nova] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 18:03:07.641110 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1449/2890] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 18:03:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 18:03:15.618335 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efed1f1-f142-49ae-9c41-646185fcb59e service nova] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 18:03:15.680452 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efed1f1-f142-49ae-9c41-646185fcb59e service nova] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 18:03:15.686479 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e908d-f25c-4b0a-b250-a260467261d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3b8e620cfd42fe993c73dc83a246be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 18:03:15.687185 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e908d-f25c-4b0a-b250-a260467261d2 service placement] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 18:03:15.687470 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e908d-f25c-4b0a-b250-a260467261d2 service placement] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 18:03:15.687746 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e908d-f25c-4b0a-b250-a260467261d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 18:03:15.689842 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-178e908d-f25c-4b0a-b250-a260467261d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:03:15.714010 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e908d-f25c-4b0a-b250-a260467261d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 18:03:15.715589 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e908d-f25c-4b0a-b250-a260467261d2 service placement] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 18:03:15.725704 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1442/2891] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 18:03:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 18:03:20.065095 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fdf02-3e3e-4d14-a1ce-87d79f3bd40a service nova] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 18:03:20.085621 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fdf02-3e3e-4d14-a1ce-87d79f3bd40a service nova] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 18:03:20.089806 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528d240-4319-4a95-b529-79b5b7575796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2174a30e22c746589b3faaf4ccc8de3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 18:03:20.090454 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528d240-4319-4a95-b529-79b5b7575796 service neutron] REQUEST_METHOD: `GET` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 18:03:20.090734 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528d240-4319-4a95-b529-79b5b7575796 service neutron] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 18:03:20.091663 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528d240-4319-4a95-b529-79b5b7575796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 18:03:20.093508 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-a528d240-4319-4a95-b529-79b5b7575796 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:03:20.187056 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528d240-4319-4a95-b529-79b5b7575796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 18:03:20.188490 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528d240-4319-4a95-b529-79b5b7575796 service neutron] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 18:03:20.208445 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1450/2892] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 18:03:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 18:03:26.652532 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e908d-f25c-4b0a-b250-a260467261d2 service placement] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 18:03:26.656729 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-178e908d-f25c-4b0a-b250-a260467261d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:03:26.674001 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e908d-f25c-4b0a-b250-a260467261d2 service placement] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 18:03:26.678857 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bd2f7-9b94-4b49-b748-ac79867f68c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 18:03:26.679769 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bd2f7-9b94-4b49-b748-ac79867f68c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 18:03:26.680097 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bd2f7-9b94-4b49-b748-ac79867f68c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 18:03:26.680402 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bd2f7-9b94-4b49-b748-ac79867f68c8 admin admin] PATH_INFO: `/v3/users/e620249a17b347e98b3fb78f1cbba2db` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 18:03:26.681665 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93bd2f7-9b94-4b49-b748-ac79867f68c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e620249a17b347e98b3fb78f1cbba2db)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 18:03:26.683623 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93bd2f7-9b94-4b49-b748-ac79867f68c8 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 18:03:26.734893 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f93bd2f7-9b94-4b49-b748-ac79867f68c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e620249a17b347e98b3fb78f1cbba2db'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 18:03:26.747183 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f93bd2f7-9b94-4b49-b748-ac79867f68c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e620249a17b347e98b3fb78f1cbba2db'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 18:03:26.753943 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f93bd2f7-9b94-4b49-b748-ac79867f68c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e620249a17b347e98b3fb78f1cbba2db'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 18:03:26.762325 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f93bd2f7-9b94-4b49-b748-ac79867f68c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e620249a17b347e98b3fb78f1cbba2db'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 18:03:26.762935 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-f93bd2f7-9b94-4b49-b748-ac79867f68c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e620249a17b347e98b3fb78f1cbba2db'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 18:03:26.769174 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1443/2893] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 18:03:26 2022] DELETE /identity/v3/users/e620249a17b347e98b3fb78f1cbba2db => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 18:03:26.943523 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528d240-4319-4a95-b529-79b5b7575796 service neutron] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 18:03:26.954928 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528d240-4319-4a95-b529-79b5b7575796 service neutron] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 18:03:27.024637 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d43ef-4ec5-42f7-87ad-37a1fc1c992d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 18:03:27.025559 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d43ef-4ec5-42f7-87ad-37a1fc1c992d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 18:03:27.025840 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d43ef-4ec5-42f7-87ad-37a1fc1c992d admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 18:03:27.026111 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d43ef-4ec5-42f7-87ad-37a1fc1c992d admin admin] PATH_INFO: `/v3/projects/70891404a20f4177b6c2d794789ffaf8` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 18:03:27.027406 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d43ef-4ec5-42f7-87ad-37a1fc1c992d admin admin] RBAC: Authorizing `identity:delete_project(project_id=70891404a20f4177b6c2d794789ffaf8)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 18:03:27.029425 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d43ef-4ec5-42f7-87ad-37a1fc1c992d admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 18:03:27.078204 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-984d43ef-4ec5-42f7-87ad-37a1fc1c992d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70891404a20f4177b6c2d794789ffaf8', 'request_id': 'req-984d43ef-4ec5-42f7-87ad-37a1fc1c992d'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 18:03:27.083454 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-984d43ef-4ec5-42f7-87ad-37a1fc1c992d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70891404a20f4177b6c2d794789ffaf8', 'request_id': 'req-984d43ef-4ec5-42f7-87ad-37a1fc1c992d'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 18:03:27.092751 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-984d43ef-4ec5-42f7-87ad-37a1fc1c992d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70891404a20f4177b6c2d794789ffaf8', 'request_id': 'req-984d43ef-4ec5-42f7-87ad-37a1fc1c992d'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 18:03:27.103951 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-984d43ef-4ec5-42f7-87ad-37a1fc1c992d admin admin] The token cache is being invalidate because project 70891404a20f4177b6c2d794789ffaf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 18:03:27.104219 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-984d43ef-4ec5-42f7-87ad-37a1fc1c992d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 18:03:27.104842 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-984d43ef-4ec5-42f7-87ad-37a1fc1c992d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 18:03:27.106386 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1451/2894] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 18:03:26 2022] DELETE /identity/v3/projects/70891404a20f4177b6c2d794789ffaf8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 18:03:27.110563 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bd2f7-9b94-4b49-b748-ac79867f68c8 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 18:03:27.112766 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-f93bd2f7-9b94-4b49-b748-ac79867f68c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:03:27.129617 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bd2f7-9b94-4b49-b748-ac79867f68c8 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 18:03:27.187242 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d15c3-1a84-4b18-b252-52fb1bf1cc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 18:03:27.188018 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d15c3-1a84-4b18-b252-52fb1bf1cc41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 18:03:27.188293 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d15c3-1a84-4b18-b252-52fb1bf1cc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 18:03:27.188561 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d15c3-1a84-4b18-b252-52fb1bf1cc41 admin admin] PATH_INFO: `/v3/users/25cd96a5e6fc4c8ab447b2480bf1dbd3` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 18:03:27.189892 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d15c3-1a84-4b18-b252-52fb1bf1cc41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25cd96a5e6fc4c8ab447b2480bf1dbd3)` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 18:03:27.191828 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d15c3-1a84-4b18-b252-52fb1bf1cc41 admin admin] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 18:03:27.239921 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4d1d15c3-1a84-4b18-b252-52fb1bf1cc41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25cd96a5e6fc4c8ab447b2480bf1dbd3'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 18:03:27.251240 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4d1d15c3-1a84-4b18-b252-52fb1bf1cc41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25cd96a5e6fc4c8ab447b2480bf1dbd3'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 18:03:27.257790 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4d1d15c3-1a84-4b18-b252-52fb1bf1cc41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25cd96a5e6fc4c8ab447b2480bf1dbd3'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 18:03:27.268497 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4d1d15c3-1a84-4b18-b252-52fb1bf1cc41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25cd96a5e6fc4c8ab447b2480bf1dbd3'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 18:03:27.269157 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.notifications [None req-4d1d15c3-1a84-4b18-b252-52fb1bf1cc41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25cd96a5e6fc4c8ab447b2480bf1dbd3'} {{(pid=90762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 18:03:27.275103 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1444/2895] 10.222.0.31 () {58 vars in 1223 bytes} [Mon Jan 10 18:03:27 2022] DELETE /identity/v3/users/25cd96a5e6fc4c8ab447b2480bf1dbd3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 18:03:27.470851 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d43ef-4ec5-42f7-87ad-37a1fc1c992d admin admin] Authenticating user token {{(pid=90763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 18:03:27.472294 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.fernet_utils [None req-984d43ef-4ec5-42f7-87ad-37a1fc1c992d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:03:27.485287 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d43ef-4ec5-42f7-87ad-37a1fc1c992d admin admin] Validating token access rules against request {{(pid=90763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 18:03:27.541502 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433bca7-4164-4e9a-b81d-2c77f2e6ee13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8900330194a64240acfd4144b4e26c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5870ae6e4a4492ac99ab89391674b9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 18:03:27.542369 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433bca7-4164-4e9a-b81d-2c77f2e6ee13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 18:03:27.542650 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433bca7-4164-4e9a-b81d-2c77f2e6ee13 admin admin] SCRIPT_NAME: `/identity` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 18:03:27.542922 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433bca7-4164-4e9a-b81d-2c77f2e6ee13 admin admin] PATH_INFO: `/v3/projects/1b795c12898f4adaae232be11306ad71` {{(pid=90763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 18:03:27.544109 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433bca7-4164-4e9a-b81d-2c77f2e6ee13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b795c12898f4adaae232be11306ad71)` {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 18:03:27.546104 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433bca7-4164-4e9a-b81d-2c77f2e6ee13 admin admin] RBAC: Authorization granted {{(pid=90763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 18:03:27.595302 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d433bca7-4164-4e9a-b81d-2c77f2e6ee13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b795c12898f4adaae232be11306ad71', 'request_id': 'req-d433bca7-4164-4e9a-b81d-2c77f2e6ee13'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 18:03:27.600738 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d433bca7-4164-4e9a-b81d-2c77f2e6ee13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b795c12898f4adaae232be11306ad71', 'request_id': 'req-d433bca7-4164-4e9a-b81d-2c77f2e6ee13'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 18:03:27.609875 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d433bca7-4164-4e9a-b81d-2c77f2e6ee13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b795c12898f4adaae232be11306ad71', 'request_id': 'req-d433bca7-4164-4e9a-b81d-2c77f2e6ee13'} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 18:03:27.620815 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d433bca7-4164-4e9a-b81d-2c77f2e6ee13 admin admin] The token cache is being invalidate because project 1b795c12898f4adaae232be11306ad71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 18:03:27.621134 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d433bca7-4164-4e9a-b81d-2c77f2e6ee13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 18:03:27.621821 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: DEBUG keystone.notifications [None req-d433bca7-4164-4e9a-b81d-2c77f2e6ee13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 18:03:27.623521 dv-cinder-824031-2-iscsi devstack@keystone.service[90763]: [pid: 90763|app: 0|req: 1452/2896] 10.222.0.31 () {58 vars in 1232 bytes} [Mon Jan 10 18:03:27 2022] DELETE /identity/v3/projects/1b795c12898f4adaae232be11306ad71 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 18:08:18.419705 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d15c3-1a84-4b18-b252-52fb1bf1cc41 admin admin] Authenticating user token {{(pid=90762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 18:08:18.421408 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-4d1d15c3-1a84-4b18-b252-52fb1bf1cc41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:08:18.494905 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d15c3-1a84-4b18-b252-52fb1bf1cc41 admin admin] Validating token access rules against request {{(pid=90762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 18:08:18.564975 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d02b30-9ce5-42cf-a4e1-43c25c621d3c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3b8e620cfd42fe993c73dc83a246be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1415eea0335a49bf800e8215498af679', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 18:08:18.565632 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d02b30-9ce5-42cf-a4e1-43c25c621d3c service placement] REQUEST_METHOD: `GET` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 18:08:18.565910 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d02b30-9ce5-42cf-a4e1-43c25c621d3c service placement] SCRIPT_NAME: `/identity` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 18:08:18.566161 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d02b30-9ce5-42cf-a4e1-43c25c621d3c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 18:08:18.568109 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.fernet_utils [None req-b8d02b30-9ce5-42cf-a4e1-43c25c621d3c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 18:08:18.579120 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d02b30-9ce5-42cf-a4e1-43c25c621d3c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 18:08:18.580690 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d02b30-9ce5-42cf-a4e1-43c25c621d3c service placement] RBAC: Authorization granted {{(pid=90762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 18:08:18.590189 dv-cinder-824031-2-iscsi devstack@keystone.service[90762]: [pid: 90762|app: 0|req: 1445/2897] 10.222.0.31 () {60 vars in 1365 bytes} [Mon Jan 10 18:08:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)